Tools for Interactive Multimedia Applications

Tools for Interactive Multimedia
Applications
Roman Berka, Jakub Hybler
DCGI, IIM - FEL CTU in Prague
SW tools: VDMX, Arcaos, Modul8, Resolume, blender, LIVES, ...
Programming tools: Processing (& Arduino), PureData (MAX MSP), Isadora,
EYESweb, VVVV,...
HW tools: iCube, MIDItron, Arduino, BasicStamp, video-sekvencers (video-samplers),
video-mixers, media-servers, digital-lights, sensors, controllers, actuators, ...
Protocols: [RS232, MIDI, DMX], UDP stream (OSC, ArtNET), …
Motivation
Using chain of sensors, processing sw/hw tools
and actuators to move something, play or shine
according to behavior of a user, player or
another source of physically measurable
signals
Software tools
Video-servers
VDMX
arKaos
LIVES
Programming tools
Processing
VDMX
Real-time video mixing sw for Djs
http://www.vidvox.net/
VDMX Example
ArKaos
Renders selected videos
to external ouput (VGA)
Controlled via MIDI, DMX
Uses layers, effects
ArKaos VJ DMX 3.6.1
Example
LIVES
Video editing tool
Real-time video-mixer
Linux (Unix) platform
Cooperation in network
using
OSC protocol
Processing
Programming language based on JAVA :-)
Programming modes:
Basic Mode
Continuous Mode
Java Mode
Rendering modes - JAVA2D,P2D,P3D,OPENGL
Simple & fast usability
Used in many MM projects
Processing sketch
Example
Hardware tools
Arduino
ICube
ARDUINO
Flexible microprocessor developing platform
Fast prototyping platform
Uses IDE based on processing language
Originally wiring
Fritzing (sw)
http://www.arduino.cc/
Arduino examples
iCUBE
Black-box
Analog inputs
Analog outputs
Controls sw via MIDI
Set of sensors and actuators (5V)
Protocols
MIDI
OSC
MIDI
asynchronous serial interface
1 start bit, 8 data bits, and 1 stop bit
Based on messages
1 and more bytes per message
1st byte status (the highest bit set to 1)
OSC
http://opensoundcontrol.org/
communication among computers, sound
synthesizers, and other multimedia devices
Oprimised for networks
300times faster then MIDI
Uses USB, IEEE-1394, Fast Ethernet
References
(1)Massimo Banzi: Getting Started with Arduino, Make; 1 edition (October 15,
2008), ISBN-10: 0596155514
Note: drawn pictures on some slides taken from (1)