about LOLA technology

The Dream 10th anniversary
…a viola Masterclass with New World Symphony,
at the GARR Conference 2005, in Pisa...
“To perform together, from distant locations...
as if distance has vanished
in a click of a computer mouse”
www.conservatorio.trieste.it
14:00
The LOLA team
LOLA v1.4.2
…and real life
Audio only…
www.conservatorio.trieste.it
The LOLA team
LOLA v1.4.2
Audio/Video tools before LOLA…
Conference XP
www.conservatorio.trieste.it
H.323/SIP
DVTS
Skype
The LOLA team
LOLA v1.4.2
Audio/Video tools before LOLA…
Latency: 400ms
Echo
H.323/SIP
DVTS
Latency: 350ms
Echo
Latency: > 300ms
Audio for voice
Auto echo
cancellation
Conference XP
Skype
www.conservatorio.trieste.it
Latency: 200ms
Audio for voice
Auto echo
cancellation
The LOLA team
LOLA v1.4.2
Latency disables interaction
If there is No natural way for our brain to deal with events,
Then we need “rules and protocols”
“Latency is not just an impediment to musical interaction;
it’s an impediment to human interaction!” Dan Nichols (NIU)
www.conservatorio.trieste.it
Talking, Playing, Acting, Dancing, Driving, …
The LOLA team
LOLA v1.4.2
Latency à Echo!
www.conservatorio.trieste.it
Courtesy of Brian Shepard, TCU
The LOLA team
LOLA v1.4.2
No Echo à No Music!
www.conservatorio.trieste.it
The LOLA team
LOLA v1.4.2
So, we came to LOLA…
Latency: 5ms
Audio for music
No echo
http://www.conts.it/artistica/lola-project/
www.conservatorio.trieste.it
25 Mbps à 100 Mbps
à 500 Mbps à 2.5 Gbps
30 fps à 90 fps
2 ch à 10 ch
Very Fast reliable networks
Hi-Speed cameras
Machine Vision Grabbers
USB3 Vision
Good PC (i5/i7)
…
New programming
approach!
The LOLA team
LOLA v1.4.2
LOLA very basic schema
For a detailed overview:
http://www.garr.tv/home/viewvideo/675/npap-workshoplola-update-and-demonstration-callocchio
(NPAPWS 2013 @ MDW, Vienna)
www.conservatorio.trieste.it
Research &
Education
Networks
The LOLA team
LOLA v1.4.2
LOLA Concerts
Mario Brunello
Marjorie Bagley & Cheng Hou-Lee
T-Bone Burnett & Chuck Mead
http://www.conts.it/artistica/lola-project/lola-video
www.conservatorio.trieste.it
Mauro Maur & Francoise de Clossey
The LOLA team
LOLA v1.4.2
LOLA Concerts/ Masterclasses
www.conservatorio.trieste.it
The LOLA team
LOLA v1.4.2
LOLA is made by its users!
•  “I need and easy backstage channel to talk to my
remote technical partner!”
•  “I’m not a network expert, I need a quick real time
snapshot of what is going on…”
•  “I really need LOLA to teach in places were we will
never have 1Gbps…”
•  “I need HD to see details and feel closer”
www.conservatorio.trieste.it
•  “What the musicians need to see is different from
what the audience likes!”
The LOLA team
LOLA v1.4.2
LOLA v1.4.2 answers
•  “I need and easy backstage channel to talk to my remote technical
partner!”
•  à an embedded permanent chat service
•  à always active, even when not “connected”
www.conservatorio.trieste.it
•  à “send debug info to remote”
•  à send/receive “audio tone” to remote
The LOLA team
LOLA v1.4.2
LOLA v1.4.2 answers
•  “I’m not a network expert, I need
a quick real time snapshot of
what is going on…”
www.conservatorio.trieste.it
•  à new detailed
“Network Monitor”
panel
The LOLA team
LOLA v1.4.2
LOLA v1.4.2 answers
•  “What the musicians need to see is different from what the audience
likes!”
à
à
à
à
multiple video windows layouts
duplicate remote video window
fully scalable windows zoom
multiple cameras
www.conservatorio.trieste.it
• 
• 
• 
• 
The LOLA team
LOLA v1.4.2
LOLA v1.4.2 answers
•  “I really need LOLA to teach in
places were we will never have
1Gbps…”
www.conservatorio.trieste.it
•  à fast JPEG video
compression (CUDA or
CPU based)
•  à ~ 0.3 - 3ms latency
•  à ~ 30Mbps (color)
•  à ~ 12Mbps (b/w)
The LOLA team
LOLA v1.4.2
LOLA v1.4.2 answers
•  “I need HD video”
www.conservatorio.trieste.it
•  à Digital cameras
(CXP – Imperx,
USB3 – Ximea,
PtGrey)
•  à full color tuning
•  à RGB or Bayer
encoded
The LOLA team
LOLA v1.4.2
Other v1.4.2 new features
•  Audio Only sessions (if needed)
•  Full recording of A/V sessions
www.conservatorio.trieste.it
•  LOLA-Tester traffic generator
•  Full support for Windows 8.1
•  It even runs on Apple h/w (bootcamp)
The LOLA team
LOLA v1.4.2
V1.4.2: Digital Cameras
•  HD cameras with scalable resolution;
•  à from SD to HD
•  Up to 100m (300’) cable at 60fps or more with USB3 optical
extenders
•  à non invasive
•  Native digital Bayer encoded color;
•  à 66% less bandwidth
www.conservatorio.trieste.it
•  Video, power, remote camera control over a single 75ohm
standard video cable with BNC connectors (Gen<i>cam) or
USB3 cable
•  à easy clean control
The LOLA team
LOLA v1.4.2
LOLA in the lab (Alpha)
•  Single/multiple video streams
•  Embedded video stream “director”
www.conservatorio.trieste.it
•  Multiple cameras per video board (CXP or
USB3 card)
•  à multiple viewpoints
The LOLA team
LOLA v1.4.2
LOLA in the field (Beta)
•  Multiple sites connections support
•  It works!
www.conservatorio.trieste.it
The LOLA team
LOLA v1.4.2
Still…
www.conservatorio.trieste.it
The LOLA team
LOLA v1.4.2
LOLA: How do I get it?
Freely available for non-commercial academic use!
•  you sign the free non-commercial academic use license and get the s/w
•  … and you’re a member of the LOLA community to start experimenting with it!
www.conservatorio.trieste.it
•  you build your own hardware following the specs:
•  1 PC with PCIe bus, CPU:
•  duoCore 2.0Ghz (SD in b/w)
•  i5 (SD in color or HD in b/w)
•  i7 (HD in color with CXP or USB3 cameras)
•  1 RME HDSP (or equivalent) audio card;
•  1 BitFlow Grabber (analog or CXP) video card or good USB3 card
•  1 fast industrial progressive scan machine vision camera
•  analog SD b/w (Sony HR50)
•  analog HD b/w (Sony HR70)
•  analog SD color (Hitachi KP-FD30(M), Toshiba IK-TF5)
•  CXP HD color (Imperx B1410C-CXP / B1411C-CXP)
•  USB3 XIMEA or PtGrey series
•  1 fast GPU card (for HD color, NVIDIA Geoforce GTX)
•  (you easily build your own analog/coax camera cables)
The LOLA team
LOLA v1.4.2
LOLA community: [email protected]
Contact us at [email protected]
www.conservatorio.trieste.it
•  Conservatorio G. Tartini, Trieste, Italy
•  Northern Illinois University School of Music - DeKalb, IL, USA
•  CESNET - Czech Republic Research and Education Network - Praha, CZ
•  New World Symphony - America's Orchestral Academy – Miami, FL, USA
•  Internet2 networking consortium - Washington, DC, USA
•  Università degli Studi di Cassino e del Lazio Meridionale - Cassino, Italy
•  JAnet - UK Education and Research Network - Oxford, Didcot, UK
•  Universidade de São Paulo - CMU, Departamento de Música - São Paulo, Brasil
•  Rensselaer Polytechnic Institute - Department of the Arts - Troy, NY, USA
•  MAGPI - Mid-Atlantic Gigapop - Multimedia Service - Philadelphia, PA, USA
•  Napier University, School of Arts and Creative Industries, Music dept. -Edinburgh, UK
•  University of North Carolina, School of Music, Greensboro, NC, USA
•  Royal Academy of Music, Aarhus, Denmark
•  Joseph Haydn Konservatorium, Eisenstadt, Austria
•  University of Southern California, School of Music, Los Angeles,CA,USA
•  Berklee College of Music, Boston, MA, USA
•  Universität für Musik und darstellende Kunst Wien, Austria
•  Interlochen Center for the Arts, Interlochen, MI, USA
•  Conservatorio di Musica Licinio Refice - Frosinone – Italy
•  Royal Northern College of Music, Manchester – UK
•  Leeds College of Music, Leeds – UK
•  TAMU - Texas A&M University, S. Antonio, TX – USA
• Lafayette Facilities, USA
•  UNINETT - The Norwegian Academic and Education Network, Trondheim, Norway
•  San Francisco Jazz, USA
•  Engage 3D, Chattanooga – TN - USA
•  Univeristy of Nebraska, Lincoln, USA
•  AARNET - Australian Academic and Research Network, Sydney – Australia
•  The Exploratorium, San Francisco, USA
•  Civitium Org, Rome – GA - USA
•  Chapman University, USA
•  CESGA - Galicia Supercomputing Center, Vigo – Spain
•  The Columbia College, Chicago, USA
•  Universida de Vigo, Vigo – Spain
•  Salford University, UK
•  National Center of Arts, Ottawa – Canada
•  he Burlington Public Library, USA
•  Royal Danish Academy of Music, Copenhagen – Denmark
•  Tampere University, Finland
•  University of Nevada, School of Journalism, Las Vegas – NV – USA
•  George Washington University, USA
•  The Royal Collee of Music, London, UK
•  Conservatorio di Cosenza, Italy
•  Birmingham Conservatory of Music, UK
•  Conservatorio G. Verdi, Milano, Italy
•  Georgia Tech University, Atlanta, GA, USA
•  Iowa State University, IA, USA
•  Pittsburgh University, USA
The LOLA team
LOLA v1.4.2
Questions?
www.conservatorio.trieste.it
http://www.conts.it/artistica/lola-project
[email protected]
The LOLA team
LOLA v1.4.2