Augmented Reality - Institut für Informatik

Transcription

Virtuelle Realität
Part 14:
Augmented Reality
Virtuelle Realität
Wintersemester 2007/08
Prof. Bernhard Jung
Overview

Introduction to Augmented Reality
Augmented Reality Displays
Examples
AR Toolkit – an open source software
library for building AR applications
Further Reading
O. Bimber & R. Raskar. Spatial Augmented Reality: A Modern Approach to Augmented
Reality. B & T. 2005.
see also: http://www.spatial-ar.com/courses.htm
http://www.augmented-reality.org/
http://www.howstuffworks.com/augmented-reality.htm
Prof. B. Jung
Virtuelle Realität
TU Bergakademie Freiberg
1
Virtuelle Realität
Mixed Reality

The Reality-Virtuality Continuum
P. Milgram, H.Takemura, A.Utsumi, F. Kishino:
Augmented Reality: A class of Displays on the Reality-Virtuality Continuum
SPIE Vol. 2351, Telemanipulator and Telepresence Technologies, 1994.
http://vered.rose.utoronto.ca/publication/1994/Milgram_Takemura_SPIE1994.pdf
Prof. B. Jung
Virtuelle Realität
Augmented Reality (AR)

images projected over the real world

types of information

aircraft / automobile head-up display
semi-transparent goggles
handhelds (PDA, smartphone)
projecting onto a desktop
…
unrelated – e.g. reading email with wearable
related – e.g. virtual objects interacting with world
issues

registration – aligning virtual and real
eye gaze direction
Prof. B. Jung
Virtuelle Realität
Vampire Project
Visual Active Memory Processes and
Interactive Retrieval (U Bielefeld)
2
Virtuelle Realität
Applications of AR

Navigation Systems
Maintenance

overlay instructions
display schematic
bmwusa.com
Museums
Gaming
…
howstuffworks.com
http://www.research.ibm.com/journal/sj/
384/spohrer.html
Prof. B. Jung
www.microvision.com
Virtuelle Realität
Augmented Interaction
http://www.csl.sony.co.jp/person/rekimoto/uist95/uist95.html

Goal: enhance the real world
sensation with useful
information
Users see real and virtual
objects
Location-dependent additional
information can be provided
(display menu cards for
restaurants)
The real sensation can be
partially disabled (replace all
billboards with pictures from
last holiday ...)
Photo-realism not necessarily
first goal but in the ultimate
system, people cannot decide
whether parts are virtual or
real
Prof. B. Jung
Virtuelle Realität
3
Virtuelle Realität
Augmented Reality - What do we need for the
combination of real and virtual worlds?

Locations and optical properties of the viewer (or camera) and the display

Calibration of all devices

Combination of all local coordinate systems centered on the devices and the objects
in the scene in a global coordinate system

Registration of models of all 3D object of interest with their counterparts in the scene

Tracking of objects over time when the user moves and interacts with scene

Realistic merging requires:

Objects to behave in physically plausible manner when manipulated

Occlusion

Collision detection

Shadows

Detailed description of the physical scene
Source: Cindy Robertson (Georgia Tech)
Prof. B. Jung
Virtuelle Realität
AR Displays: Overview and Classification
Bimber & Raskar
Prof. B. Jung
Virtuelle Realität
4
Virtuelle Realität
Retinal Displays
Bimber & Raskar
Prof. B. Jung
Virtuelle Realität
Head Mounted Displays
Bimber & Raskar
Prof. B. Jung
Virtuelle Realität
5
Virtuelle Realität
Handheld Displays
Prof. B. Jung
Bimber & Raskar
Virtuelle Realität
Bimber & Raskar
Spatial Optical See-Through Displays
www.laser-magic.com
http://io2technology.com
Prof. B. Jung
Virtuelle Realität
6
Virtuelle Realität
Projection-based Augmentation
Bimber & Raskar
Prof. B. Jung
Virtuelle Realität
Example: DigitalDesk (Wellner, Xerox, 1992)
http://www.xrce.xerox.com/competencies/past-projects/ip/digitalDesk.html

Extending the desktop metaphor to the real desk
Virtual (displayed) and real documents share the same space
Prof. B. Jung
Virtuelle Realität
7
Virtuelle Realität
Example: Augmented Reality for New Gaming
Experiences
Research Project: Virtual Reality and Hypermedia in Future Telecommunication Products and Services
University of Oulu, Finland
http://www.infotech.oulu.fi/Annual/2000/VIRGIN.html
Prof. B. Jung
Virtuelle Realität
Example: Augmented Reality for New Gaming
Experiences
Mozzies Game on Siemens SX1 mobile phone
The mosquitoes can be seen
as they are placed on the
live video feed from the
camera. Aiming is done by
moving the phone around
so that the mosquitoes are
at the cross hair.
The Camera is used to
detect the motion.
http://en.wikipedia.org/wiki/Siemens_SX1
Prof. B. Jung
Virtuelle Realität
8
Virtuelle Realität
Example: AR Quake
http://wearables.unisa.edu.au/projects/ARQuake/www/
Prof. B. Jung
Virtuelle Realität
Example: Steve Mann – "Cyborg"
http://www.eyetap.org/

Steven Mann (MIT, now Toronto University)

"Steve Mann is the world’s first real cyborg, a man who exists in harmony
with technology." Canadian Film Institute, 2001
Started to develop ‚Cyborg‘ equipment in school
Since the 1980s he is constantly wearing his ‚WearComp‘
His main research is for privacy and social impacts
He noticed two main trends:

The technology diminished (everything moved into sunglasses)
His ‚Cyborg‘-feeling has been growing over the years
http://www.imdb.com/title/tt0301145/
2007
Prof. B. Jung
Virtuelle Realität
9
Virtuelle Realität
Example: Reality Window Manager (EyeTap)
http://www.eyetap.org/, http://wearcam.org/

Window manager for XWindows that overlays xterms and other windows onto
planar patched in the environment
Allows for real-time tracking, replacement and rendering
Prof. B. Jung
Virtuelle Realität
Example:
Third-person perspective in augmented reality (???)
Salamin, P., Thalmann, D., and Vexo, F. 2006.
http://vrlab.epfl.ch/Publications/pdf/Salamin_Thalmann_Vexo_VRST_06.pdf
Prof. B. Jung
Virtuelle Realität
10
Virtuelle Realität
ARToolKit – an open source software
library for building AR applications

ARToolKit uses computer vision algorithms to solve the
problem of tracking the users viewpoint
calculates the camera position and orientation
relative to physical markers in real time
http://www.hitl.washington.edu/artoolkit/
live demo …
Prof. B. Jung
Virtuelle Realität
11