Panoramic imaging

Panoramic imaging
State of the art and future challenges
Pablo d'Angelo
Overview
●
Panoramic imaging
●
Panorama software
●
Merging images
–
HDR, Lens distortion, Vignetting
●
Correcting images
●
Future work
Pablo d'Angelo
LGM 2007
Panoramic images
●
Partial Panoramas:
●
Immersive Panoramas:
●
Stitching individual images
Pablo d'Angelo
LGM 2007
Stitching Software
●
Image editors (Photoshop, GIMP, ...)
●
Dedicated Stitching software
–
–
Panorama Tools, Hugin
Non-free programs
●
●
PTGui, PTAssembler, PTMac
Autostitch, Autopano Pro, Canon Photostitch, ...
Pablo d'Angelo
LGM 2007
Stitching process
Correspondence
analysis
(Autopano-SIFT)
Determine image
placement
(PTOptimizer)
Transform
individual images
(nona, Ptmender)
Photograph
images
merge and retouch
(enblend, gimp,
cinepaint, krita, ...)
Interactive viewing,
printing
(FreePV, PTViewer,
panoglview)
Pablo d'Angelo
LGM 2007
Hugin
●
●
GUI for panorama creation
Command line tools
–
–
–
●
fulla, correction of single images
autooptimizer, determine image placement
nona, remaps and merges images
Used tools:
–
–
–
Autopano SIFT
enblend
Panorama Tools
Pablo d'Angelo
LGM 2007
Hugin
Demo
●
Partial Panorama
●
HDR panorama
Pablo d'Angelo
LGM 2007
Image defects
●
Lens distortion
●
Vignetting
●
Transverse
chromatic
abberations
Examples from wiki.panotools.org
Pablo d'Angelo
LGM 2007
Vignetting
Vignetting correction
Pablo d'Angelo
LGM 2007
Vignetting
Image blending
Pablo d'Angelo
LGM 2007
Spherical panorama
Original images
Pablo d'Angelo
LGM 2007
Spherical panorama
Vignetting, exposure and WB
correction
Pablo d'Angelo
LGM 2007
Image correction
Workflow
Correction:
Photograph
images
Automatic correction
(fulla,
In the future:ufraw, gimp,
krita, digikam, ...)
Camera
Database
Camera
Calibration:
Images/
panorama
Hugin
Required once for each lens/camera
Pablo d'Angelo
LGM 2007
Image correction
Software
●
Modular, easily embeddable library
–
–
–
●
API to access Camera database
Image processing functions
Plugins for image editors, RAW converters
One step further:
–
–
Automatic registration in image editors?
Merge layers using enblend?
Pablo d'Angelo
LGM 2007
Image correction
Database
●
●
Estimate correction parameters using
Hugin
Community driven:
–
–
●
Users contribute camera/lens profiles
created with Hugin
Quality control of submitted profiles
required
To be done:
–
–
–
Define database format and scope
Calibration instructions
Web app for database maintenance?
Pablo d'Angelo
LGM 2007
Google Summer of Code
●
5 Projects accepted
–
–
–
–
–
QT based GUI
Automatic control point detection
HDR deghosting
Interactive panorama viewer
Processing of very large images using VIPS
Pablo d'Angelo
LGM 2007
Conclusion
●
●
●
●
Hugin is a powerful toolchain for
merging overlapping images
Future: Automatic stitching
Advanced image correction
useful for other applications, too!
Small, but active community, 5 GSoC
projects
Pablo d'Angelo
LGM 2007