Welcome to the new version of CaltechAUTHORS. Login is currently restricted to library staff. If you notice any issues, please email coda@library.caltech.edu
Published November 20, 2005 | public
Report Open

Multi-View Image Compositions

Abstract

The geometry of single-viewpoint panoramas is well understood: multiple pictures taken from the same viewpoint may be stitched together into a consistent panorama mosaic. By contrast, when the point of view changes or when the scene changes (e.g., due to objects moving) no consistent mosaic may be obtained, unless the structure of the scene is very special. Artists have explored this problem and demonstrated that geometrical consistency is not the only criterion for success: incorporating multiple view points in space and time into the same panorama may produce compelling and informative pictures. We explore this avenue and suggest an approach to automating the construction of mosaics from images taken from multiple view points into a single panorama. Rather than looking at 3D scene consistency we look at image consistency. Our approach is based on optimizing a cost function that keeps into account image-to-image consistency which is measured on point-features and along picture boundaries. The optimization explicitly considers occlusion between pictures. We illustrate our ideas with a number of experiments on collections of images of objects and outdoor scenes.

Additional Information

We wish to thank Matthew Brown for providing his Autostitch software and the Oxford Visual Geometry Group for their edge detection code. This research was supported by MURI award number AS3318 and the Center of Neuromorphic Systems Engineering award EEC-9402726.

Files

paper.pdf
Files (4.6 MB)
Name Size Download all
md5:12c576e18f03be778d2877f1a80d7b2b
4.6 MB Preview Download

Additional details

Created:
August 22, 2023
Modified:
October 16, 2023