Welcome to the new version of CaltechAUTHORS. Login is currently restricted to library staff. If you notice any issues, please email coda@library.caltech.edu
Published November 1, 2007 | Submitted
Report Open

Measuring and Predicting Importance of Objects in Our Visual World

Abstract

Associating keywords with images automatically is an approachable and useful goal for visual recognition researchers. Keywords are distinctive and informative objects. We argue that keywords need to be sorted by 'importance', which we define as the probability of being mentioned first by an observer. We propose a method for measuring the `importance' of words using the object labels that multiple human observers give an everyday scene photograph. We model object naming as drawing balls from an urn, and fit this model to estimate `importance'; this combines order and frequency, enabling precise prediction under limited human labeling. We explore the relationship between the importance of an object in a particular image and the area, centrality, and saliency of the corresponding image patches. Furthermore, our data shows that many words are associated with even simple environments, and that few frequently appearing objects are shared across environments.

Attached Files

Submitted - CNStr07-002-importance.pdf

Files

CNStr07-002-importance.pdf
Files (3.3 MB)
Name Size Download all
md5:713ecb7bc3f33abcaa0169408aad50df
3.3 MB Preview Download

Additional details

Created:
August 22, 2023
Modified:
October 16, 2023