Bayesian model of dynamic image stabilization in the visual system
Abstract
Humans can resolve the fine details of visual stimuli although the image projected on the retina is constantly drifting relative to the photoreceptor array. Here we demonstrate that the brain must take this drift into account when performing high acuity visual tasks. Further, we propose a decoding strategy for interpreting the spikes emitted by the retina, which takes into account the ambiguity caused by retinal noise and the unknown trajectory of the projected image on the retina. A main difficulty, addressed in our proposal, is the exponentially large number of possible stimuli, which renders the ideal Bayesian solution to the problem computationally intractable. In contrast, the strategy that we propose suggests a realistic implementation in the visual cortex. The implementation involves two populations of cells, one that tracks the position of the image and another that represents a stabilized estimate of the image itself. Spikes from the retina are dynamically routed to the two populations and are interpreted in a probabilistic manner. We consider the architecture of neural circuitry that could implement this strategy and its performance under measured statistics of human fixational eye motion. A salient prediction is that in high acuity tasks, fixed features within the visual scene are beneficial because they provide information about the drifting position of the image. Therefore, complete elimination of peripheral features in the visual scene should degrade performance on high acuity tasks involving very small stimuli.
Additional Information
© 2010 National Academy of Sciences. Edited by William T. Newsome, Stanford University, Stanford, CA, and approved September 17, 2010 (received for review May 8, 2010). Published online before print October 11, 2010. We thank Dan Lee, Ofer Mazor, and Xaq Pitkow for helpful discussions and Eran Mukamel for comments on the manuscript. We acknowledge support from the Swartz Foundation (Y.B. and U.R.), the National Eye Institute (M.M.), the Israeli Science Foundation (H.S.), and the Israeli Ministry of Defense (H.S.). Author contributions: Y.B., U.R., M.M., and H.S. designed research; Y.B., U.R., and H.S. performed research; and Y.B., M.M., and H.S. wrote the paper. The authors declare no conflict of interest. This article is a PNAS Direct Submission. This article contains supporting information online at www.pnas.org/lookup/suppl/doi:10.1073/pnas.1006076107/-/DCSupplemental.Attached Files
Published - PNAS-2010-Burak-19525-30.pdf
Supplemental Material - sapp.pdf
Files
Name | Size | Download all |
---|---|---|
md5:56c0a642ab74b7c1e45128e8f72528a3
|
526.0 kB | Preview Download |
md5:99a9f488d2ac1819e5c2b2adf917cb81
|
257.5 kB | Preview Download |
Additional details
- PMCID
- PMC2984143
- Eprint ID
- 75699
- Resolver ID
- CaltechAUTHORS:20170404-134032704
- Swartz Foundation
- National Eye Institute
- Israeli Science Foundation
- Ministry of Defense (Israel)
- Created
-
2017-04-04Created from EPrint's datestamp field
- Updated
-
2021-11-15Created from EPrint's last_modified field