The 2007 edition of this course offers an advanced survey of selected topics of current interest in the neural and computational modeling of mammalian vision. This year's topics include perceptual consequences of eye movements, visual search, object recognition, and perceptual learning. Some classes will be held at laboratories of nearby institutions. Students are expected to have a sufficient interdisciplinary grounding in the fundamentals of computational modeling of mammalian vision to read primary research sources extensively. A term project that combines a problem statement, literature review, and either (1) simulation of a model or (2) a design for a psychophysical experiment is required.
Answers to FREQUENTLY-ASKED QUESTIONS about CN730
Information for GUEST SPEAKERS
Dates of DELIVERABLES for student research reports
Click
on a date to go directly to a summary of that week's class, including assigned
readings. Links to guest speakers' home pages, weekly topics, and a list of
readings will also be found there, though these will be updated in real time
in the course of the semester.
Jan 18 Rick Born -- field trip -- Harvard Med; see map
Feb 22 Student presentations
Mar 8 Bill Warren -- field trip
Mar 15 Spring break
Mar 22 Paul Dizio -- field trip
Apr 5 Peter Schiller-- field trip
May 2 Wednesday: Student presentations, Room B03, 10:30 to 1:30
May 3 Thursday: Student presentations, Room B03, 1:00 to 4:00
Jan 18 Rick Born -- field trip -- Harvard Med; see map
Background
Born, R. T. and Bradley, D. C. (2005) Structure and function of visual area MT. Annu. Rev. Neurosci., 28:157-89. DOI, 10.1146/annurev.neuro.26.041002.131052 pdf available at: http://www.hms.harvard.edu/bss/neuro/bornlab/lab/papers/born-bradley-mt-arn2005.pdf
Core Readings
Pack, C. C., Berezovskii, V. K. and Born, R. T. (2001) Dynamic properties of neurons in cortical area MT in alert and anesthetized macaque monkeys. Nature, 414:905-908. pdf available at: http://www.hms.harvard.edu/bss/neuro/bornlab/
Pack, C. C., Gartland, A. J. and Born, R. T. (2004) Integration of contour and terminator signals in visual area MT of alert macaque. J. Neurosci., 24:3268-3280. pdf available at: http://www.hms.harvard.edu/bss/neuro/bornlab/
Supplementary
Salzman, C.D., Britten, K.H., and Newsome, W.T. Cortical microstimulation influences perceptual judgements of motion direction. Nature 346, 174-7 (1990).
Salzman, C.D., Murasugi, C.M., Britten, K.H., and Newsome, W.T. Microstimulation in visual area MT: effects on direction discrimination performance. J. Neurosci. 12, 2331-55 (1992).
Related
Bershanzkaya, J., Grossberg, S., and Mingolla, E. Laminar cortical dynamics of visual form and motion interactions
during coherent object motion perception. Spatial Vision, in press. Technical Report CAS/CNS TR-2007-pending, Boston, MA: Boston University. pdf
Background
Ahissar M, Hochstein S (2004) The reverse hierarchy theory of visual perceptual learning. Trends Cogn Sci 8(10): 457-464. pdf
Gilbert, C.D., et al. (2001) The neural basis of perceptual learning. Neuron 31, 681-697 pdf
Posner, M.I., and Petersen, S.E. (1990) The attention system of the human brain. Annu Rev Neurosci 13, 25-42 pdf
Seitz and Dinse (2007), “Mechanisms of Perceptual Learning”, Current Opinion of Neurobiology, in press
Core Readings
Seitz, Yamagishi, Werner, Goda, Kawato, Watanabe (2005). "Task specific disruption of perceptual learning" PNAS, Oct 3; 10.1073/pnas.0505765102 pdf
Seitz, Lefebvre, Watanabe, Jolicoeur (2005). "The requirement of high-level processing in subliminal learning" Current Biology, Sept 20;18(15):R753-5 pdf
Seitz and Watanabe (2003). "Is subliminal learning really passive?" Nature, Mar 6 (Vol 422(6927): 36). pdf
Seitz and Watanabe (2005). "A unified model for perceptual learning" Trends in Cognitive Science, Jul (Vol 9(7) 329-334). pdf
Learning prototype-based embeddings for measuring similarity, classification and retrieval
Background Readings
Robert E. Schapire.
*The boosting approach to machine learning: An overview*.
In D. D. Denison, M. H. Hansen, C. Holmes, B. Mallick, B. Yu, editors, Nonlinear Estimation and Classification. Springer, 2003. http://www.cs.princeton.edu/~schapire/uncompress-papers.cgi/msri.ps
GR Hjaltason, H Samet, "Properties of embedding methods for similarity searching in metric spaces, IEEE Trans. Pattern Analysis and Machine Intelligence, 25(5):530-549, 2003.
http://ieeexplore.ieee.org/iel5/34/26906/01195989.pdf?isnumber=&arnumber=1195989
Core Readings
Athitsos, V, Hadjieleftheriou, M, Kollios, G, and Sclaroff, S. Query-Sensitive Embeddings
ACM Transactions on Database Systems, Vol. 32, No. 1, March 2007.
http://cs-people.bu.edu/athitsos/publications/athitsos_tods_preprint.pdf
Athitsos, V,Alon, J, Sclaroff, S, and Kollios, G.Member, An Embedding Method for Efficient Nearest Neighbor Retrieval. IEEE PAMI, in press. http://cs-people.bu.edu/athitsos/publications/athitsos_pami_preprint.pdf
Feb 8 Arash Fazl
Background Readings
Driver, J., G. Davis, C. Russell, M. Turatto, and E. Freeman. 2001. Segmentation, attention and phenomenal visual objects. Cognition 80:61-95. pdf
Itti, L., and C. Koch. 2001. Computational modelling of visual attention. Nat Rev Neurosci 2:194-203. pdf
Riesenhuber, M., and T. Poggio. 2000. Models of object recognition. Nat Neurosci 3 Suppl:1199-204. pdf
Core Readings
Egly, R., J. Driver, and R.D. Rafal. 1994. Shifting visual attention between objects and locations: evidence from normal and parietal lesion subjects. J Exp Psychol Gen 123:161-77. pdf
Bulthoff, H.H., S.Y. Edelman, and M.J. Tarr. 1995. How are three-dimensional objects represented in the brain? Cereb Cortex 5:247-60. pdf
Feb 15 Dave Elder
Background Readings
Bremmer, F. Navigation in space – the role of the macaque ventral intraparietal area. 2005;566;29-35; J. Physiol. pdf
Core Readings
Warren WH Jr, Hannon DJ. Eye movements and optical flow. J Opt Soc Am A. 1990 Jan;7(1):160-9. pdf
Fajen BR, Warren WH. Behavioral dynamics of steering, obstacle avoidance, and route selection. J Exp Psychol Hum Percept Perform. 2003 Apr;29(2):343-62. pdf
Supplementary Readings
Duffy CJ and Wurtz, RH. Response of Monkey MST Neurons to Optic Flow Stimuli with Shifted Centers of Motion. The Journal of Neuroscience, July 1995, 15(7): 5192-5208. pdf
Gu Y, Watkins PV, Angelaki DE, and DeAngelis DC. Visual and Nonvisual Contributions to Three-DimensionalHeading Selectivity in the Medial Superior Temporal Area. The Journal of Neuroscience, January 4, 2006 • 26(1):73– 85 • 73. pdf
Feb 22 Student presentations
Mar 1 Jim DiCarlo
Neuronal representations underlying visual object recognition
Background Reading
Tanaka K. Mechanisms of visual object recognition: monkey and human studies. Curr Opin Neurobiol. 1997 Aug;7(4):523-9. pdf
Core Readings
Zoccolan D, Cox DD, DiCarlo JJ. Multiple object response normalization in monkey inferotemporal cortex. J Neurosci. 2005 Sep 7;25(36):8150-64. pdf
Hung CP, Kreiman G, Poggio T, DiCarlo JJ. Fast readout of object identity from macaque inferior temporal cortex.
Science. 2005 Nov 4;310(5749):863-6. pdf
Mar 8 Bill Warren -- field trip -- directions
Core Readings
Warren WH. The dynamics of perception and action. Psychol Rev. 2006 Apr;113(2):358-89. pdf
Warren, W. H. (2004). Optic flow. in L. Chalupa & J. Werner (Eds.), The Visual Neurosciences (pp. 1247-1259). Cambridge, MA: MIT Press. pdf
Mar 15 Spring break
Spatial orientation model
Bortolami SB, Rocca S, Daros S, DiZio P, Lackner JR. Mechanisms of human static spatial orientation. Exp Brain Res. 2006 Aug;173(3):374-88. link
Adaptation of active body rotation
Hudson TE, Lackner JR, DiZio P. Rapid adaptation of torso pointing movements to perturbations of the base of support. Exp Brain Res. 2005 Sep;165(3):283-93. link
Force segmentation in motor adaptation
Frucht C, DiZio P, Lackner JR. Human movement control in a novel dynamic environment. In press, Exp Brain Res. pdf
Mar 29 Todd Horowitz
Background readings
Pylyshyn, Z. W., & Storm, R. W. (1988). Tracking multiple independent targets: evidence for a parallel tracking mechanism. Spatial Vision, 3(3), 179-197. pdf figures: pdf
Pylyshyn, Z. W. (1989). The role of location indexes in spatial perception: a sketch of the FINST spatial-index model. Cognition, 32(1), 65-97. pdf
Yantis, S. (1992). Multielement visual tracking: Attention and perceptual organization. Cognitive Psychology, 24, 295-340. pdf
Core Readings
Alvarez, G. A., Horowitz, T. S., Arsenio, H. C., Dimase, J. S., & Wolfe, J. M. (2005). Do multielement visual tracking and visual search draw continuously on the same visual attention resources? Journal of Experimental Psychology-Human Perception and Performance, 31(4), 643-667. pdf
Cavanagh, P., & Alvarez, G. A. (2005). Tracking multiple targets with multifocal attention. Trends Cogn Sci, 9(7), 349-354. pdf
Supplementary Readings
Alvarez, G. A., & Cavanagh, P. (2005). Independent resources for attentional tracking in the left and right visual hemifields. Psychological Science, 16(8), 637-643. pdf
Scholl, B. J., Pylyshyn, Z. W., & Feldman, J. (2001). What is a visual object? Evidence from target merging in multiple object tracking. Cognition, 80(1-2), 159-177. pdf
Horowitz, T. S., Birnkrant, R. S., Fencsik, D. E., Tran, L., & Wolfe, J. M. (2006). How do we track invisible objects? Psychonomic Bulletin & Review, 13(3), 516–523. pdf
Apr 5 Peter Schiller -- field trip -- building map; floor map
Readings
Schiller, P.H. (1998) The neural control of visually guided eye movements. IN: Cognitive Neuroscience of Attention, ed: J. Richards. Erlbaum. pdf
Schiller, P.H. & Tehovnik, E.J. (2005) Neural mechanisms underlying target selection with saccadic eye movements. IN: Cortical Function: A View from the Thalamus, Ed: V.A. Casagrande, R.W. Guillery & S.M. Sherman. Elsevier. pdf
Hikosaka, O. and Wurtz, R.H. (1985) Modification of saccadic eye movements by GABA-related substances. I. Effect of muscimol and bicuculine in monkey superior colliculus. J. Neurophysiol., 53, 266-291. pdf
Schiller, P.H. and Tehovnik, E.J. (2003) Cortical inhibitory circuits in eye-movement generation. European Journal of Neuroscience, 18, 3127-3133. pdf
Apr 12 Jack Loomis -- note; links to pdfs are at http://www.psych.ucsb.edu/~loomis/BU%20talks.htm
1:00 PM -- Visual control of action: Contrasting ecological and model-based approaches
Suggested readings, in order
Loomis, J. M. & Beall, A. C. (1998). Visually-controlled locomotion: Its dependence on optic flow, 3-D space perception, and cognition. Ecological Psychology, 10, 271-285.
Loomis, J. M. & Beall, A. C. (2004). Model-based control of perception/action. In L. Vaina, S. Beardsley, and S. Rushton (Eds.). Optic Flow and Beyond (pp. 421-441). Boston: Kluwer Academic Publishers.
Loomis, J. M., Beall, A. C., Macuga, K. L., Kelly, J. W. & Smith, R. (2006). Visual control of action without retinal optic flow. Psychological Science, 17, 214-221.
Kelly, J.W., Loomis, J.M., & Beall, A.C. (2005). The importance of perceived relative motion in the control of posture. Experimental Brain Research, 161, 285-292.
2:30 PM -- Visual space perception: Reconciling egocentric distance perception with exocentric distance perception
Suggested reading, in order:
Loomis, J. M., Da Silva, J.A., Fujita, N., & Fukusima, S. S. (1992). Visual space perception and visually directed action. Journal of Experimental Psychology: Human Perception and Performance, 18, 906-921.
Philbeck, J. W., Loomis, J. M., & Beall, A. C. (1997). Visually perceived location is an invariant in the control of action. Perception & Psychophysics, 59, 601-612.
Foley, J. M., Ribeiro, N. P., & Da Silva, J. A. (2004). Visual perception of extent and the geometry of visual space. Vision Research, 44, 147-156
Ooi, T. L., Wu, B., & He, Z. J. (2006). Perceptual space in the dark affected by the intrinsic bias of the visual system. Perception, 35, 605-624.
Optional reading:
Loomis, J. M. & Philbeck, J. W. (in press). Measuring perception with spatial updating and action. In R. L. Klatzky, M. Behrmann, & B. MacWhinney (Eds.), Embodiment, ego-space, and action. Mahwah, NJ: Erlbaum.
Apr 19 Pawan Sinha
Ostrovsky Y, Andalman A, Sinha P. Vision following extended congenital blindness. Psychol Sci. 2006 Dec;17(12):1009-14. pdf
Gregory, RL and Wallace, JG. Recovery from Early Blindness: A Case Study. Reproduced in March 2001 from Experimental Psychology Society Monograph No. 2 1963. © 2001 Richard Gregory and Jean Wallace. pdf
Bouvrie, JV and Sinha, P. Visual object concept discovery: Observations in congenitally blind children, and a computational approach. Neurocomputing; in press. pdf
Mandavilli, A. Visual neuroscience: Look and Learn, Nature. 2006 May 18;441(7091):271-2. pdf
Apr 26 Arash Yazdanbakhsh
Cornelissen, F. W., A. R. Wade, et al. (2006). "No functional magnetic
resonance imaging evidence for brightness and color filling-in in early
human visual cortex." J Neurosci 26(14): 3634-41 pdf
Grossberg, S. and E. Mingolla (1985). "Neural dynamics of form
perception: boundary completion, illusory figures, and neon color
spreading." Psychol Rev 92(2): 173-211 pdf
Grossberg, S. and A. Yazdanbakhsh (2005). "Laminar cortical dynamics of
3D surface perception: stratification, transparency, and neon color
spreading." Vision Res 45(13): 1725-43 pdf
Qiu, F. T. and R. von der Heydt (2007). "Neural representation of
transparent overlay." Nat Neurosci 10(3): 283-4 pdf
Yazdanbakhsh, A. and M. S. Livingstone (2006). "End stopping in V1 is
sensitive to contrast." Nat Neurosci 9(5): 697-702 pdf
This page is maintained by Ennio Mingolla
Please direct questions to: ennio @ cns.bu.edu