CN730 -- Models of Visual Perception -- Spring, 2007

Prerequisites : Consent of the instructor, Ennio Mingolla 
Office hours: by appointment

The 2007 edition of this course offers an advanced survey of selected topics of current interest in the neural and computational modeling of mammalian vision. This year's topics include perceptual consequences of eye movements, visual search, object recognition, and perceptual learning. Some classes will be held at laboratories of nearby institutions. Students are expected to have a sufficient interdisciplinary grounding in the fundamentals of computational modeling of mammalian vision to read primary research sources extensively. A term project that combines a problem statement, literature review, and either (1) simulation of a model or (2) a design for a psychophysical experiment is required.

Answers to FREQUENTLY-ASKED QUESTIONS about CN730

Information for GUEST SPEAKERS

Dates of DELIVERABLES for student research reports

Discussion Board (internal)

Weekly Schedule -- Meetings with guest speakers are on Thursdays, beginning on January 18, and start at 1:00 PM, unless otherwise indicated on this page by the designation "field trip." Meetings with guest speakers at Boston University are held in Room B03 of the CNS Building, 677 Beacon Street. An additional weekly discussion hour is held from 12:30 to 1:30 PM on Wednesdays, beginning on January 17, in Room B01.

Click on a date to go directly to a summary of that week's class, including assigned readings. Links to guest speakers' home pages, weekly topics, and a list of readings will also be found there, though these will be updated in real time in the course of the semester.

Jan 18    Rick Born -- field trip -- Harvard Med; see map

Jan 25    Aaron Seitz

Feb 1      Stan Sclaroff

Feb 8      Arash Fazl

Feb 15    Dave Elder

Feb 22    Student presentations

Mar 1     Jim DiCarlo

Mar 8      Bill Warren -- field trip

Mar 15    Spring break

Mar 22    Paul Dizio -- field trip

Mar 29    Todd Horowitz

Apr 5       Peter Schiller-- field trip

Apr 12     Jack Loomis

Apr 19    Pawan Sinha

Apr 26     Arash Yazdanbakhsh

May 2    Wednesday: Student presentations, Room B03, 10:30 to 1:30

May 3     Thursday: Student presentations, Room B03, 1:00 to 4:00


Jan 18    Rick Born -- field trip -- Harvard Med; see map

Background
Born, R. T. and Bradley, D. C. (2005) Structure and function of visual area MT. Annu. Rev. Neurosci., 28:157-89. DOI, 10.1146/annurev.neuro.26.041002.131052 pdf available at: http://www.hms.harvard.edu/bss/neuro/bornlab/lab/papers/born-bradley-mt-arn2005.pdf

Core Readings
Pack, C. C., Berezovskii, V. K. and Born, R. T. (2001) Dynamic properties of neurons in cortical area MT in alert and anesthetized macaque monkeys. Nature, 414:905-908. pdf available at: http://www.hms.harvard.edu/bss/neuro/bornlab/

Pack, C. C., Gartland, A. J. and Born, R. T. (2004) Integration of contour and terminator signals in visual area MT of alert macaque. J. Neurosci., 24:3268-3280. pdf available at: http://www.hms.harvard.edu/bss/neuro/bornlab/

Supplementary
Salzman, C.D., Britten, K.H., and Newsome, W.T. Cortical microstimulation influences perceptual judgements of motion direction. Nature 346, 174-7 (1990).

Salzman, C.D., Murasugi, C.M., Britten, K.H., and Newsome, W.T. Microstimulation in visual area MT: effects on direction discrimination performance. J. Neurosci. 12, 2331-55 (1992).

Related

Bershanzkaya, J., Grossberg, S., and Mingolla, E. Laminar cortical dynamics of visual form and motion interactions
during coherent object motion perception. Spatial Vision, in press. Technical Report CAS/CNS TR-2007-pending, Boston, MA: Boston University. pdf

Back to top of page


Jan 25    Aaron Seitz

Background

Ahissar M, Hochstein S (2004) The reverse hierarchy theory of visual perceptual learning. Trends Cogn Sci 8(10): 457-464. pdf

Gilbert, C.D., et al. (2001) The neural basis of perceptual learning. Neuron 31, 681-697 pdf

Posner, M.I., and Petersen, S.E. (1990) The attention system of the human brain. Annu Rev Neurosci 13, 25-42 pdf

Seitz and Dinse (2007), “Mechanisms of Perceptual Learning”, Current Opinion of Neurobiology, in press

Core Readings

Seitz, Yamagishi, Werner, Goda, Kawato, Watanabe (2005). "Task specific disruption of perceptual learning" PNAS, Oct 3; 10.1073/pnas.0505765102 pdf

Seitz, Lefebvre, Watanabe, Jolicoeur (2005). "The requirement of high-level processing in subliminal learning" Current Biology, Sept 20;18(15):R753-5 pdf

Seitz and Watanabe (2003). "Is subliminal learning really passive?" Nature, Mar 6 (Vol 422(6927): 36). pdf

Seitz and Watanabe (2005). "A unified model for perceptual learning" Trends in Cognitive Science, Jul (Vol 9(7) 329-334). pdf

Back to top of page


Feb 1   Stan Sclaroff

Learning prototype-based embeddings for measuring similarity, classification and retrieval

Background Readings

Robert E. Schapire.
*The boosting approach to machine learning: An overview*.
In D. D. Denison, M. H. Hansen, C. Holmes, B. Mallick, B. Yu, editors, Nonlinear Estimation and Classification. Springer, 2003. http://www.cs.princeton.edu/~schapire/uncompress-papers.cgi/msri.ps

GR Hjaltason, H Samet, "Properties of embedding methods for similarity searching in metric spaces, IEEE Trans. Pattern Analysis and Machine Intelligence, 25(5):530-549, 2003.

http://ieeexplore.ieee.org/iel5/34/26906/01195989.pdf?isnumber=&arnumber=1195989

Core Readings
Athitsos, V, Hadjieleftheriou, M, Kollios, G, and Sclaroff, S. Query-Sensitive Embeddings
ACM Transactions on Database Systems, Vol. 32, No. 1, March 2007.

http://cs-people.bu.edu/athitsos/publications/athitsos_tods_preprint.pdf

Athitsos, V,Alon, J, Sclaroff, S, and Kollios, G.Member, An Embedding Method for Efficient Nearest Neighbor Retrieval. IEEE PAMI, in press. http://cs-people.bu.edu/athitsos/publications/athitsos_pami_preprint.pdf

 

Back to top of page


Feb 8      Arash Fazl

Background Readings

Driver, J., G. Davis, C. Russell, M. Turatto, and E. Freeman. 2001. Segmentation, attention and phenomenal visual objects. Cognition 80:61-95. pdf

Itti, L., and C. Koch. 2001. Computational modelling of visual attention. Nat Rev Neurosci 2:194-203. pdf

Riesenhuber, M., and T. Poggio. 2000. Models of object recognition. Nat Neurosci 3 Suppl:1199-204. pdf

Core Readings

Egly, R., J. Driver, and R.D. Rafal. 1994. Shifting visual attention between objects and locations: evidence from normal and parietal lesion subjects. J Exp Psychol Gen 123:161-77. pdf

Bulthoff, H.H., S.Y. Edelman, and M.J. Tarr. 1995. How are three-dimensional objects represented in the brain? Cereb Cortex 5:247-60. pdf

 

Back to top of page


Feb 15    Dave Elder

Background Readings

Bremmer, F. Navigation in space – the role of the macaque ventral intraparietal area. 2005;566;29-35; J. Physiol. pdf

Core Readings

Warren WH Jr, Hannon DJ. Eye movements and optical flow. J Opt Soc Am A. 1990 Jan;7(1):160-9. pdf

Fajen BR, Warren WH. Behavioral dynamics of steering, obstacle avoidance, and route selection. J Exp Psychol Hum Percept Perform. 2003 Apr;29(2):343-62. pdf

Supplementary Readings

Duffy CJ and Wurtz, RH. Response of Monkey MST Neurons to Optic Flow Stimuli with Shifted Centers of Motion. The Journal of Neuroscience, July 1995, 15(7): 5192-5208. pdf

Gu Y, Watkins PV, Angelaki DE, and DeAngelis DC. Visual and Nonvisual Contributions to Three-DimensionalHeading Selectivity in the Medial Superior Temporal Area. The Journal of Neuroscience, January 4, 2006 • 26(1):73– 85 • 73. pdf

Back to top of page


Feb 22    Student presentations

Back to top of page


Mar 1      Jim DiCarlo

Neuronal representations underlying visual object recognition

Abstract

Background Reading

Tanaka K. Mechanisms of visual object recognition: monkey and human studies. Curr Opin Neurobiol. 1997 Aug;7(4):523-9. pdf

Core Readings

Zoccolan D, Cox DD, DiCarlo JJ. Multiple object response normalization in monkey inferotemporal cortex. J Neurosci. 2005 Sep 7;25(36):8150-64. pdf

Hung CP, Kreiman G, Poggio T, DiCarlo JJ. Fast readout of object identity from macaque inferior temporal cortex.

Science. 2005 Nov 4;310(5749):863-6. pdf

 

Back to top of page


Mar 8      Bill Warren -- field trip -- directions

Core Readings

Warren WH. The dynamics of perception and action. Psychol Rev. 2006 Apr;113(2):358-89. pdf

Warren, W. H. (2004). Optic flow. in L. Chalupa & J. Werner (Eds.), The Visual Neurosciences (pp. 1247-1259). Cambridge, MA: MIT Press. pdf

Back to top of page


Mar 15    Spring break

Back to top of page


Mar 22    Paul Dizio -- field trip

Spatial orientation model

Bortolami SB, Rocca S, Daros S, DiZio P, Lackner JR. Mechanisms of human static spatial orientation. Exp Brain Res. 2006 Aug;173(3):374-88. link

Adaptation of active body rotation

Hudson TE, Lackner JR, DiZio P. Rapid adaptation of torso pointing movements to perturbations of the base of support. Exp Brain Res. 2005 Sep;165(3):283-93. link

Force segmentation in motor adaptation

Frucht C, DiZio P, Lackner JR. Human movement control in a novel dynamic environment. In press, Exp Brain Res. pdf

Back to top of page


Mar 29    Todd Horowitz

Background readings
Pylyshyn, Z. W., & Storm, R. W. (1988). Tracking multiple independent targets: evidence for a parallel tracking mechanism. Spatial Vision, 3(3), 179-197. pdf figures: pdf


Pylyshyn, Z. W. (1989). The role of location indexes in spatial perception: a sketch of the FINST spatial-index model. Cognition, 32(1), 65-97. pdf

Yantis, S. (1992). Multielement visual tracking: Attention and perceptual organization. Cognitive Psychology, 24, 295-340. pdf

Core Readings
Alvarez, G. A., Horowitz, T. S., Arsenio, H. C., Dimase, J. S., & Wolfe, J. M. (2005). Do multielement visual tracking and visual search draw continuously on the same visual attention resources? Journal of Experimental Psychology-Human Perception and Performance, 31(4), 643-667. pdf


Cavanagh, P., & Alvarez, G. A. (2005). Tracking multiple targets with multifocal attention. Trends Cogn Sci, 9(7), 349-354. pdf

Supplementary Readings
Alvarez, G. A., & Cavanagh, P. (2005). Independent resources for attentional tracking in the left and right visual hemifields. Psychological Science, 16(8), 637-643. pdf


Scholl, B. J., Pylyshyn, Z. W., & Feldman, J. (2001). What is a visual object? Evidence from target merging in multiple object tracking. Cognition, 80(1-2), 159-177. pdf


Horowitz, T. S., Birnkrant, R. S., Fencsik, D. E., Tran, L., & Wolfe, J. M. (2006). How do we track invisible objects? Psychonomic Bulletin & Review, 13(3), 516–523. pdf

Back to top of page


Apr 5       Peter Schiller -- field trip -- building map; floor map

Readings

Schiller, P.H. (1998) The neural control of visually guided eye movements. IN: Cognitive Neuroscience of Attention, ed: J. Richards. Erlbaum. pdf

Schiller, P.H. & Tehovnik, E.J. (2005) Neural mechanisms underlying target selection with saccadic eye movements. IN: Cortical Function: A View from the Thalamus, Ed: V.A. Casagrande, R.W. Guillery & S.M. Sherman. Elsevier. pdf

Hikosaka, O. and Wurtz, R.H. (1985) Modification of saccadic eye movements by GABA-related substances. I. Effect of muscimol and bicuculine in monkey superior colliculus. J. Neurophysiol., 53, 266-291. pdf

Schiller, P.H. and Tehovnik, E.J. (2003) Cortical inhibitory circuits in eye-movement generation. European Journal of Neuroscience, 18, 3127-3133. pdf

 

Back to top of page


Apr 12    Jack Loomis -- note; links to pdfs are at http://www.psych.ucsb.edu/~loomis/BU%20talks.htm

1:00 PM -- Visual control of action: Contrasting ecological and model-based approaches

Suggested readings, in order

Loomis, J. M. & Beall, A. C. (1998). Visually-controlled locomotion: Its dependence on optic flow, 3-D space perception, and cognition. Ecological Psychology, 10, 271-285.

Loomis, J. M. & Beall, A. C. (2004). Model-based control of perception/action. In L. Vaina, S. Beardsley, and S. Rushton (Eds.). Optic Flow and Beyond (pp. 421-441). Boston: Kluwer Academic Publishers.

Loomis, J. M., Beall, A. C., Macuga, K. L., Kelly, J. W. & Smith, R. (2006). Visual control of action without retinal optic flow. Psychological Science, 17, 214-221.
Kelly, J.W., Loomis, J.M., & Beall, A.C. (2005). The importance of perceived relative motion in the control of posture. Experimental Brain Research, 161, 285-292.

2:30 PM -- Visual space perception: Reconciling egocentric distance perception with exocentric distance perception

Suggested reading, in order:
Loomis, J. M., Da Silva, J.A., Fujita, N., & Fukusima, S. S. (1992). Visual space perception and visually directed action. Journal of Experimental Psychology: Human Perception and Performance, 18, 906-921.

Philbeck, J. W., Loomis, J. M., & Beall, A. C. (1997). Visually perceived location is an invariant in the control of action. Perception & Psychophysics, 59, 601-612.

Foley, J. M., Ribeiro, N. P., & Da Silva, J. A. (2004). Visual perception of extent and the geometry of visual space. Vision Research, 44, 147-156

Ooi, T. L., Wu, B., & He, Z. J. (2006). Perceptual space in the dark affected by the intrinsic bias of the visual system. Perception, 35, 605-624.

Optional reading:

Loomis, J. M. & Philbeck, J. W. (in press). Measuring perception with spatial updating and action. In R. L. Klatzky, M. Behrmann, & B. MacWhinney (Eds.), Embodiment, ego-space, and action. Mahwah, NJ: Erlbaum.

Back to top of page


Apr 19    Pawan Sinha

Ostrovsky Y, Andalman A, Sinha P. Vision following extended congenital blindness. Psychol Sci. 2006 Dec;17(12):1009-14. pdf

Gregory, RL and Wallace, JG. Recovery from Early Blindness: A Case Study. Reproduced in March 2001 from Experimental Psychology Society Monograph No. 2 1963. © 2001 Richard Gregory and Jean Wallace. pdf

Bouvrie, JV and Sinha, P. Visual object concept discovery: Observations in congenitally blind children, and a computational approach. Neurocomputing; in press. pdf

Mandavilli, A. Visual neuroscience: Look and Learn, Nature. 2006 May 18;441(7091):271-2. pdf

Back to top of page


Apr 26    Arash Yazdanbakhsh

Cornelissen, F. W., A. R. Wade, et al. (2006). "No functional magnetic
resonance imaging evidence for brightness and color filling-in in early
human visual cortex." J Neurosci 26(14): 3634-41 pdf

Grossberg, S. and E. Mingolla (1985). "Neural dynamics of form
perception: boundary completion, illusory figures, and neon color
spreading." Psychol Rev 92(2): 173-211 pdf

Grossberg, S. and A. Yazdanbakhsh (2005). "Laminar cortical dynamics of
3D surface perception: stratification, transparency, and neon color
spreading." Vision Res 45(13): 1725-43 pdf

Qiu, F. T. and R. von der Heydt (2007). "Neural representation of
transparent overlay." Nat Neurosci 10(3): 283-4 pdf

Yazdanbakhsh, A. and M. S. Livingstone (2006). "End stopping in V1 is
sensitive to contrast." Nat Neurosci 9(5): 697-702 pdf

 

Back to top of page


 

This page is maintained by Ennio Mingolla

Please direct questions to: ennio @ cns.bu.edu