CN810 -- Topics in Cognitive and Neural Systems: Vision in Man, Monkey,
and Machine
Prerequisites : Consent of the instructor, Ennio Mingolla
(Office hours: Tuesdays, 1-3 pm)
The 2003 edition of this course offers an advanced survey of selected
topics of current interest in the neural and computational modeling of mammalian
vision. This year's topics include motion perception, control of locomotion,
attention and object recognition. Several classes will be held at
laboratories of nearby institutions. Students are expected to have
a sufficient interdisciplinary grounding in the fundamentals of computational
modeling of mammalian vision to read primary research sources extensively,
and will be required to present short oral expositions of selected readings
to the class. A term project that combines a problem statement, literature
review, and either (1) simulation of a model or (2) a design for a pyschophysical
experiment is also required.
Answers
to FREQUENTLY-ASKED QUESTIONS about CN 810
Information
for GUEST SPEAKERS
Dates
of DELIVERABLES for student research reports
Weekly Schedule -- NOTE: Meetings are on Thursdays, beginning on January
16, and start at 1:00 PM, unless otherwise indicated on this page. Meetings
at Boston University are held in Room B03 of the CNS Building, 677 Beacon
Street.
Click on a date to go directly to a summary of that week's class,
including assigned readings.
Jan 16 Jeremy Wolfe (at CNS) NOTE: Starting time on this day is 2:00 pm.
Jan 23 Rick Born and Chris Pack (field
trip: Harvard Med; map)
Jan 30 Bill Freeman (at CNS) NOTE: Starting time on this day is 2:00 pm.
Feb 6 Steve Grossberg (at
CNS)
Feb 13 Paul Dizio (field trip:
Graybiel Lab, Brandeis)
Feb 20 Student presentations
(at CNS)
Feb 27 Michele Rucci (at CNS)
Mar 6 Pawan Sinha
Mar 13 No class (spring break)
Mar 20 Chris Stauffer (field trip:
AI Lab, MIT)
Mar 27 Marc Pomplun (field trip, UMass
Boston)
Apr 3 Margaret
Livingstone and Piers Howe (field trip; Harvard Med; map)
Apr 10 Matthew Brand and Baback Moghaddam (field
trip: MERL)
Apr 17 Bill Warren
(field trip: Brown)
Apr 24 Student presentations
(at CNS)
May 1 Student presentations
(at CNS)
Jan 16: Jeremy Wolfe (at CNS)
Core reading:
Visual Search (1998) Wolfe J. In: Pashler H., editor. Attention.
London UK:
University College London Press.
This article is downloadable from Jeremy's publications
page.
There you will also find a number of other pertinent background
and
supplementary readings.
Jan 23 Rick Born and Chris Pack (field
trip)
Background:
Albright TD, Stoner GR (1995) Visual motion perception.
Proc Natl Acad
Sci U S A 1995 Mar 28;92(7):2433-40
Allman, J. M., F. Miezin, and E. McGuinness (1985) Direction- and
velocity-specific responses from beyond the classical receptive field
in the
middle temporal visual area (MT). Perception 14:105-26.
Core:
Albright TD. Direction and orientation selectivity of neurons
in visual
area MT of the macaque. Journal of Neurophysiology, 1984;
52(6):1106-30.
Lorenceau J, Shiffrar M, Wells N, Castet E. Different motion
sensitive
units are involved in recovering the direction of moving lines. Vision
Research, 1993; 33(9):1207-17.
Pack CC, Born RT. Temporal dynamics of a neural solution to the
aperture
problem in macaque visual area MT. Nature, in press. Downloadable
pdf
available from here.
Born, R. T., J. M. Groh, R. Zhao, and S. L. Lukasewycz (2000) Segregation
of
object and background motion in visual area MT: effects of microstimulation
on eye movements. Neuron. 2000 Jun;26(3):725-34.
Downloadable pdf
available from here.
Supplementary:
Britten, K. H., W. T. Newsome, M. N. Shadlen, S. Celebrini, and J.
A.
Movshon (1996) A relationship between behavioral choice and the visual
responses of neurons in macaque MT. Vis. Neurosci. 13:87-100.
Newsome, W T, R H Wurtz, M R Dursteler, and A Mikami (1985) Deficits
in
visual motion processing following ibotenic acid lesions of the middle
temporal visual area of the macaque monkey. J. Neurosci. 5:825-40.
Masson GS, Rybarczyk Y, Castet E, Mestre DR (2000) Temporal dynamics
of
motion integration for the initiation of tracking eye movements at
ultra-short latencies. Visual Neuroscience.
Jan 30 Bill Freeman (at CNS)
W. T. Freeman, E. C. Pasztor, O. T. Carmichael Learning Low-Level
Vision International Journal of Computer Vision, 40(1), pp. 25-47,
2000. http://www.merl.com/papers/docs/TR2000-05.pdf
Recovering intrinsic images from a single image (Tappen, Freeman, and
Adelson)
ftp://publications.ai.mit.edu/ai-publications/2002/AIM-2002-015.pdf
Optional related papers --
On the mathematics of belief propagation:
J. Yedidia, W. T. Freeman and Y. Weiss, Understanding belief
propagation and its generalizations International Joint Conference on
Artificial Intelligence (IJCAI 2001), Distinguished Papers Track.
http://www.ai.mit.edu/people/wtf/ijcai_final.pdf
More on super-resolution:
William T. Freeman, Thouis R. Jones, and Egon C. Pasztor,
Example-based super-resolution, IEEE Computer Graphics and
Applications, March/April, 2002.
http://www.ai.mit.edu/people/wtf/papers/g2free-lo.pdf
On graphics application:
Shapetime photography (Freeman and Zhang)
ftp://publications.ai.mit.edu/ai-publications/2002/AIM-2002-002.pdf
Feb 6 Steve Grossberg (at
CNS)
Presentation title:
Why is the Cerebral Cortex Laminar?
A Unified View of Visual Development, Learning, Attention, and Grouping
The following articles are available for download at Grossberg's
publications page.
Grossberg, 1999, Spatial Vision
Grossberg and Raizada, 2000, Vision Research
Grossberg and Williamson, 2001, Cerebral Cortex
Raizada and Grossberg, 2003, Cerebral Cortex
Grossberg and Howe, 2003, Vision Research
Feb 13 Paul Dizio (Field trip)
Krakauer JW, Ghilardi MF, Ghez C Independent learning of internal
models for
kinematic and dynamic control of reaching. Nature Neuroscience,
2(11): 1026-1031, 1999.
Brandt T, Glasauer S, Stephan T, Bense S, Yousry TA, Deutschlander A,
Dieterich M
Visual-vestibular and visuovisual cortical interaction - New insights
from fMRI and PET.
Neurobiology of Eye Movements: From Molecules to Behaviour, Annals
of the New
York Academy of Sciences, 956: 230-241, 2002.
Roy JE, Cullen KE Selective processing of vestibular reafference
during self-generated
head motion. Journal of Neuroscience, 21(6):
2131-2142, 2001.
Feb 20 Student presentations
(at CNS)
Each presentation will last approximately
10 minutes, including questions.
Feb 27 Michele Rucci (at CNS)
Snodderly DM, Kagan I, Gur M.Selective activation of visual cortex
neurons by fixational eye movements: implications for neural coding.
Vis Neurosci. 2001 Mar-Apr;18(2):259-77. pdf
Martinez-Conde S, Macknik SL, Hubel DH. Microsaccadic eye movements and
firing of single cells in the striate cortex of macaque monkeys. Nat
Neurosci. 2000 Mar;3(3):251-8. pdf
Rucci M, Edelman GM, Wray J. Modeling LGN responses during
free-viewing: a possible role of microscopic eye movements in the
refinement of cortical orientation selectivity.J Neurosci. 2000 Jun
15;20(12):4708-20. pdf
Mar 6 Pawan Sinha
Brennan, S. E. (1985). Caricature generator. Leonardo, 18:170-178.
Rhodes, G., Brennan, S., and Carey, S. (1987). Identification and ratings
of
caricatures: implications for mental representations of faces. Cognitive
Psychology, 19:473-497.
Sacks, O. (1995). To see and not see. In An Anthropologist on Mars, Vintage
Books, New York, pp 108-152.
Le Grand, R., Mondloch, C. J., Maurer, D. and Brent, H. P. (2001). Early
visual
experience and face processing. Nature, 410, 890.
Mar 13 No class (spring break)
Mar 20 Chris Stauffer (Field trip)
For readings, see: http://www.ai.mit.edu/people/stauffer/Papers/
Chris Stauffer, Eric Grimson, "Learning Patterns of Activity Using Real-Time
Tracking", pami, 22(8):747-757, 2000.
Chris Stauffer and Kinh Tieu. "Automated multi-camera planar tracking
correspondence modeling." Not yet published. Pointer at:
http://www.ai.mit.edu/people/stauffer/Papers/staufferMulticamCVPR2003.pdf.
Chris Stauffer, Erik G. Miller, Kinh Tieu, "Transform-invariant image
decomposition with similarity templates", to appear in NIPS 2001, 2001.
Additional Readings:
Hofmann's paper is a useful overview of exploiting dyadic data in a
probabilistic framework...
Unsupervised Learning from Dyadic Data
(http://citeseer.nj.nec.com/114563.html)
Thomas Hofmann & Jan Puzicha
Technical Report, ICSI TR-98-042
Mar 27 Marc Pomplun (Field trip)
Pomplun, M., Reingold, E.M. & Shen, J. (2001). Investigating the visual
span in comparative search: The effects of task difficulty and divided
attention. Cognition 81, B57-B67.
http://www.cs.umb.edu/~marc/pubs/pomplun_et_al_cognition2001.pdf
Reingold, E.M., Charness, N., Pomplun, M. & Stampe, D.M. (2001). Visual
Span in Expert Chess Players: Evidence from Eye Movements. Psychological
Science 12, 49-56.
http://www.cs.umb.edu/~marc/pubs/reingold_et_al_psysci2001.pdf
Pomplun, M., Reingold, E.M. & Shen, J. (2001). Peripheral and parafoveal
cueing and masking effects on saccadic selectivity in a gaze-contingent
window paradigm. Vision Research 41, 2757 - 2769.
http://www.cs.umb.edu/~marc/pubs/pomplun_et_al_visionres2001.pdf
Inamdar, S. & Pomplun, M. (submitted). Comparative Search Reveals the
Tradeoff between Eye Movements and Working Memory Use in Visual Tasks.
Twenty-Fifth Annual Conference of the Cognitive Science Society, Boston,
Massachusetts.
http://www.cs.umb.edu/~marc/pubs/inamdar_pomplun.pdf
Apr 3 Margaret
Livingstone and Piers Howe (Field trip)
The stereoscopic correspondence problem
1) Ohzawa, DeAngelis, Freeman (1990) Science 249 1037-1041 AND
Livingstone + Tsao (1999) Nature Neuoscience 2(9) 825-832. People just need
to skim these
two papers to get the basic concept that there are cells in V1 that act like
disparity detectors and what their reponse maps look like.
2) Blake + Wilson (1991) TINS 14(10) 445-451. This gives a good overview
of
what the stereo correspondence problem is and how it might be solved.
3) Cumming + Parker (2000) J. Neuroscience 20(12) 4758-4767. People
need to
get from this paper that neurons in V1 respond approximately equally to both
true + false matches and so do not solve the correspondence problem begging
the question of which brain area does.
Apr 10 Baback Moghaddam and Matthew
Brand (Field trip)
Readings to be posted here.
Apr 17 Bill Warren
(Field trip)
Readings to be posted here.
Apr 24 Student presentations
(at CNS)
Each presentation will last
approximately 20 minutes, including questions.
May 1 Student presentations
(at CNS)
Each presentation will last
approximately 10 minutes, including questions.
Last Updated 27 March 2003
This page is maintained by Ennio Mingolla
Please direct questions to: ennio@cns.bu.edu