Lecture 3

Unsupervised learning

Clustering algorithms: Leader clustering and K-means clustering
Norms and metrics
Competitive learning
Adaptive resonance theory - 1970s
ART 1: Binary pattern learning
ART 2-A: A fast, algorithmic version of ART 2
Freud's neural networks

Clustering

• http://en.wikipedia.org/wiki/Data_clustering
• Duda, Richard O., Hart, Peter E., and Stork, David (2001) Pattern Classification. Second Edition. New York: Wiley. Section 10.4.3: k-means clustering, pp. 526-528 http://en.wikipedia.org/wiki/K-means

Competitive learning

• Levine, Daniel S. (2000) Introduction to Neural and Cognitive Modeling. Hillsdale, NJ: Lawrence Erlbaum Associates, 2nd Edition. Part 1 Part 2 Part 3 Part 4
  • Chapter 4: Competition, lateral inhibition, and short–term memory, pp. 95–154.
  • Chapter 6: Coding and categorization, pp. 198–279.
• Malsburg, Christoph von der (1973) Self–organization of orientation sensitive cells in the striate cortex. Kybernetik, 14, 85–100.
• Grossberg, Stephen (1976) Adaptive pattern classification and universal recoding, I: Parallel development and coding of neural feature detectors. Biological Cybernetics, 23, 121–134.

Adaptive Resonance Theory – 1970s

• Grossberg, Stephen (1976) Adaptive pattern classification and universal recoding, II: Feedback, expectation, olfaction, and illusions. Biological Cybernetics, 23, 187–202.

ART 1

• Carpenter, Gail A., and Grossberg, Stephen (1987) A massively parallel architecture for a self–organizing neural pattern recognition machine. Computer Vision, Graphics, and Image Processing, 37, 54–115.
• Moore, Barbara (1989) ART 1 and pattern clustering. In David S. Touretzky, Geoffrey Hinton, and Terrence Sejnowski (Eds.) Proceedings of the 1988 Connectionist Models Summer School. San Mateo, Calif.: Morgan Kaufmann Publishers. pp. 174–185.

ART 2–A algorithm

• Carpenter, Gail A., Grossberg, Stephen, and Rosen, David B. (1991) ART 2–A: An Adaptive Resonance algorithm for rapid category learning and recognition. Neural Networks, 4, 493–504.

Freud's neural networks

• http://en.wikipedia.org/wiki/Freud
• Freud, Sigmund (1886–1899) Project for a Scientific Psychology. pp. 322–325. (1900) The Interpretation of Dreams. Introduction by James Strachey (Editor and translator). New York: Avon Books (1965).
• Tucker, Don M., and Luu, Phan (1998) Cathexis revisited: Corticolimbic resonance and the adaptive control of memory. In Robert M. Bilder and F. Frank LeFever (Eds.) Neuroscience of the Mind on the Centennial of Freud’s Project for a Scientific Psychology. Annals of the New York Academy of Sciences, Vol. 843. New York: The New York Academy of Sciences. pp. 134-152.