NOTE: This is a back-up page for people who do not (yet) have access to Canvas.
85-419/719: Introduction to Parallel Distributed Processing
Fall 2020, Tue/Thu 9:50-11:10am
Lectures on Zoom:
(get passcode from instructor)
Instructor: David Plaut <email@example.com>
Arrange meetings by email; Zoom Meeting ID: 544-375-7807
TA: Abhishek Dedhe <firstname.lastname@example.org>
Office hours: TBD; Zoom Meeting ID: 392-137-8979
We will be using a software package called "Lens" (for Light Efficient
Network Simulator). Follow the instructions below depending on your laptop's operating system:
Download the file Lens-windows.zip and unzip the file. Inside the resulting folder will be a folder called "Lens". Read the file "README.rtf" in this folder for further instructions. Because of differences in the way Windows and Unix-based systems handled spaces, it will simplify things if you put the Lens folder somewhere so that the full path to the folder doesn't contain spaces (i.e., C:\Lens or C:\Users\<name>\Desktop\Lens).
- Mac OS X
Download the file Lens-OSX.zip and double-click it to create an unzipped version. Inside will be a folder called "Lens". Read the text file README.txt in this folder for further instructions.
Download the file Lens-linux.tar.gz. Open a terminal and untar it with the command "tar xzf Lens-linux.tar.gz". This will create a directory called "Lens". Read the text file README.txt in this directory for further instructions.
If you have any problems getting Lens running, contact the instructor. The precompiled versions come with an offline (local) copy of the Lens manual that can be accessed by pointing your web browser at Manual/index.html in the Lens folder.
Tue Sep 1:
Overview and basic principles
- Rogers, T.T. (2009).
In Squire, L. (Ed.), Encyclopedia of Neuroscience, Volume 3, pp. 75-82. Oxford: Academic Press.
- (opt: Rogers, T.T. and McClelland, J.L. (2014).
Parallel distributed processing at 25: Further explorations in the microstructure of cognition.
Cognitive Science, 38, 1024-1077.
Up to the top of p. 1041 only.
This goes into a bit more depth than the Rogers chapter.)
- (opt: O'Reilly et al. (2014).
CCN, Chapter 1.)
- (opt: O'Reilly et al. (2014).
CCN, Chapter 2.)
Thu Sep 3:
Lens tutorial [INSTALL LENS]
Tue Sep 8:
Thu Sep 10:
Tue Sep 15:
Localist vs. distributed representations
- Hinton, G.E., McClelland, J.L., & Rumelhart, D.E. (1986).
Distributed representations. PDP1, Chapter 3.
- (opt: McClelland, J.L. & Rumelhart, D.E. (1981).
An interactive activation model of context effects in letter perception: Part 1. An account of basic findings.
Psychological Review, 88, 375-407.)
- (opt: McClelland, J.L. & Elman, J.L. (1986).
The TRACE model of speech perception.
PDP2, Chapter 15.
The speech analog of the IA model.)
- (opt: Plaut, D.C. and McClelland, J.L. (2010).
Locating object knowledge in the brain: A critique of Bowers's (2009) attempt to revive the grandmother cell hypothesis.
Psychological Review, 117, 284-290.
A position piece that argues against localist representations in the brain.)
Thu Sep 17:
Correlation-based learning (Hebb rule)
[HOMEWORK 1 DUE]
- McLeod, P., Plunkett, K. and Rolls, E.T. (1998).
Pattern association. MPR, Chapter 3.
- (opt: O'Reilly et al. (2014). Learning,
CCN, Chapter 4.)