The Lecture Notes and Handouts constitute the mandatory reading, and consist of two main ingredients:
Additional, optional reading are also listed to quench your thirst for more knowledge than contained in the Lecture Notes. The references to those are given in the Course materials.
If a .ps or .pdf file comes up with poor resolutin on your screen, the printed version should still be perfectly fine. If that is not the case alert me.|
No. |
Date |
Topic |
Lecture Notes | >
Homework | >
Optional Reading |
|||||
|
1 |
Jan 10 |
Orientation, Introduction |
HW1 due 1/17, electronic copy only. |
Haykin Ch1 |
||||||
|
2 |
Jan 12 |
Background review |
|
Haykin Ch1 |
||||||
|
3 |
Jan 17 |
Background review, cont'd |
CF2/1, CF2/2
|
HW2 due 1/26 |
Haykin Ch10 or Cover & Thomas Ch1 and Ch9 |
|||||
|
4 |
Jan 19 | Associative memory | CF1/2
L3-NoisyNeuron.pdf L4-AssociativeMemory.pdf |
Haykin Ch2.11 | ||||||
|
5 |
Jan 24 | Associative memory, cont'd, error correction | CF1/2
L4-AssociativeMemory.pdf updated |
Haykin Ch2.1-4, Ch2.11 | ||||||
|
6 |
Jan 26 | Wrap up Associative memory
Perceptron |
CF1/3
L5-Perceptron.pdf |
HW3 due 2/2 | Haykin Ch3 | |||||
7 |
Jan 31 | Perceptron, cont'd | CF1/3
L5-Perceptron.pdf |
Haykin Ch3 | ||||||
8 |
Feb 2 | Multilayer Perceptron (Back Propagation) | CF1/4
L6-MultiLayerPerceptron.pdf |
HW4 Part1 due 2/9 |
Haykin Ch4.1-4.4 | |||||
9 |
Feb 7 | Issues With Backprop | CF1/4
L7-IssuesWithMLPs.pdf |
HW4 Part2 due 2/16 |
Haykin Ch4.5-4.8 | |||||
10 |
Feb 9 | Issues With Backprop: Momentum | CF1/4
L7-IssuesWithMLPs.pdf |
Haykin Ch4.5-4.8 | ||||||
11 |
Feb 14 | More practical issues (EM); Vector Backprop; BP clinic (BB) | CF1/4
L7-IssuesWithMLPs.pdf |
Haykin Ch4.5-4.8 | ||||||
12 |
Feb 16 | VC dimension | CF1/4
L8-VCdimension.pdf |
HW5-P1andP2 due 2/24 5pm | Haykin Ch4.5-4.8, Haykin pp 94 - 102, Bishop | |||||
13 |
Feb 21 | QUIZ1 Network Pruning | CF2/3
L9-NetworkPruning.pdf L10-UnsupervisedLearning.pdf |
Haykin CH8.1-5 | ||||||
14 |
Feb 23 | Network Pruning Unsupervised learning; Oja's PCA net |
CF2/3
L9-NetworkPruning.pdf L10-UnsupervisedLearning.pdf |
Haykin CH8.1-5 | ||||||
|
Feb 27 - Mar 3 | SPRING BREAK, no classes | ||||||||
15 |
Mar 6 | Unsupervised learning; Sanger's PCA net
Competitive learning: SOM |
CF2/3, CF1/5.6-8
L10-UnsupervisedLearning.pdf L11-CompetitiveLearning.pdf |
HW6 due 3/13 | Haykin CH8.1-5, CH9.1-6 | |||||
16 |
Mar 8 | Competitive learning: SOM, cont'd | CF2/3, CF1/5.6-8
L11-CompetitiveLearning.pdf Self_Organizing_Maps-EM502.pdf |
Haykin CH8.1-5, CH9.1-6 | ||||||
17 |
Mar 13 | Discussion of project proposals | Meet in my office bring hardcopy of your draft proposal |
HW7 due 3/20 | ||||||
18 |
Mar 15 | Competitive Learning (SOM, LVQ), cont'd | CF1/5.6-8,
CF1/7.1-7.2
L12-RecurrentNetworks.pdf |
Haykin CH9.1-6, CH14 | ||||||
19 |
Mar 20 | Recurrent nets | CF1/7.1-7.2,
L12-RecurrentNetworks.pdf |
Haykin Ch14 | ||||||
|
Mar 20 | Midterm exam handed out | Exam due 3/27 Material for midterm up to (including) GHA, and HW-6 exercise. |
|||||||
| Mar 22 | NO CLASS (spring recess) | HW8 due 3/29 | ||||||||
20 |
Mar 27 | Recurrent nets, cont'd Simulated Annealing |
CF1/7.1-7.2,
L12-RecurrentNetworks.pdf L13-RecurrentNetworks-SAandBM.pdf |
Haykin Ch14 | ||||||
21 |
Mar 29 | Recurrent nets, cont'd: Boltzmann Machine Network Growing: Cascade Correlation |
CF1/7.1-7.2,CF2/5.4-5.6
L13-RecurrentNetworks-SAandBM.pdf L14-NetworkGrowing.pdf |
Haykin Ch11 | ||||||
22 |
Apr 3 | Cross-Entropy as Objective Function Conjugate Gradients (Faster Supervised Learning) |
CF2/5.4-5.6, CF1/8.3-5, 8.7
L15-InfoTheoreticalObjectiveFunctions.pdf L16-ConjugateGradients.pdf |
Haykin Ch10 | ||||||
23 |
Apr 5 | QUIZ2 Information Theoretic Models, cont'd |
Material for QUIZ2: from QUIZ1 to April 3 | |||||||
24 |
Apr 10 | Blind Source Separation Factorial codes |
CF
2/6
ANN-NLPCA-and-ICA.pdf FactorialCodes.pdf |
Parts of Haykin Ch10 | ||||||
25 |
Apr 12 | Class project prevew presentations and feedback, 10+2 minutes per group |
||||||||
25 |
Apr 17 | No class. Compensation for midterm time. Instructor out of town. |
||||||||
26 |
Apr 19 | No class. Class period given up in compensation for project write-ups. |
Project reports due 4/20, 5pm. Turn in one hardcopy and upload one electronic copy to
Owl Space. Recommended length: 10-12 pages. Max. (cutoff) length 15 pages. Appendices s.a. code
do not count in the max page number. You can hand the hard copy to Margaret Poon (DH 2124, poon@rice.edu, -6032). |
|||||||
Return to COMP / ELEC 502 / STAT 502 home page