ELEC / COMP 602
Fall 2010

Schedule

Class topics and titles of handouts will come on-line in a timely manner. Handouts will typically be provided in hardcopy format in class but some may be posted here. Should you have trouble getting a printout please notify me.

Additional, optional reading is also listed below. The references are resolved in the Course materials.

Key to notation:
EMvis-x = set #x of my visuals. EM-"other" = "other" electronic material that I may post.
SPvis-y = set #y of Student Presenter's visuals.

If a .ps or .pdf file comes up with poor resolutin on your screen, the printed version should still be perfectly fine. If that is not the case alert me.
>>td>

Date

Topic

Lecture Notes
Handouts

Homework/Reading Assignment
Turn in HW by 2:30pm on due date
unless otherwise indicated.
Reading assignment must be completed
by the indicated deadline.

Optional Reading

Aug 24

Orientation, Introduction

EMvis-1

Reading: Kohonen Ch3, due Aug 31

Haykin Ch9.1-9.6
Aug 26 Review of the basic SOM, EM EMvis-2

Reading: Kohonen Ch3
Refresh Competitive Learning from ELEC/CPOMP 502
Refresh SOM exercises from 502		 Haykin Ch9.1-9.6
Aug 31 Review of the basic SOM, EM
Discuss SOM exercises		 EMvis-3

 Reading assignment: for class on Sep 2, 7; no reviews:
Ultsch&Siemon, 1990; Cottrell&deBodt,
1995; Kraaijveld et al., 1995
Haykin Ch9.1-9.6
Sep 2 Review of basic SOM, cont'd,
SOM visualizations, DAT 		DATvis

 Reading assignment: for class on Sep 14
Tennenbaum et al., 2000, no review;
Review assignment: Sammon, 1969, due Sep 14		 Haykin Ch9.1-9.6
Sep 7 Review of the basic SOM

LVQ refresher, AG		 AGvis

Reading: Kohonen Ch3, Kohonen, 1990
Refresh Learning Vector Quantization, from ELEC/CPOMP 502
and from paper Kohonen, 1990		 Haykin Ch9.1-9.6
Sep 9 Review of the basic SOM, wrap-up
discussion of simulations 		EMvis

 paper Kohonen, 1990
Sep 14 Constructive proof of SOM ordering, DAT
Gold standards: Sammon's mapping, TV
 TVvis

 Experiment assignment: Use the MATLAB function for Sammon's mapping, apply to one of the {uniform or 4 Gaussians} AND one of the {iris or 6-D synthetic spectral image}, compare results with KSOM.
Do the same with the ISOMAP MATLAB implementation.
Results to be discussed in class on Sep 23, 5-7 minutes per student.

reading assignment: for classes on Sep 21, 23
DeSieno, 1988; NeuralWare, Neural Computation, SOM; (by Sep 21)
Review assignment: Kangas et al, 1990, due Sep 23
Sep 16 Gold standards: ISOMAP, AG
 AGvis

 reading assignment: due today
Tennenbaum et al., 2000, no review;
Sep 21 Variants of SOMS: Conscience SOM, EM;
Discuss leftover issues from previous classes; 		EMvis

 Experiment assignment: Implement conscince SOM, learn the same data as with KSOM, compare behavior and results.
(Choose one or two of the uniform, 4 Gaussians,
Iris, 6-D spectral cube data sets.)
Results to be discussed in class on Sep 28, 5-7 minutes per student.
Sep 23 Variants of SOMs: scaled distances (Kangas et al. 1990), TV
Discussion of Sammons / ISOMAP / KSOM simulations. 		TVvis, EMvis

reading assignment: Martinetz & Schulten, 1994 (for classes Sep 28 and 30)
Linde, Buzo, Gray, 1980 (for class on Sep 30)
Review assignment: Martinetz & Schulten, 1994, due Sep 30
Sep 28 Topology Representing Networks, EM student-vis, EMvis

reading assignment: Martinetz & Schulten, 1994; Linde, Buzo, Gray, 1980 (cont'd)
Sep 30 Topology Representing Networks, cont'd, EM
Discussion of KSOM vs Conscience SOM simulations. Lead: TV
 EMvis

reading assignment: Martinetz & Schulten, 1994; Linde, Buzo, Gray, 1980 (cont'd)
Oct 5 LBG (K-means): comparison with SOM, DAT
DATvis

reading assignment: Martinetz & Schulten, 1994; Linde, Buzo, Gray, 1980 (cont'd)
Review assignment: Martinetz & Schulten, 1994, due now
Oct 7 Topology Preservation in SOMs, EM
 EMvis

reading assignment: Villmann et al, 1997 due; Bauer and Pawelzik, 1992
Oct 12 Fall recess, NO CLASS
 reading assignment: Villmann et al, 1997. Read *thoroughly*
Oct 14 PCA networks: Oja and Sanger's GHA, DAT and All
 DATvis

reading assignment: 502 handouts
Exercise: run GHA, compare with MATLAB PCA
specifics will be given in class
Results to be discussed in class on Oct 21, ~ 10 minutes per student.
Oct 19
Clinic period
Oct 21 Students present GHA simulation reults
Topology representation and preservation, cont'd:
CONN and CONNvis, EM
EMvis

reading assignment: Tasdemir&Merenyi, TNN 2009
Discussion of GHA experiment results due, ~ 10 minutes per student.
Oct 26 Magnification in neural maps, EM

 EMvis

reading assignment: Bauer, Der, Hermann, 1996
Oct 28
Clinic period
Nov 2 Magnification of the Kohonen SOM, AG

 AGvis

reading assignment due: Ritter & Schulten, 1986
reading assignment for upcoming classes: Ritter, IEEE TNN 1991 (Asymptotic level density ...);
VanHulle and D. Martinez, IEEE TNN 1994 (BAR algorithm);
Dersch and Tavan, IEEE TNN 1995;
T. Martinetz et al., IEEE TNN 1993; (Neural Gas)
Merenyi et al., IEEE TNN 2007; (Magnification for "forbidden" data)
Review assignment: Pick two papers from
Ritter TNN 1991, VanHulle and Martinez, 1994,
and Dersch and Tavan, 1995. (Exclude what you present.)
Due Nov 11
Nov 4 Issues related to map magnification:
Asymptotic level density, TV
Neighborhood effects, DAT 		TVvis, DATvis

reading assignment due: Ritter, IEEE TNN 1991 (Asymptotic level density ...);
Dersch and Tavan, IEEE TNN 1995;
reading assignment, continued: T. Martinetz et al., IEEE TNN 1993; (Neural Gas)
Merenyi et al., IEEE TNN 2007; (Magnification for "forbidden" data)
Nov 9 SOM-hybrid classification and regression; Real applications, high-d cases, EM
 EMvis

reading assignment: Fardanesh and Ersoy; Sashahani and Landgrebe
Nov 11 Discussion of mini-projects; Round-table
 EMvis

reading assignment: Fardanesh and Ersoy; Sashahani and Landgrebe
Nov 16 The use of unlabeled data in supervised classification, BDB
 BDBvis

 Reding assignment due: Fardanesh and Ersoy; Sashahani and Landgrebe;
Nov 18 Neural ICA, EEPP network, SMV
 SMVvis

reading assignment: Girolami and Fyfe, Neural Networks 10(9), pp 1607-1618, 1997.
Nov 23 Growing Self-Organizing Map, GSOM, BDB
Practical issues for projects.
BDBvis

reading assignment: Bauer and Villmann, IEEE TNN 1997 (GSOM paper)
Nov 25 NO CLASS (Thanksgiving)

Nov 30 Factor Analysis with non-linear PCA nets, EM
 EMvis
Dec 2 Class project presentations
 Approx. 15 min + 5 minutes for discussion, for each talk
Turn in hardcopy and soft copy of your presentation.
Project write-ups are due Dec 10.

Return to ELEC 602 / COMP 602 home page