| Class # | Date | Topic | Readings | Homework Due |
|---|---|---|---|---|
| Week 1 | ||||
| 1 | 6 Jan | Intro | 1-10 | |
| 2 | 8 Jan | Neuron model, digraph model, feedback | 10-20 | |
| Week 2 | ||||
| 3 | 11 Jan | Net architecture, knowledge rep., Learning | 21-46 | |
| 4 | 13 Jan | SLP structure and convergence theorem | 47-55 | HW 1 |
| 5 | 15 Jan | Bath vs. sequential SLP | ||
| Week 3 | ||||
| 18 Jan | Holiday | |||
| 6 | 20 Jan | Bayes Classification vs. the Single Layer Perceptron | 55-65 | |
| 7 | 22 Jan | Optimization and LMS | 99-117 | HW 2 |
| Week 4 | ||||
| 8 | 25 Jan | LMS and Bayes Classification | 122-129 | P1 |
| 9 | 27 Jan | Myultilayer Perceptrons | ||
| 10 | 29 Jan | Back Propagation | 129-131 | |
| Week 5 | ||||
| 11 | 1 Feb | More on Back Propagation & Program 2 Assignment | 131-143 | |
| 12 | 3 Feb | |||
| 13 | 5 Feb | MLP Training, Generalization, Crossvalidation | 164-175 | |
| Week 6 | ||||
| 14 | 8 Feb | Structural Risk Minimization Networks | 209-214 | HW3 |
| 15 | 10 Feb | Small and Large Scale Learning & Test Review | 214-218 | |
| 16 | 12 Feb | Exam 1 | ||
| Week 7 | ||||
| 17 | 15 Feb | Convolution Networks | 201-203 | |
| 18 | 17 Feb | Radial Basis Functions | 230-238 | |
| 19 | 19 Feb | K-means Clustering | 236-242 242-245 | |
| Week 8 | ||||
| 20 | 22 Feb | Test Debriefing & Fuzzy C-Means | ||
| 21 | 24 Feb | RLS Algorithm, Hybrid RBFN Plan | 245-248 | HW4 P2 |
| 22 | 26 Feb | Matlab RBFNs & Support Vector Machines | 268-272 | |
| Week 9 | ||||
| 23 | 1 Mar | Support Vector Machines | 272-275 | |
| 24 | 3 Mar | SVMs for Non-separable patterns | 276-280 | |
| 25 | 5 Mar | Kernel SVM | 281-286 | |
| 6-14 Mar | Spring Break | |||
| Week 10 | ||||
| 26 | 15 Mar | Self-Organization & PCA | 367-383 | |
| 27 | 17 Mar | Kernel PCA | 401-406 | HW5 P3 |
| 28 | 19 Mar | Project 4 Description + SOM | , 425-437 | |
| Week 11 | ||||
| 29 | 22 Mar | More Self Organizing Maps | 425-437 | HW6 |
| 30 | 24 Mar | Properties of Feature Maps | 437-445 | |
| 31 | 26 Mar | Exam 2 | P4 | |
| Week 12 | ||||
| 32 | 29 Mar | Kernel SOM | 454-464 | |
| 33 | 31 Mar | Test Debriefing and Project 5 | ||
| 34 | 2 Apr | Bidirectional Associative Memory | Rojas § 1-2 | |
| Week 13 | ||||
| 35 | 5 Apr | Discrete Hopfield Net | Rojas § 2 | HW 7 |
| 36 | 7 Apr | Ising Model, Hopfield Convergence | Rojas § 2-3,6 | |
| 37 | 9 Apr | Hopfield Net Learning, Graded Weights, and RC Network Hopfield Model | ||
| Week 14 | ||||
| 38 | 12 Apr | Independent Components Analysis | 508-514 | |
| 39 | 14 Apr | Natural-Gradient Learning for ICA | 516-526 | |
| 40 | 16 Apr | Fast ICA | 534-541 | HW8 |
| Week 15 | ||||
| 41 | 19 Apr | Slack space for ICA | ||
| 42 | 21 Apr | Exam 3 | P5 | |