December 5th, 2011:  Midterm II will be held in Anderson Hall (AND-34) from 8:20-10:10PM. The material is: Graphical models, belief propagation including Bethe/Kikuchi approximations, manifold learning  including Laplacian eigenmaps, local linear embedding, ISOMAP. The midterm is CLOSED BOOK.

December 5th, 2011:  ISOMAP paper.

November 29th, 2011:  Local linear embedding where the best graph that fits a set of data is sought. ICML 2009 paper.

November
24th, 2011:  Homework 3 (due December 5th, 2011, in class). Bishop 8.19, 8.24, 8.26, Small 2.4.7 (from this page). Also, prove equation (26) in Yuille's paper.

November 23rd, 2011:  Project desiderata now up. Please give feedback.

November 23
rd, 2011: Makeup lectures are available here. We're following Alan Yuille's CCCP for the Bethe and Kikuchi free energies paper.

October 31st, 2011:  Laplacian Eigenmaps paper.

October 24th, 2011:  Midterm I  to be held in TUR2334 from 8:20-10:10PM on Tuesday, October 25th, 2011. The topics are AdaBoost, Random Forests, the Hammersley-Clifford theorem and Besag's paper, and Bishop 14.3, 14.4, Chapter 8 up to and including 8.4.1.

October 24th, 2011: Homework 2 text portion now due Wednesday, October 26th  in class and programming portion due Monday, October 31st  in class.

October 4th, 2011: Homework 2 (due Monday, October 24th, in class): Bishop 8.4, 8.8, 8.10, 8.16, 8.17. Run AdaBoost and Random forests on the diabetes and ionosphere datasets in the UCI repository and try and reproduce lines 3 and 6 in Table 2 of Breiman's paper. Prove the inequalities in equations 7 and 8 in Breiman's paper. This homework counts for twice the credit of a normal homework.

October 4th, 2011:
Julian Besag's paper on the Hammersley-Clifford theorem.

September 13th, 2011: Breiman's original Random Forests paper.

September 13
th, 2011: Homework 1 (due Monday, September 26th, in class): Bishop 14.6, 14.7, 14.8, 14.9, 14.10 (and please work out the corresponding case for the sum of absolute value of errors as well).

August 31st, 2011: Bishop's AdaBoost algorithm.

August 20th, 2011: The first two classes on Monday, August 22nd are canceled since I'm forced to attend an NSF-sponsored meeting. We'll do a make up during the semester.