CAP6610: Machine Learning



What is about this course?

Machine learning is concerned with the question of how to construct computer programs that learn in a broad sense. The immediate benefit of machine learning would be to enable AI programs to improve their performance automatically over time. For example, a chess program can improve its game plan against its opponent through playing. A robot can recognize a particular kind of object more accurately though repeated presentation of the object image. At a fundamental level, a machine with a clearly demonstrated ability to learn would answer the question of whether machines can exhibit true intelligence.

This course covers several important learning paradigms including learning from examples, decision tree learning, neural networks, support vector machines, Bayesian learning, learning rules, analytical learning, and reinforcement learning. Important learning algorithms are taught in detail and illustrated with real-world applications. In addition, computational learning theory including PAC learning, VC-dimension, and sample complexity is examined.

Recently, data mining has become an important application area of machine learning. Data mining deals with the discovery of hidden knowledge, patterns, and rules from large databases. This course also has a special series of discussions on this topic.

Who teaches the course?

LiMin Fu

When?

Teaching Material:

Fu's Lecture Notes:

Introduction to Machine Learning

Concept Learning

Decision Tree Learning

Artificial Neural Networks

Evaluation

Bayesian Learning

Computational Learning Theory

Reinforcement Learning

Learning Rules

Genetic Algorithms

Textbook (required):

Supplementary Material:

From WWW resources

Data Mining

Genetic Algorithms

Genetic Programming

Prerequisites:

In general, backgrounds in artificial intelligence and in statistics are helpful.

Course Objectives:

Course Requirements:

Introduce Yourself:

Please enter your personal information by clicking on Register: Introduce yourself

Check Your Grade On-Line:

You may check your grades (homework, projects, exams, overall) any time as long as they are available by clicking on Check Your Grade. Notice, however, you need to have an ID name in order to use this facility.

Presentation Schedule:

Click here to find out your schedule for presenting your term research project

On-Line Materials (Homework and Projects)

Homework #1 (Due: 1/31)

Homework #2 (Due: 2/28)

Homework #3 (Due: 3/26)

Homework #4 (Due: 4/23)

Project #1 Decision Trees (Due: 2/24)

Project #2 Neural Networks (Due: 3/28)

Project #3 SVMs (Due: 4/14)

id3 document for Proj. #1

id3 program for Proj. #1

SVM README for Proj. #3

SVM train program for Proj. #3

SVM predict/test program for Proj. #3

Mushroom Train Data I for Proj. #1, #2, #3

Mushroom Train Data II (with 10% noise on the class labels) for Proj. #1, #2, #3

Mushroom Test Data for Proj. #1, #2, #3

Term Research Project (Due: 4/23)

A Tentative Schedule: