COT 5615, Math for Intelligent Systems, Fall 2012

Place:CSE; E118
Time:Monday, Wednesday, Friday 7th Period (1:55-2:45 p.m.)

Instructor:
Prof. Arunava Banerjee
Office: CSE E336.
E-mail: arunava@cise.ufl.edu.
Phone: 505-1556.
Office hours: Tuesday 2:00 p.m.-4:00 p.m. or by appointment.

TA:
Subhajit Sengupta
TA Office: CSE E309.
E-mail: ss5@cise.ufl.edu.
Office hours: Wednesday 3:00 p.m.- 5:00 p.m. or by appointment.

Pre-requisites:

The goal of this course is to cover several topics in mathematics that is of general interest to people pursuing a Ph.d in intelligent systems. The course will focus on conceptual clarity.

There is no official text book for this course. We will mostly work with online material posted on the net. However, following are four good books to keep in mind.

References:
Principles of Mathematical Analysis, W. Rudin
Linear Algebra, K. M. Hoffman, R. Kunze
Probability and Measure, P. Billingsley
Probability: Theory and examples, R. Durrett, can be found online at http://citeseer.ist.psu.edu/viewdoc/summary?doi=10.1.1.155.4899

Please return to this page at least once a week to check updates in the table below

Evaluation: The final grade will be based on two midterm exams (30% each) and several assignments (remaining 40%).

Course Policies:

Academic Dishonesty: See http://www.regulations.ufl.edu/chapter4/4017.pdf for Academic Honesty Guidelines. All academic dishonesty cases will be handled through the University of Florida Honor Court procedures as documented by the office of Student Services, P202 Peabody Hall. You may contact them at 392-1261 for a "Student Judicial Process: Guide for Students" pamphlet.

Students with Disabilities: Students requesting classroom accommodation must first register with the Dean of Students Office. The Dean of Students Office will provide documentation to the student who must then provide this documentation to the Instructor when requesting accommodation.

Tentative List of Topics to be covered

List of Topics covered --!>
Week Topic Additional Reading Assignment
Aug 19 - Aug 25
  • Introduction
  • Natural numbers, Rationals
  • Ordered sets, Reals as Dedekind Cuts
  • Countably infinite (proof for rationals)
Aug 26 - Sep 01
  • Reals are uncountable (Cantor's diagonalization proof)
  • Least upper bound (lub property inplies gub property)
  • Rings and Feilds
  • Convergence, Cauchy sequence
Sep 02 - Sep 08
  • Reals are complete
  • Limit Supremum and Limit Infimum
  • Continuity: Limit definition of continuous functions
Sep 09 - Sep 15
  • Weierstrass's definition of continuous fns, equivalence
  • Metric spaces
  • Basic point set topology
  • epsilon neighborhoods, limit points, interior points, open sets, closed sets
  • Thm: Open iff complement is closed
Sep 16 - Sep 22
  • Basic point set topology continued;
  • Thm: Arbitrary union, Finite intersection of open sets is open
  • Definition: Topological space, trivial topology, discrete topology
  • Pointwise continuity, Uniform continuity, Absolute continuity
Sep 23 - Sep 29
  • Linear maps.
  • Vector/Linear spaces.
  • Span, Linear Independence, Basis
  • Matrix representation of a linear map
  • Matrix multiplication with vector and matrix, and relationship to linear maps and composition of linear maps
Sep 30 - Oct 06
  • Composition of linear maps and Matrix multiplication
  • Gaussian Elimination and LU decomposition
Oct 07 - Oct 13
  • Midterm I (Monday In-class)
  • Normed (+Complete=Banach) vector spaces, Inner product spaces
  • Inner product (+Complete=Hilbert) spaces
  • Started Gram Schmidt orthogonalization
Oct 14 - Oct 20
  • Orthonormal basis; advantages, orthonormal vectors are independent.
  • Fourier series
Oct 21 - Oct 27
  • Dual of a vector space
  • Tensors
  • Symmetric and Alternating tensors
  • determinant=signed volume
  • Started eigenvectors/eigenvalues
Oct 28 - Nov 03
  • Finished eigenvectors and eigenvalues.
  • Unconstrained/constrained optimization
  • The Lagrange Multiplier technique
  • Convex functions and proof of local=global minima
Nov 04 - Nov 10
  • Mathematical probability theory
  • Sample space, sigma algebra, probability measure.
  • The Borel sigma algebra.
Nov 11 - Nov 17
  • Random variables, Indicator RV
  • Distribution function, density function.
  • Expected value, Conditional distribution, marginal distribution
Nov 18 - Nov 24
  • Random variable transform, Independence.
  • Independence of random variables.
Nov 25 - Dec 01
  • Markov and Chebychev's inequalities
  • Weak law of large numbers (and proof)
  • Information theory:
  • Entropy, conditional entropy, mutual information, Kullback Leibler divergence.
Dec 02 - Dec 08
  • Review
  • Midterm II (Wednesday, In-class)