Date  Description  Chapters  Slides  Comments 
Aug 26 (NO CLASS) 
NO CLASS  Saved for presentations (Dec 2) 



Aug 28 
Lecture 1
Overview/Introduction
 1, 2.1 
01intro.pdf 

Sep 2 
Lecture 2
Hypothesis spaces 
2.72.10 
02hypothesis_spaces.pdf 

Sep 4 
Lecture 3
Space of Algorithms
Linear Threshold Classifiers 
2.72.10 10.110.4 
03space_of_algs_and_LTUs.pdf 

Sep 9 
Lecture 4
Project details
Perceptrons
Logistic Regression
 11.111.4 10.610.7 
04perceptrons_LogReg.pdf 
HW 1 
Sep 11 
Lecture 5
Linear Discriminant Analysis 
6.6 5.15.5 
05LDA.pdf 

Sep 16 
Lecture 6
OffTheShelf Learning Algorithms
Decision Trees 
9.19.3 
06OffTheShelfAlgsDecisionTrees.pdf 

Sep 18 
Lecture 7
Decision Trees (cont)
 
07DecisionTrees.pdf 
HW 1 due HW 2 posted 
Sep 23 
Lecture 8
Nearest Neighbor 
8.18.5 
08NearestNeighbor.pdf 
Project preproposals due (1 page) 
Sep 25 
Lecture 9
Neural networks 
11.511.7 
0910NeuralNetworks.pdf 

Sep 30 
Lecture 10
Neural networks (cont) 


HW 2 due HW 3 posted 
Oct 2 (NO CLASS) 
No class  saved for presentations (Dec 4) 



Oct 7 
Lecture 11
Bayesian Learning 
Appendix A 
1112BayesianLearning.pdf 

Oct 9 
Lecture 12
Bayesian Learning (cont) 
3.13.4, 3.7 4.44.51 

Project proposals due 
Oct 14 
Lecture 13
Support Vector Machines 
10.9 
1314SVM.pdf 
HW 3 due 
Oct 16 
Lecture 14
Support Vector Machines (cont) 



Oct 21 
MIDTERM 



Oct 23 
Lecture 15
Learning Theory 
2.22.3 
1516learningtheory.pdf 

Oct 28 
Lecture 16
Learning Theory (cont) 



Oct 30 
Lecture 17
Learning Theory finished
Bias/Variance Theory & Ensemble Methods 
4.3 15.115.5 
1718biasvariance.pdf 
HW 4 posted 
Nov 4 
Lecture 18
Bias/Variance Theory & Ensemble Methods (cont) 



Nov 6 
Lecture 19
Bias/Variance Theory & Ensemble Methods finished
Preventing Overfitting: Penalty and Holdout methods 
4.74.9 
1920overfitting.pdf 

Nov 11 
Lecture 20
Overfitting finished
HoldOut and Crossvalidation Methods
 14.114.2 

HW 4 due 
Nov 13 
Lecture 21
Penalty methods: decision trees, neural nets, SVMs 
8.68.8 
21penaltymethods.pdf 
HW 5 posted
statlog.arff
statlog_test.arff

Nov 18 
Lecture 22
Evaluating and Comparing Classifiers 
14.314.9 
22evaluationofclassifiers.pdf 

Nov 20 
Lecture 23
Unsupervised Learning 
7 
2324unsupervised learning.pdf 

Nov 25 
Lecture 24
Unsupervised Learning (cont) 
7 

HW 5 due 
Nov 27  Thanksgiving  No class 



Dec 2 (double class) 3:304:50pm GFS 118 5:006:20pm GFS 118 
Lecture 2526
Project Presentations 1 (double class)
 

Project papers due 
Dec 4 (double class) 3:304:50pm GFS 118 5:006:20pm GFS 118 
Lecture 2728
Project Presentations 2 (double class)
 


Dec 11 (GFS 118) 
FINAL: 4:30pm6:30pm 


