A Course in

Machine Learning

Hal Daumé III

Copyright © 2013–2017 Hal Daumé III

Self-published

http://ciml.info/

TODO. . . .

Second printing, January 2017

For my students and teachers.

Often the same.

 TABLE OF C ONTENTS

About this Book 6

1 Decision Trees 8

2 Limits of Learning 19

3 Geometry and Nearest Neighbors 29

4 The Perceptron 41

5 Practical Issues 55

6 Bias and Fairness 73

7 Beyond Binary Classification 85

8 Linear Models 99

9 Probabilistic Modeling 116

10 Neural Networks 129

 5

11 Kernel Methods 141

12 Learning Theory 154

13 Ensemble Methods 164

14 Efficient Learning 171

15 Unsupervised Learning 178

16 Expectation Maximization 186

17 Structured Prediction 195

18 Imitation Learning 212

Code and Datasets 222

Bibliography 223

Index 225