Machine Learning - CS419 Reading Material

From Grundy
Jump to: navigation, search

This is a part of our Machine Learning article. Prof. Preethi Jyothi conducted an "Introduction to Machine Learning" course at IIT Bombay in Spring 2018. In this article, we have compiled all the reading material in this course. Also, have a look at the original course webpage.

Basics of Probability for ML

       Reading: http://www.deeplearningbook.org/contents/prob.html, Sections 3.1-3.8, 3.10, 3.11, 3.13

Linear Regression (incl. Regularization)

       Reading:  http://www.stat.cmu.edu/~cshalizi/mreg/15/lectures/03/lecture-03.pdf, Sections 2 & 3
       Reading:  http://www.stat.cmu.edu/~cshalizi/mreg/15/lectures/04/lecture-04.pdf, Sections 1.2, 1.3 and 2
       Reading:  https://web.stanford.edu/~hastie/ElemStatLearn/, Chapter 3.4 (everything before Eqn 3.45)

Naive Bayes & Logistic Regression Classifiers

       Reading: https://www.cs.cmu.edu/~tom/mlbook/NBayesLogReg.pdf, Entire chapter

Decision Trees

       Reading: https://www.cse.iitb.ac.in/~pjyothi/cs419/dtrees.pdf, Entire chapter

Perceptron Algorithm

       Reading: https://www.cs.cmu.edu/~avrim/ML10/lect0125.pdf

Basics of Statistical Learning Theory / Bias-Variance Tradeoff

       Reading: http://cs229.stanford.edu/notes/cs229-notes4.pdf
       Reading: http://www.cs.huji.ac.il/~shashua/papers/class11-PAC2.pdf, Section 11.1 on VC dimension

MLE vs MAP Estimation

       Reading: http://www.mi.fu-berlin.de/wiki/pub/ABI/Genomics12/MLvsMAP.pdf, Slides 1 to 35

SVMs + Kernel Methods

       Reading: http://svms.org/tutorials/Moore2001.pdf, Technical details about QP/lagrangian optimization are not important
       Reading: https://www.cise.ufl.edu/class/cis4930sp11dtm/notes/intro_svm_new.pdf, Slides 1 to 32

k-Means Clustering + Gaussian Mixture Models

       Reading: Chapter 9 from the book "Pattern Recognition and Machine Learning" by Chris Bishop, Entire chapter

Principle Component Analysis (PCA)

       Reading: https://arxiv.org/pdf/1404.1100.pdf, Sections I to V

Feedforward Neural Networks + Backpropagation

       Reading: http://ufldl.stanford.edu/tutorial/supervised/MultiLayerNeuralNetworks/

Ensemble Learning (Boosting / Bagging)

       Reading: Chapter 14 from the book "Pattern Recognition and Machine Learning" by Chris Bishop, Sections 14.3, 14.3.1
       Reading: http://jessica2.msri.org/attachments/10778/10778-boost.pdf, Slides 1 to 27

Fundamentals of hidden Markov Models

       Reading: https://web.stanford.edu/~jurafsky/slp3/9.pdf