Skip to content

swaminathanj/ml

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

226 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Machine Learning

1. Foundations (Prerequisites and Introduction)

Introduction to Machine Learning

  1. What is ML? (Lecture 1)
  2. Supervised vs. Unsupervised vs. Reinforcement Learning (Lecture 2)
  3. Applications of Machine Learning (Activity 1)
  4. Basic ML Terminology (Lecture 3)

Python for Machine Learning

  1. NumPy for numerical operations (Numpy essentials)
  2. Pandas for data manipulation (Pandas essentials)
  3. Matplotlib/Seaborn for data visualization (Matplotlib essentials)
  4. Scikit-learn basics for loading datasets, splitting data (Scikit-learn essentials)

Overview of Mathematical Foundations

  1. Linear Algebra (Importance of LA in ML)
  2. Probability & Statistics (Importance of Probability & Statistics in ML)
  3. Calculus (Importance of Calculus in ML)

2. Supervised Learning - Regression

Data Preprocessing and Exploration

  1. Handling missing values (Reading from geeks-for-geeks]
  2. Feature scaling - standardization, normalization - (Reading from geeks-for-geeks)
  3. One-hot encoding for categorical features (Reading from geeks-for-geeks)
  4. Exploratory Data Analysis EDA (Reading from geeks-for-geeks)

Linear Regression

  1. Simple Linear Regression (Video: Mathematical intuition)
  2. Cost function (Mean Squared Error - MSE)
  3. Gradient Descent algorithm (Video: Mathematical intuition)
  4. Multiple Linear Regression (Reading from Geeks-for-geeks)
  5. Assumptions of Linear Regression (Reading from Geeks-for-geeks)
  6. Implementation (Coding step-by-step)
  7. Lab Assignment - 1 (Lab Activity)

Model Evaluation for Regression

  1. R^2, Adjusted R^2 (Videos: Intuition behind R^2, Intuition behind Adjusted R^2)
  2. MAE, MSE, RMSE
  3. Overfitting and Underfitting (Intuition)
  4. Bias-Variance Tradeoff (Intuition behind)
  5. Multi-colinearity (Reading from Geeks-for-geeks)
  6. Cross-validation (k-fold, leave-one-out) (Intuition)

Regularization

  1. Ridge Regression (L2 regularization) (Intuition, Reading)
  2. Lasso Regression (L1 regularization) (Intuition, Reading)
  3. Elastic Net (Intuition)
  4. Lab Assignment - 2 (Lab Activity)

3. Supervised Learning - Classification

Introduction to Classification

  1. Regression vs. Classification (Reading)
  2. False Positives (Type I error) vs. False Negatives (Type II error) (Reading)
  3. Classification metrics (Accuracy, Precision, Recall, F1-score, Confusion Matrix) (Reading)
  4. ROC Curve and AUC (Reading) (Class Notes)
  5. Binary vs. Multi-class classification

Logistic Regression

  1. Why not linear regression for classification? (Reading)
  2. Sigmoid function
  3. Cost function (Binary Cross-Entropy)
  4. Class notes
  5. Decision boundary
  6. Implementation (Coding Logistic Regression)
  7. Lab Assignment - 3 (Lab Activity)

K-Nearest Neighbors (KNN)

  1. Distance metrics
  2. Choosing 'k'
  3. Reference (Reading)

Naive Bayes

  1. Bayes' Theorem
  2. Naive Bayes classifier (Reading)
  3. Feature independence
  4. Discrete vs. continuous features
  5. Lab Assignment - 4 (Lab Activity)

Support Vector Machines (SVM)

  1. Linear SVM (maximal margin hyperplane)
  2. Class notes
  3. Kernels (polynomial, RBF) for non-linear separation
  4. Mathematical Derivation (Readings: Part 1, Part 2, Part 3)
  5. Lab Assignment - 5 (Lab Activity)

Decision Trees

  1. Entropy, Gini impurity
  2. Information Gain
  3. Pruning
  4. Lab Assignment - 6 (Lab Activity)

Ensemble Methods

  1. Bagging: Random Forest
  2. Boosting: AdaBoost (Video)

4. Unsupervised Learning

Clustering

  1. K-Means Clustering: Elbow method, silhouette score
  2. Hierarchical Clustering: Dendrograms
  3. DBSCAN (briefly).
  4. Lab Assignment -7 (Lab Activity)

Dimensionality Reduction

  1. Principal Component Analysis (PCA): Intuition, eigen decomposition (briefly), applications
  2. PCA computation (Class Notes)

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors