# Machine Learning Notes Hub > [!Note] > Hub consolidating notes on **Machine Learning** — supervised, unsupervised, > reinforcement, plus the foundations and evaluation infrastructure that make > them rigorous. References: Bishop (PRML), Hastie/Tibshirani/Friedman (ESL), > Murphy (PML). ## 1. Foundations - [[Machine Learning]] - [[Supervised Learning]] · [[Unsupervised Learning]] · [[Reinforcement Learning]] · [[Self-Supervised Learning]] - [[Hypothesis Space]] - [[No Free Lunch Theorem]] - [[Bias-Variance Tradeoff]] - [[Overfitting and Underfitting]] - [[Generalization]] - [[Curse of Dimensionality]] - [[Inductive Bias]] --- ## 2. Evaluation - [[Train-Validation-Test Split]] - [[Cross-Validation]] - [[K-Fold Cross-Validation]] - [[Confusion Matrix]] - [[Precision and Recall]] - [[F1 Score]] - [[ROC Curve and AUC]] - [[MSE MAE RMSE]] - [[R-Squared Coefficient]] --- ## 3. Feature Engineering and Dimensionality Reduction - [[Feature Engineering]] - [[Feature Scaling]] - [[Feature Selection]] - [[One-Hot Encoding]] - [[Dimensionality Reduction]] - [[Principal Component Analysis]] - [[t-SNE]] - [[UMAP]] --- ## 4. Regularization and Optimization - [[Regularization]] - [[L1 Regularization]] · [[L2 Regularization]] · [[Elastic Net]] - [[Loss Functions]] - [[Gradient Descent]] · [[Stochastic Gradient Descent]] --- ## 5. Supervised — Regression - [[Linear Regression]] - [[Polynomial Regression]] - [[Ridge Regression]] - [[Lasso Regression]] - [[Decision Trees for Regression]] - [[Support Vector Regression]] --- ## 6. Supervised — Classification - [[Logistic Regression]] - [[kNN]] - [[Naive Bayes]] - [[Decision Trees]] - [[Support Vector Machine]] - [[Kernel Trick]] --- ## 7. Ensemble Methods - [[Bagging]] · [[Boosting]] - [[Random Forest]] - [[AdaBoost]] - [[Gradient Boosting Machines]] - [[XGBoost]] - [[Stacking]] --- ## 8. Unsupervised - [[K-Means Clustering]] - [[Hierarchical Clustering]] - [[DBSCAN]] - [[Gaussian Mixture Model]] - [[Expectation-Maximization]] - [[Apriori Algorithm]] --- ## 9. Reinforcement Learning - [[Markov Decision Process]] - [[Value Iteration]] - [[Policy Iteration]] - [[Q-Learning]] - [[SARSA]] - [[Policy Gradient]] - [[Actor-Critic]] - [[Multi-Armed Bandit]] - [[Exploration vs Exploitation]]