Machine Learning Notes by Ikram Ali

Greetings! I am Ikram Ali, technical Leader with 10+ years of experience architecting large-scale distributed systems and driving industry-wide impact. My background in applied ML, distributed systems engineering, and MLOps tooling has empowered me to build and mentor dynamic teams of Data Scientists, ML Engineers, and MLOps experts. I thrive on end-to-end challenges from designing robust data pipelines and optimizing model serving to fine-tuning, evaluation, and implementing strong governance frameworks.

• https://www.linkedin.com/in/akkefa/

• https://www.github.com/akkefa

I would like to offer concise definitions and comprehensible explanations of Machine Learning and Deep Learning.

Contents

• ML Notation / Equations

Data Structures

• Hashmaps
• Tree
• Heap
• Graph

Algorithms

• Sorting Algorithms
• Shortest Path Algorithms
• Greedy Algorithms

Linear Algebra

• Introduction
• Linear Combinations
• Convex Combinations
• Linear Independence
• Linear System
• Matrices
• Solving Linear Systems
• Solution Set of a Linear System
• Geometric Interpretation of Inconsistent Linear Systems
• Rank
• Solution Set and Rank
• Elementary Matrices
• Inverse of a Square Matrix
• Determinant of a Matrix

Probability

• What is Probability
• Bayes Theorem
• Random Variables
• Discrete Distributions
• Continuous Distributions
• Joint Distributions
• Covariance and Correlation
• Estimators and Sampling Distributions
• Moments Generating Functions
• Maximum Likelihood Estimation
• Confidence Interval
• Hypothesis Testing

Calculus

• Introduction
• Derivatives and Partial Derivatives

Algebra

• Algebra Introduction

Machine Learning

• What is Machine Learning?
• Logistic Regression
• Non Parametric Models
• Decision Tree
• Principal Component Analysis (PCA)
• Clustering
• Matrix Factorization

Deep learning

• What is Deep Learning
• Vectors, Matrices, and Tensors
• Loss Functions
• How Neural Networks Work
• Neural Network Optimization
• Evaluation Metrics

Graph Theory

• What is Graphs Theory
• Graph Neural Networks
• Graph Equations

Learn Pytorch

• Pytorch Fundamental
• Pytorch Workflow
• PyTorch Neural Network Classification
• Basic Neural Network
• PyTorch Internals

Recommendation System

• Recommender
• Matrix Factorization

Large Language Models

• Large Language Models

Cheat Sheet

• Python List Cheat Sheet

Indices and tables

• Index

• Module Index

• Search Page