Probability & Statistics

Random variables, distributions, Bayes theorem, information theory, and estimation

1.

Probability Theory

Axioms, random variables, distributions, expectations, covariance, and change of variables

2.

Probability Basics WIP

Fundamental concepts of probability theory

3.

Probability Note 2 WIP

Probability theory continued — joint distributions, expectations, and transformations

4.

MLE & MAP Estimation WIP

Maximum Likelihood Estimation and Maximum A Posteriori estimation

5.

Bayesian Inference WIP

Bayesian approach to statistical inference

6.

Information Theory

Entropy, Information Gain, Gini Impurity, Cross-Entropy, KL-Divergence