Many thanks to Gregory Gundersen for the blog theme.
A Few Different Adaptive Metropolis Schemes
10 June 2024
Adaptively updating a Gaussian proposal covariance for Random Walk Metropolis-Hastings samplers.
130 May 2024
An introduction to dimensionality reduction via active subspaces.
2A fairly deep dive into Gaussian measures in finitely many dimensions. The next step in building up to the infinite-dimensional case.
3Gaussian Measures, Part 1 - The Univariate Case
16 May 2024
A brief introduction to Gaussian measures in one dimension, serving to provide the setup for an extension to multiple, and eventually infinite, dimensions.
4An Introduction to Scattered Data Approximation
24 March 2024
I summarize the first chapter of Holger Wendland's book "Scattered Data Approximation", which I augment with some background on polynomial interpolation and splines.
5Generalizing the Outer Product to Hilbert Space
18 March 2024
I briefly discuss how the outer product, familiar in Euclidean space, can be viewed as a linear operator which can readily be generalized to Hilbert space.
6Approximating Nonlinear Functions of Gaussians, Part I - Linearized Kalman Filter Extensions
15 February 2024
I discuss the generic problem of approximating the distribution resulting from a non-linear transformation of a Gaussian random variable, and then show how this leads to extensions of the Kalman filter which yield approximate filtering algorithms in the non-linear setting.
7The Kalman Filter - A Few Different Perspectives
15 February 2024
I discuss the Kalman filter from both the Bayesian and optimization perspectives.
8An Introduction to Bayesian Filtering and Smoothing
29 January 2024
I provide an overview of the general framework for statistical filtering, viewed from the Bayesian perspective.
9The Measure-Theoretic Context of Bayes' Rule
28 January 2024
I describe Bayes' rule in a measure-theoretic context, explain how it can be viewed as a non-linear operator on probability measures, and detail applications to Bayesian inverse problems.
10Deriving the Metropolis-Hastings Update from the Transition Kernel
31 December 2023
Given only the Metropolis-Hastings transition kernel, I show how to recover the Metropolis-Hastings update rule.
1115 December 2023
I derive the PCA decomposition from both a minimum reconstruction error and maximum variance perspective. I also discuss a statistical interpretation of PCA.
12