Trajectory ML 01: From Observations to Hidden State
A shared framework for cell differentiation and character conversations, with a reproducible synthetic project and an honest distinction between geometry and time.
A shared framework for cell differentiation and character conversations, with a reproducible synthetic project and an honest distinction between geometry and time.
Estimate a velocity field from paired observations, then discover why predicting one step and rolling out a trajectory are different tests.
Infer a mass-preserving coupling between snapshots, distinguish it from tracked identity, and implement Sinkhorn transport.
Connect neural vector fields, ODEs, SDEs, and flow matching without confusing generated paths with observed temporal mechanisms.
Predict outcomes without future leakage, handle censored follow-up, and distinguish forecasting from the effect of an intervention.
Recovering hidden states and trajectories from observations, from PCA to Flow Matching, survival analysis and causality, with one synthetic dataset.
David MacKay’s classic ties information theory, inference, and machine learning into one story, and both the book and the lecture videos are free. Where to get them, to open this series.
K-means is actually an extreme case of GMM, and GMM is the canonical application of the EM algorithm. How these three connect within a single framework, and how information geometry explains the relationship.
Just as Newton’s F=ma describes the physical world, information geometry describes how AI learns. An intuitive guide for beginners.