Storage and Streaming
Storage formats, streaming, object stores, relational databases.
Categories
Every note belongs to a category. Pick one to see its full list of chapters in the order they were written — or pick across every note at once →.
Storage formats, streaming, object stores, relational databases.
Linear algebra, probability, statistics, calculus, information theory, and optimization — the math the rest of the site leans on.
sklearn, boosting, clustering, feature engineering, model evaluation, A/B testing, interpretability, fairness.
PyTorch, MLP/CNN/RNN, model compression, distillation, RL, generative models.
Data preparation, forecasting models, deep learning, foundation models, evaluation, maintenance.
Transformer architecture, the generation loop, prompt engineering, structured outputs, agent patterns.
Embeddings, vector databases, sparse and hybrid retrieval, chunking, reranking, and the search lineage from BoW to E5.
Endogeneity, IV, RDD, panel data, causal ML.
How models actually run on hardware: GPUs, memory bandwidth and the roofline, kernels, LLM inference and serving, multi-GPU parallelism, capacity planning.