Storage and Streaming
Storage formats, streaming, object stores, relational databases.
Categories
Every note belongs to a category. Pick one to see its full list of chapters in the order they were written — or pick across every note at once →.
Storage formats, streaming, object stores, relational databases.
Linear algebra, probability, statistics, calculus, information theory, and optimization — the math the rest of the site leans on.
sklearn, boosting, clustering, feature engineering, model evaluation, A/B testing, interpretability, fairness.
PyTorch, MLP/CNN/RNN, model compression, distillation, RL, generative models.
Data preparation, forecasting models, deep learning, foundation models, evaluation, maintenance.
Transformer architecture, the generation loop, prompt engineering, structured outputs, agent patterns.
Embeddings, similarity and nearest-neighbor search, ANN indexes and vector databases, sparse and hybrid retrieval, chunking, reranking, and the search lineage from BoW to modern embedding models.
Endogeneity, IV, RDD, panel data, causal ML.
How machine-learning algorithms actually run on hardware: GPUs, CUDA and C++, memory and parallelism, kernels, numerical computing, LLM inference and serving, distributed systems, and performance engineering.