The Two Pillars of LLM Inference: Prefill vs. Decode
Explore the two execution phases of LLM inference: compute-bound prefill vs. memory-bandwidth-bound decode. Understand arithmetic intensity and the role of the KV cache.
Read Post →Featured Projects
View All Projects →Latest Blog Posts
Read All Posts →Basics of AI Inference: Demystifying Latency, Throughput, and Serving
Start the AI Inference Deep-Dive Series. Learn the fundamentals of inference vs training, key performance metrics, and the systems engineering behind serving.
Read Post →The Model Taxonomy: LLMs, Vision Models, VLAs, and Diffusion
A developer's guide to the modern AI model taxonomy. Understand the architecture, modalities, and performance profiles of LLMs, ViTs, VLAs, and Diffusion.
Read Post →