Foundation Models
3 pages
-
AI Engineering
concept
AI engineering as a discipline vs ML engineering; three-layer stack (application dev, model dev, infrastructure); product planning; last-mile challenge; use case taxonomy
-
AI Engineering
source
*AI Engineering* — Chip Huyen
-
Foundation Models
concept
What foundation models are; transformer architecture (prefill/decode, KV cache, MoE); training data constraints; Chinchilla scaling law; post-training (SFT, RLHF, DPO)