ML System Design Patterns
Back: ML System Design
Common architectural patterns for building ML systems in production. Each pattern makes different tradeoffs between freshness, latency, cost, and complexity.
Concepts
- Batch Prediction Pattern
- Real-Time Prediction Pattern
- Online Learning
- Embedding-Based Retrieval
- Two-Tower Model
- Feature Pipeline Pattern
- Human-in-the-Loop