Model Serving

Back: MLOps

Deploying models to serve predictions in production. Different serving patterns and frameworks for different latency, throughput, and cost requirements.

Concepts

• Batch Inference
• Real-Time Inference
• Serving Frameworks
• Model Optimization
• Edge Deployment

---

mlops model-serving deployment