SageMaker inference: real-time vs serverless vs async vs batch
| Requirement / use case | Choose |
|---|---|
| A news site's article-recommendation model receives steady traffic all day and must respond in milliseconds. | Real-time inference |
| A nonprofit's donation-risk model is called only a few times a week, and brief cold-start delays are acceptable. | Serverless Inference |
| A media company submits very large video files that each take many minutes to analyze; requests should be queued. | Asynchronous Inference |
| A bank scores its entire customer table once a month and does not need any endpoint afterward. | Batch Transform |
- Start with latency, request shape, traffic pattern and whether a persistent endpoint is needed.