Guides ยท Technology
ML Batch vs Stream Serving
Pick serving mode for ML
Serving ML can be batch (precompute and cache) or stream/online (real-time inference); decide based on freshness, latency, cost, and consistency, often combining both with fallbacks.
- ml serving
- batch
- stream
- latency
- freshness
Decide Mode
Use batch for low-latency lookups; online for real-time contexts.
Mix
Hybrid: cache batch, fall back to online when needed.
Operate
Monitor freshness/latency; plan retraining and invalidation.
Keep Exploring
Guides
API Basics
APIs let software request data or actions from other systems through defined endpoints and responses.
Comparison
RAM vs Storage
RAM handles what your device is actively working on, while storage keeps apps, files, and system data available over time.
How it works
Global Positioning System
GPS uses timing signals from satellites to calculate a receiver's position on Earth.
What it is
Blockchain
A blockchain is a distributed ledger secured by cryptography and consensus nodes.