Ingestion/Streaming
Streaming Ingestion
Real-time audio and event pipelines with backpressure, partitioning, deduplication and failure recovery.
WebSocketSecure WebSocketWebRTCSIPRECRTPKafkaEvent streamsProvider media APIs
Secure WebSocket events
wss
Events/sec
420
Lag
45ms
Partitions
—
Last event just now
Kafka voice.events
kafka
Events/sec
1800
Lag
120ms
Partitions
24
Last event just now
Provider media streams
provider_media
Events/sec
90
Lag
890ms
Partitions
—
Last event just now
SIPREC recorders
siprec
Events/sec
35
Lag
200ms
Partitions
—
Last event just now
High-volume design
Async processing: ingest path ACKs quickly; workers normalize and index offline.
Backpressure: degraded channels slow producers or spill to buffer.
Partitioning: by organization / call ID for ordered per-call processing.
Dedup: event ID + idempotency window across streams.
Failure recovery: checkpoint offsets; poison messages → DLQ.
Consent: media streams require recording/monitoring policy checks before storage.