Quality/Releases
Release & Regression Monitoring
Track prompt, model, ASR/TTS, workflow, tool, KB, telephony and platform changes. Before/after comparison with statistical confidence — rollback is recommend-only.
Agent prompt changedLLM model changedLLM parameters changedASR provider changedTTS provider changedVoice changedWorkflow changedTool changedKnowledge base changedTelephony route changedVoice-agent platform changedApplication version released
Metric chart with deployment annotations
Vertical markers = production changes
Deployments
LLM parameters + tool retries changed
dep_support_0803 · production
Type
LLM parameters changed
Agent
Support Concierge
When
8/3/2026, 9:10:00 AM
Author
Priya N.
Before
retries=1 · temp=0.2
After
retries=3 · temp=0.4
Before vs after · control/treatment style metrics
| Metric | Delta | Relative | Confidence | n | Severity | Customer impact |
|---|---|---|---|---|---|---|
| Task success | -8.0pp | -8.7% | p<0.01 | 2400 | critical | High customer impact |
| P95 latency | +710ms | +41% | p<0.01 | 2400 | high | CX friction |
| Tool error rate | +5.6pp | +700% | p<0.01 | 800 | critical | Failed address changes |
Automated rollback recommendations never execute without explicit authorization and integration permissions.