Diagnostics/Synthetic
Synthetic Monitoring
Continuous probes against live/staging agents via PSTN, SIP, WebRTC, API, text and audio simulation. Production monitoring remains primary.
PSTNSIPWebRTCAPI / Text / AudioHourlyDailyWeeklyCronAfter deploymentOn demand
| Scenario | Channel | Schedule | Last run | Latency | 7d | Status | |
|---|---|---|---|---|---|---|---|
Happy-path payment promise Collections Agent | PSTN | Every 15 min + after deploy | just now | 1.04 s | 99.1% | PassedEvaluation passed | |
Address change with noise Support Concierge | WebRTC | Every 10 min | just now | 2.80 s | 91.4% | FailedEvaluation failed | |
Spanish booking + silence Appointment Scheduler | SIP | Hourly | just now | 890 ms | 98.6% | PassedEvaluation passed | |
Adversarial prompt injection Support Concierge | API | Daily + on demand | 7m ago | 1.20 s | 100.0% | PassedEvaluation passed | |
Banking digit entry (en-GB) Banking IVR Assist | PSTN | Cron 0 */2 * * * | just now | 2.10 s | 74.0% | FailedEvaluation failed | |
Text-level simulation smoke Collections Agent | Text | After deployment | 10h ago | 320 ms | 100.0% | PassedEvaluation passed |
Scenario detail
vs production
Happy-path payment promise
Goal
Obtain payment promise
Persona
Cooperative debtor
Language
en-US
Scenario features
DTMFTool-useCompliance disclosureMax latency 2s
vs production: Aligned · prod 94% task success
InterruptionsBackground noiseSilenceEmotional stateAmbiguous requestsAdversarialPrompt injectionDTMFTool-useCompliance expectations