3
AC
Platform/Data Quality

Data-Quality Controls

Every metric has definition, formula, owner and freshness. Missing data is never silently treated as zero.

Principle: never silently treat missing data as zero. Show quality scores on integrations and calls.

Issue classes open

10

Catalog metrics

4

Integrations scored

5

Detected issues (24h)

TypeCountSeverity
Duplicate calls3medium
Missing timestamps12high
Invalid event order2medium
Incomplete transcripts28high
Recording mismatch1critical
Clock skew7medium
Missing provider IDs4high
Impossible durations0low
Outlier values19low
Schema changes1medium
Partial traces41medium

Integration data-quality score

Retell AI96 · 2 issues
Vapi94 · 3 issues
Twilio91 · 5 issues
LiveKit93 · 4 issues
Generic OTel88 · 9 issues

Metric catalog

Definition · formula · unit · source · owner · version · freshness · limitations

MetricFormulaUnitOwnerVerFreshnessLimitations

Task success rate

Share of completed calls with successful business outcome

successful_calls / completed_calls%Quality1.31mDepends on outcome mapping; missing outcomes excluded (not zero)

P95 end-to-end latency

95th percentile user-perceived turn latency

percentile(turn.e2e_ms, 0.95)msPlatform2.030sClock skew can inflate values

Containment rate

Calls resolved without human transfer

1 - transferred_calls / completed_calls%Ops1.11mWarm transfers may be misclassified if provider omits events

Tool error rate

Tool spans ending in error or timeout

tool_error_spans / tool_spans%Engineering1.030sPartial traces under-count tools