Benchmarks

Provider resolution benchmarks

Reproducible performance and reliability evidence for Orita's provider resolution engine across 20, 100 and 500 provider networks.

Benchmarks in progress

We are running the benchmark suite against the v2 release. Results will be published here with raw JSON files, methodology, and reproduction instructions. We do not publish engineering targets as measured results.

What will be published

Engine-only latency

Eligibility pipeline + ranking + DB, without external calendar calls. p50, p95, p99 by network size.

End-to-end latency

Full resolution including calendar verification. Measured separately from engine-only.

Concurrency

100 simultaneous confirmation requests on the same slot. Expected: exactly one booking.

Idempotency

100 retries with the same Idempotency-Key. Expected: same booking every time.

Calendar failure

Calendar returns 429, times out, or token is expired. Expected: provider marked unverifiable, not free.

Tenant isolation

Cross-tenant access attempts. Expected: zero cross-tenant data returned.

Network sizes

20

providers

100

providers

500

providers

Required reliability outcomes

Duplicate confirmed bookings from 100 competing requests0
Cross-tenant data accesses0
Same idempotency key → same booking100%
Losing confirmation requests409 Conflict
Calendar failure treated as freeNever
Webhook event ID stable across retriesAlways

Raw result files, reproduction instructions, and historical releases will be published at /benchmarks/provider-resolution.json when available.