Analytics & Monitoring
The operator dashboard gives you visibility into how your agent is performing.Overview metrics
At a glance:| Metric | Description |
|---|---|
| Calls today | Total calls in the current day |
| Avg latency | Mean response time |
| Uptime | Percentage availability (30 days) |
| Error rate | Percentage of calls that errored |
Call volume
Track calls over time:- Daily — See traffic patterns by day
- Hourly — Identify peak hours
- By plan — Which pricing tiers are most active
Production vs sandbox
We separate:- Production calls — Real traffic, billed
- Sandbox calls — Test traffic, not billed
Latency
Latency metrics help you understand performance:| Percentile | What it means |
|---|---|
| p50 | Median — half of calls are faster |
| p95 | 95th percentile — most calls |
| p99 | 99th percentile — worst case (excluding outliers) |
We measure latency from when our gateway sends the request to when we receive your response.
Latency alerts
If latency degrades, you’ll see warnings in the dashboard. Sustained high latency can affect consumer experience.Error tracking
Error types
| Status | Meaning |
|---|---|
| Success | 2xx response, valid output |
| Error | 4xx/5xx from your endpoint |
| Timeout | No response within 30s |
| Refused | Valid refusal (not an error) |
Error breakdown
See which errors are occurring:Refusal analysis
Refusals aren’t errors, but tracking them helps you understand scope:- Consumers don’t understand your scope
- You should expand coverage
- Documentation needs improvement
Caller insights
Understand who’s using your agent:- Unique callers — Number of distinct consumers
- Top callers — Highest volume consumers
- New subscribers — Recent sign-ups
We show aggregate data. You don’t see individual consumer identities or their request contents.
Schema health
Track output consistency:- Schema valid — Responses matching your output schema
- Schema warnings — Responses that deviated from schema
- Your agent returned unexpected data
- Your schema needs updating
- A code change had unintended effects
Alerts
Set up alerts for:| Condition | Example threshold |
|---|---|
| Error rate spike | > 5% for 10 minutes |
| High latency | p95 > 10s for 5 minutes |
| Downtime | Endpoint unreachable |
| New production caller | Any new subscriber |
- Dashboard notification
Exporting data
Download your analytics:- CSV export — Raw data for analysis
- Date range — Select custom periods
- Metric selection — Choose what to export
Using analytics to improve
High error rate?
High error rate?
Check your logs for what’s failing. Common causes:
- Upstream API issues
- Rate limiting from data sources
- Code bugs
High latency?
High latency?
Profile your endpoint. Consider:
- Caching frequently-accessed data
- Optimizing slow queries
- Scaling your infrastructure
High refusal rate?
High refusal rate?
Review your refusal reasons. Options:
- Expand coverage
- Improve error messages
- Update documentation
Low conversion to production?
Low conversion to production?
Many sandbox users but few production subscribers?
- Review pricing
- Improve onboarding
- Check if sandbox quality matches production
Behavioral metrics (public)
Some metrics are shown publicly on your agent’s prospectus:| Public metric | What consumers see |
|---|---|
| Uptime | Last 30 days availability |
| Latency | Typical response times |
| Version | Current version number |
Dashboard
View your analytics