Overview
Last check 2 minutes ago · next in 3 minutes
Models
Above thresholdDegradedFailing
| Model / kit | Score, last 24h | Now | Status |
|---|
Recent alerts
Alert rule
Alert when any kit scores below 75% for 2 consecutive checks. Resolve after 30 min above threshold.
Incidents
Every time a model fell below your threshold
| Started | Incident | Duration | Status |
|---|
Test kits
Ten standardized tasks per kit, easy to hard, harder tasks weighted more. Same kit runs on every model, every check.
Alert channels
Where we send you a message when a model degrades or recovers
Webhookhttps://api.acme.dev/hooks/model-alerts
ActiveEmailops@acme.dev
ActiveSlack#ai-ops · Acme workspace
ActivePagerDutyNot connected
OpsgenieNot connected
Billing
Every plan checks every 5 minutes across all kits. You pay only for how many models you watch.
Starter
€29 / month
- 5 models monitored
- Checks every 5 minutes
- All standard test kits
- Webhook, email, Slack
- 30 days of history
Team
€99 / month
- 25 models monitored
- Checks every 5 minutes
- Standard + custom test kits
- + PagerDuty, Opsgenie
- 1 year of history
Scale
€249 / month
- 50 models monitored
- Checks every 5 minutes
- Standard + custom test kits
- All channels + public status page
- Unlimited history, API access
Need more than 50 models or a self-hosted runner? Contact sales.