Skip to content
DriftCaught

Monthly plan

One feature

One feature is $1,900 a month. We rerun your suite on every tracked provider update, on every prompt or retrieval change you flag, and weekly, sample production, and send a drift report by the 5th business day.

$1,900per month, after the baseline

A team with one AI feature in production that a provider update can change.

Start One featureRead the method first

What counts as a feature

A feature is one AI capability with its own prompt or pipeline and its own golden dataset. Two prompts behind one button are one feature. One prompt serving two products is one feature. A chat assistant and the summariser next to it are two.

This plan covers 1 feature.

Scope and limits

Scope and limits
Features covered1
Golden dataset items500
Scheduled runs a month4
Production sample a month1,000 requests
Flagged change turnaround2 business days
Judge recalibrationMonthly

What triggers a rerun

  • A tracked provider announces an update
  • You flag a prompt change
  • You flag a retrieval or index change
  • The weekly scheduled run

Turnaround for a change you flag: 2 business days for a flagged change. A provider update reruns within 2 business days of the announcement, on every plan.

EV-RERUN, the rerun procedure in full

What you receive

  • Reruns on every trigger with a written verdict
  • Production sampling and online scoring
  • Monthly drift report
  • Async channel

Not included

  • Agent span-level evals
  • CI gate integration
  • Same-day reruns

Protocols this plan runs

Each protocol is published in full, with citations and a version. Nothing in the service happens by a method that is not on this site.

Getting started

  1. 01

    Access

    You give us sample inputs and outputs, the prompt or pipeline, and a way to run it. A staging key and an export of logged requests is usually enough.
  2. 02

    Dataset

    We pull your real failures out of those logs, label them with your domain expert, and version the set. This is the part nobody else wants to own.
  3. 03

    Scorers and judge

    We pick the scorers that fit your feature type, calibrate the judge against the human verdicts, and report the agreement so you know what the score is worth.
  4. 04

    Thresholds and handover

    You agree the thresholds that gate a release. From then on every trigger reruns the suite and you get a written verdict.

What we guarantee

  1. First eval baseline within 10 business days of access.
  2. Every tracked provider update triggers a rerun within 2 business days of the provider's announcement.
  3. Every flagged prompt or retrieval change is evaluated before it ships, within the plan's turnaround.
  4. Monthly drift report by the 5th business day.
  5. Judge recalibrated against human verdicts at least monthly.
  6. If a regression above the agreed threshold reaches production on a change we marked as passed, the next month is free.

These six are the whole list. Nothing else on this site is a guarantee.

What we cannot do

We cannot make a model deterministic or guarantee its outputs. We measure against an agreed dataset and thresholds and report what changed. We do not train or fine-tune models, and we do not replace human review for policy or legal decisions. Coverage is bounded by the dataset and the plan.

The longer version, with the reasoning

Exit terms

Monthly. Cancel with 30 days' notice. No setup fee beyond the baseline. The baseline fee is credited to the first month of any plan started within 60 days.

Questions about One feature

How fast is a rerun after a provider announcement?
Within 2 business days of the provider publishing it. The change goes into the public change log with the provider's source on the same day we see it.
What if my feature calls tools?
Span-level evaluation for tool-using features starts on Up to three features. On One feature we score the end-to-end output, which catches a worse answer but not which step caused it.
What is the production sample for?
1,000 real requests a month are scored online, so the report compares what your users actually sent against the dataset the suite was built on. That is how the dataset stays honest.
What counts as one feature?
A feature is one AI capability with its own prompt or pipeline and its own golden dataset. Two prompts behind one button are one feature. One prompt serving two products is one feature. A chat assistant and the summariser next to it are two.
Can I cancel?
Monthly. Cancel with 30 days' notice. No setup fee beyond the baseline. The baseline fee is credited to the first month of any plan started within 60 days.
Do you publish our results?
No. Your dataset, your scores and your reports are yours. The only thing this site publishes is the model change log, built from provider announcements, and the methodology. We publish no measurement of any model as our own.

Ready? The link opens an email with the four things we need to quote the work: feature type, provider and model, monthly volume, and whatever eval setup you have now. Start One feature.

Other plans