Skip to content
DriftCaught

Monthly plan

Up to three features

Up to three features is $4,400 a month. Everything in One feature, for three features, plus span-level evals where a feature calls tools, plus a call every two weeks.

$4,400per month, after the baselines

A product team with several AI features and no way to compare them objectively.

Start Up to three featuresRead the method first

What counts as a feature

A feature is one AI capability with its own prompt or pipeline and its own golden dataset. Two prompts behind one button are one feature. One prompt serving two products is one feature. A chat assistant and the summariser next to it are two.

This plan covers 3 features.

Scope and limits

Scope and limits
Features covered3
Golden dataset items1,500 across the three
Scheduled runs a month12
Production sample a month5,000 requests
Flagged change turnaround2 business days
CallEvery two weeks

What triggers a rerun

  • A tracked provider announces an update
  • You flag a prompt change
  • You flag a retrieval or index change
  • The weekly scheduled run

Turnaround for a change you flag: 2 business days for a flagged change. A provider update reruns within 2 business days of the announcement, on every plan.

EV-RERUN, the rerun procedure in full

What you receive

  • Everything in One feature, for three features
  • Agent span-level evals where applicable
  • Biweekly call

Not included

  • CI gate integration
  • Same-day reruns

Protocols this plan runs

Each protocol is published in full, with citations and a version. Nothing in the service happens by a method that is not on this site.

Getting started

  1. 01

    Access

    You give us sample inputs and outputs, the prompt or pipeline, and a way to run it. A staging key and an export of logged requests is usually enough.
  2. 02

    Dataset

    We pull your real failures out of those logs, label them with your domain expert, and version the set. This is the part nobody else wants to own.
  3. 03

    Scorers and judge

    We pick the scorers that fit your feature type, calibrate the judge against the human verdicts, and report the agreement so you know what the score is worth.
  4. 04

    Thresholds and handover

    You agree the thresholds that gate a release. From then on every trigger reruns the suite and you get a written verdict.

What we guarantee

  1. First eval baseline within 10 business days of access.
  2. Every tracked provider update triggers a rerun within 2 business days of the provider's announcement.
  3. Every flagged prompt or retrieval change is evaluated before it ships, within the plan's turnaround.
  4. Monthly drift report by the 5th business day.
  5. Judge recalibrated against human verdicts at least monthly.
  6. If a regression above the agreed threshold reaches production on a change we marked as passed, the next month is free.

These six are the whole list. Nothing else on this site is a guarantee.

What we cannot do

We cannot make a model deterministic or guarantee its outputs. We measure against an agreed dataset and thresholds and report what changed. We do not train or fine-tune models, and we do not replace human review for policy or legal decisions. Coverage is bounded by the dataset and the plan.

The longer version, with the reasoning

Exit terms

Monthly. Cancel with 30 days' notice. No setup fee beyond the baseline. The baseline fee is credited to the first month of any plan started within 60 days.

Questions about Up to three features

Is the dataset limit per feature or shared?
Shared: 1,500 items across the three features. Most teams split it unevenly, because one feature usually carries more risk than the other two.
What do we do on the biweekly call?
Look at what moved, decide whether a threshold is wrong or the feature is, and agree what gets added to the dataset. It is a working call, not a status update.
Can we swap which three features are covered?
Yes, with a month's notice, and a new feature needs its own baseline first.
What counts as one feature?
A feature is one AI capability with its own prompt or pipeline and its own golden dataset. Two prompts behind one button are one feature. One prompt serving two products is one feature. A chat assistant and the summariser next to it are two.
Can I cancel?
Monthly. Cancel with 30 days' notice. No setup fee beyond the baseline. The baseline fee is credited to the first month of any plan started within 60 days.
Do you publish our results?
No. Your dataset, your scores and your reports are yours. The only thing this site publishes is the model change log, built from provider announcements, and the methodology. We publish no measurement of any model as our own.

Ready? The link opens an email with the four things we need to quote the work: feature type, provider and model, monthly volume, and whatever eval setup you have now. Start Up to three features.

Other plans