Skip to content
DriftCaught

Monthly plan

Up to eight features

Up to eight features is $9,800 a month. Everything in Up to three features, for eight, plus a gate in your CI pipeline, a weekly call, and flagged changes evaluated within 1 business day.

$9,800per month, after the baselines

An AI platform team that other teams ship through, with a CI pipeline to gate.

Start Up to eight featuresRead the method first

What counts as a feature

A feature is one AI capability with its own prompt or pipeline and its own golden dataset. Two prompts behind one button are one feature. One prompt serving two products is one feature. A chat assistant and the summariser next to it are two.

This plan covers 8 features.

Scope and limits

Scope and limits
Features covered8
Golden dataset items5,000 across the eight
Scheduled runs a month40
Production sample a month20,000 requests
Flagged change turnaround1 business day
CallWeekly

What triggers a rerun

  • A tracked provider announces an update
  • You flag a prompt change
  • You flag a retrieval or index change
  • The weekly scheduled run
  • A pull request hits the CI gate

Turnaround for a change you flag: 1 business day for a flagged change. A provider update reruns within 2 business days of the announcement, on every plan.

EV-RERUN, the rerun procedure in full

What you receive

  • Everything in Up to three features, for eight
  • CI gate integration in your pipeline
  • Weekly call
  • Priority reruns

Not included

  • Model training or fine-tuning
  • Human review of individual outputs beyond calibration samples

Protocols this plan runs

Each protocol is published in full, with citations and a version. Nothing in the service happens by a method that is not on this site.

Getting started

  1. 01

    Access

    You give us sample inputs and outputs, the prompt or pipeline, and a way to run it. A staging key and an export of logged requests is usually enough.
  2. 02

    Dataset

    We pull your real failures out of those logs, label them with your domain expert, and version the set. This is the part nobody else wants to own.
  3. 03

    Scorers and judge

    We pick the scorers that fit your feature type, calibrate the judge against the human verdicts, and report the agreement so you know what the score is worth.
  4. 04

    Thresholds and handover

    You agree the thresholds that gate a release. From then on every trigger reruns the suite and you get a written verdict.

What we guarantee

  1. First eval baseline within 10 business days of access.
  2. Every tracked provider update triggers a rerun within 2 business days of the provider's announcement.
  3. Every flagged prompt or retrieval change is evaluated before it ships, within the plan's turnaround.
  4. Monthly drift report by the 5th business day.
  5. Judge recalibrated against human verdicts at least monthly.
  6. If a regression above the agreed threshold reaches production on a change we marked as passed, the next month is free.

These six are the whole list. Nothing else on this site is a guarantee.

What we cannot do

We cannot make a model deterministic or guarantee its outputs. We measure against an agreed dataset and thresholds and report what changed. We do not train or fine-tune models, and we do not replace human review for policy or legal decisions. Coverage is bounded by the dataset and the plan.

The longer version, with the reasoning

Exit terms

Monthly. Cancel with 30 days' notice. No setup fee beyond the baseline. The baseline fee is credited to the first month of any plan started within 60 days.

Questions about Up to eight features

How does the CI gate work?
The suite runs on a pull request that touches a prompt, a retrieval step or a model id, and reports pass or fail against your agreed thresholds. It runs in your pipeline, in your tooling, with your secrets.
What does priority mean?
A flagged change is evaluated within 1 business day instead of 2. It does not mean a different method.
Eight features sounds like a lot to keep calibrated.
It is, which is why the judge recalibration runs monthly across all eight and the report separates the features that moved from the ones that did not. Coverage is bounded by the dataset and the plan, and the report says which items each feature's dataset does not cover.
What counts as one feature?
A feature is one AI capability with its own prompt or pipeline and its own golden dataset. Two prompts behind one button are one feature. One prompt serving two products is one feature. A chat assistant and the summariser next to it are two.
Can I cancel?
Monthly. Cancel with 30 days' notice. No setup fee beyond the baseline. The baseline fee is credited to the first month of any plan started within 60 days.
Do you publish our results?
No. Your dataset, your scores and your reports are yours. The only thing this site publishes is the model change log, built from provider announcements, and the methodology. We publish no measurement of any model as our own.

Ready? The link opens an email with the four things we need to quote the work: feature type, provider and model, monthly volume, and whatever eval setup you have now. Start Up to eight features.

Other plans