Skip to main content

Auto-Pilot

The implemented automatic workflow is Auto-promote winner, a per-test, time-based setting. There is no workspace-wide Auto-Pilot configuration surface.

Enable automatic promotion​

In the Promotion step of New test:

  1. Turn on Automatically promote the winning variant.
  2. Enter a delay from 1 to 336 hours.
  3. Continue to Review & save and save the draft.
  4. Place the test embed and launch the draft when ready.

The test detail shows whether auto-promotion is on and the configured delay. A draft can toggle the setting. When the elapsed time is reached, the current goal-rate leader is promoted.

What is not implemented​

Current production does not provide:

  • A workspace Auto-Pilot on/off strip or settings sheet
  • Confidence-threshold or minimum-sample controls
  • Bayesian/Frequentist or sequential-testing settings
  • Adaptive traffic rebalancing
  • Guardrail enforcement or override
  • A promotion undo window
  • Linked clone-winner rollout or tag enrollment
  • Test recipes

Traffic percentages can be edited manually on a live test. This is a direct allocation change and does not reset recorded statistics.

Manual alternative​

Leave auto-promotion off to choose a video yourself from Review & promote. The suggestion is a recommendation based on observed results; you can select any variant.

Best practices​

  • Choose a delay that gives the test time to collect useful observations.
  • Review the selected goal and test traffic before enabling automatic promotion.
  • Use manual promotion when the decision needs business context beyond the reported goal rate.

Frequently asked questions​

What triggers automatic promotion?

After the configured 1–336 hour delay, the current goal-rate leader is promoted. The current UI does not expose a confidence or minimum-sample gate.

Does it rebalance traffic while the test runs?

No. Automatic adaptive allocation is not implemented. An operator can edit live traffic percentages manually.

Can I undo an automatic promotion?

The current test surface does not provide a documented promotion undo window.