Guardrails, SRM & multivariate

These controls are not available in the current production A/B Tests UI.

Guardrails

There is no workspace or per-test guardrail editor, threshold, state, override, or automatic-promotion block. Evaluate secondary business metrics outside the test workflow before promoting a video when they matter to the decision.

Sample-ratio mismatch

The current UI does not calculate or display an SRM warning, expected-versus-actual diagnostic, or Diagnose action. It does show configured traffic share and observed sessions for each variant; investigate unexpected allocation externally rather than relying on an in-product SRM decision.

Multivariate testing

The builder compares 2–9 complete videos. It does not create component combinations, a cell matrix, or interaction analysis. To compare several complete versions, add those videos as ordinary variants while keeping exactly one control and a 100% traffic total.

Related docs

• A/B testing overview
• Auto-Pilot
• Statistics & methods
• A/B test types
• Revenue attribution

Frequently asked questions

Can I configure a guardrail in the current UI?+

No. There is no current guardrail editor, threshold, override, or promotion block.

Does AtomicPlayer currently show SRM warnings?+

No. The production A/B Tests surface does not expose SRM warnings or diagnostics.

Can I create a multivariate cell matrix?+

No. Current tests compare 2–9 complete-video variants against one goal.