Glossary
Concepts and terminology
Control
The unchanged version in an Exploration. Serves as the baseline for all variant comparisons.
Bayesian probability
The statistical method used to calculate Chance to beat control. Asks 'how likely is this variant to be genuinely better?' rather than relying on p-values.
Chance to beat control (P(beat))
The Bayesian probability that a variant outperforms the control. Winning ≥ 95%, Losing ≤ 5%, Inconclusive between 5% and 95%.
Dimension Analysis
A breakdown of Exploration or Experiment results by user segment (e.g. region or device type).
Duration
How long an Exploration or Experiment has been running.
Experiment
A randomized controlled A/B test used to validate whether a specific product change genuinely outperforms the control.
Exploration
A multi-variant price discovery test that distributes traffic across a range of price points to identify patterns and opportunities.
Inconclusive
A variant with a Chance to beat control between 5% and 95%. More data is needed before a decision can be made.
Leading variant
The variant currently showing the best performance relative to the control.
Losing
A variant with ≤ 5% Chance to beat control.
Optimizations
The section in your Portal that contains Explorations and Experiments.
Primary metric
The key measure of success (typically GWP per order). Experiments are anchored to this metric.
Projected uplift
Estimated monthly business impact of shipping the winning variant, calculated from the variant's lift and current traffic volume. Directional guidance only.
Related Experiments
Experiments derived from an Exploration. Shown in the Exploration detailed view.
Sample
The number of unique users enrolled in an Experiment.
Scheduled
An Exploration or Experiment that is configured but has not yet started collecting data.
subject_id
The partner-supplied identifier in the XCover API request used to assign users consistently to experiment variants.
Traffic %
In Explorations, the share of enrolled users assigned to a given price variant.
Uplift range
The 95% Bayesian credible interval for the relative improvement or decline of a variant. A range that doesn't cross zero indicates a clear directional effect.
Variant
A modified version that is tested against the Control — a price adjustment, a different configuration, or an alternative feature or design. Explorations compare several variants for directional patterns; Experiments test them to identify a winner.
Winning
A variant with ≥ 95% Chance to beat control.
Metrics
Avg. protection price
The average price paid by the customer for a protection quote package.
Core order conversion
The percentage of visitors who successfully completed a primary order.
Gross Written Premium (GWP)
The total gross sales value of all protection products sold.
GWP % of order
The total value of protection products sold expressed as a percentage of total order value.
GWP per order
The average protection premium generated for each of your successful orders.
GWP per visit
The average protection product sales value generated for every unique visitor session (OfferId or QuotePackageId).
Premium vs. order ratio
The cost of protection expressed as a percentage of the item's price (e.g. 10% of the flight cost).
Protection attach rate
The percentage of successful partner orders that included protection.
Protection conversion
The percentage of protection quote packages or OfferIds that resulted in confirmed purchases.
Total bookings sold
The total number of quote packages or OfferIds purchased by your customers.
Total order value
The total sales value of your products for customers who also completed a purchase in the checkout flow.
Total quotes displayed
The total number of distinct protection quote packages generated.
Unique visits
The total number of unique quote packages or OfferIds exposed to the experiment variants.
Last updated
Was this helpful?

