Optimization hub
Overview
The Optimization hub allows you to create and manage your personalization, audiences and experimentation experiences within Contentful. The information displayed in the Optimization hub helps you build better experiences and optimize your content.
Important: The Optimization hub is only available if you install the Contentful Personalization app in your space.
Access the Optimization hub
To access the optimization hub:
Log in to the Contentful app.
Navigate to the space where you have installed the Contentful Personalization app.
Go to the "Optimization" tab. The "Overview" page is displayed.
Overview page
The "Overview" page contains details about the performance and reach of your experiments and personalizations, as well as, access to valuable AI Suggestions. The data displayed is reported based on the selected timeframe.
The Total traffic and Optimized traffic widgets represent the global Key Performance Indicators (KPIs) that give you insight into:
Total traffic – The number of unique visitors that have visited any of your pages.
Optimized traffic – The % of unique visitors that have seen a personalization or experiment.
NOTE: You can customize your "Overview" page by clicking + Suggest a widget.
Conversion metric performance
The conversion metric performance section contains details about all the conversion metrics you have set up and how they are performing. This information can help you determine how much your conversions are influenced by Contentful Personalization.
The value underneath the name of each conversion metric represents the number of conversions, unique conversions or conversion values that were influenced by an experiment or personalization, depending on the metric type.
The numbers are being reported on the scope selected in the dropdown filed. You can select from the following scopes:
Unique conversions – Unique conversions count the unique number of visitors that have converted in the selected time period. If a single visitor converts multiple times, they are still just counted once.
Total conversions – Total conversions count the number of conversion events that have happened in the selected time period, irrespective of the number of visitors that have triggered it.
Conversion value / Duration / Custom value – The “Conversion value”, “Duration” or “Custom value” sums up the associated value of a conversion across all that have happened in the selected time period. This scope is only available to metrics that carry a value, for example, currency, time or other metric types.
The following values are displayed both as a sum, and on the timeline:
Total value – The total number of conversions, unique conversions or the sum of the conversion value.
Influenced by optimizations – The influenced value is a subset of the total value. It only includes all the conversions that were in some way influenced by an experiment of personalization. This means that the conversion was attributed to at least one personalization experiment.
Audiences page
The "Audiences" page contains details about all your Contentful Personalization audiences and their reach. All metrics displayed are based on the selected timeframe.
You can search for a specific audience to see its details, or create a new one from within the page by clicking Create audience.
For each audience, the following additional columns are displayed:
Current usage – How many published personalizations and experiments are currently using this audience.
Profiles – The number of profiles that were active (i.e. have sent any event, such as a “page view”) in the selected timeframe. This timeframe can be changed in the top right of the screen.
Personalizations page
The "Personalizations" page contains details about all your personalizations, their reach and their performance. All metrics displayed are based on the selected timeframe.
You can search for a specific personalization to see its details, or create a new one from within the page by clicking Create personalization.
For each personalization, the following additional columns are displayed:
Audience – The audience that sees this personalization.
Variant profiles – The number of unique profiles that have seen the variant (i.e. not the holdout) of this personalization in any capacity in the given timeframe.
Primary metric – The primary metric that was selected for this personalization.
Uplift – The uplift this personalization creates, compared to the holdout, for the respective primary metric and the selected timeframe.
Probability to be best (P2BB) – The probability that the uplift is significantly outperforming the holdout. P2BB is also calculated based on the selected timeframe and respective primary metric.
NOTE: If the primary metric is not set for a personalization or if the holdout is set to 0%, then Uplift and P2BB cannot be calculated. In this case, define your primary goal/metric and increase your holdout.
Experiments page
The "Experiments" page contains details about all your experiments, their reach and their performance. All metrics displayed are calculated based on the whole duration of an experiment.
You can search for a specific personalization to see its details, or create a new one from within the page by clicking Create experiment.
For each experiment, the following additional columns are displayed:
Progress – The elapsed duration and estimated time left until the experiment reaches a significantly winning variant with a “Probability To Be Best” of >95%. Progress is calculated based on the performance of all variants against the control group and the primary metric, as well as the traffic and behaviour so far. The longer an experiment runs, the more accurate the estimation will become. Estimations are usually available after running an experiment for at least a day.
NOTE: If no primary metric is selected or if 0% of traffic is distributed towards the control group, then progress cannot be calculated. In this case, define a primary goal/metric and increase your variant distribution for the control.
Audience – The audience that triggers this personalization.
Profiles – The number of unique profiles that have seen the experiment (including the control group) so far.
Primary metric – The primary metric that was selected for this experiment.
Uplift – The uplift that this experiment sees for the best variant, compared to the control, and for the respective primary metric. If the control outperforms all variants, then this will be negative. In a typical A/B-testing scenario, a negative number isn’t necessarily bad but just shows that the control is winning.
Probability to be best (P2BB) – The “Probability to be best” for the best performing variant or the control, meaning the probability that any single variant (or the control) is outperforming all others. P2BB is also calculated based on the respective primary metric.
NOTE: If the primary metric is not set for a personalization or if the variant distribution for the control is set to 0%, then Progress, Uplift and P2BB cannot be calculated. In this case, please make sure to define your primary goal/metric and increase the variant distribution for the control.