---
title: "Adyen Uplift experiments"
description: "Learn more about how you can start, evaluate, and stop experiments."
url: "https://docs.adyen.com/uplift/uplift-experiments"
source_url: "https://docs.adyen.com/uplift/uplift-experiments.md"
canonical: "https://docs.adyen.com/uplift/uplift-experiments"
last_modified: "2019-09-06T14:25:00+02:00"
language: "en"
---

# Adyen Uplift experiments

Learn more about how you can start, evaluate, and stop experiments.

[View source](/uplift/uplift-experiments.md)

You can run different types of experiments to validate and evaluate the impact of changes you make to settings on your account. For example, you can run experiments to see if a different setup is likely to lead to an uplift in conversion or revenue, or compare the performance of two risk profiles.

Experiments are not simulations. They are performed on real transactions, processed with your live Adyen account.

## Requirements

Before you begin, take into account the following requirements and limitations.

| Requirement                                    | Description                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                         |
| ---------------------------------------------- |   |
| **Integration type**                           | Make sure that you have built an online payments integration that supports Adyen Uplift. For more information, see the [detailed requirements](/uplift/uplift-requirements).                                                                                                                                                                                                                                                                                                                                                                                                                        |
| **[Customer Area roles](/account/user-roles)** | All Customer Area users can see the **Experiments** page in the **Revenue & risk** section. To start a checkout experiment, you need one of the following roles:- **Merchant admin**
- **Merchant manage Uplift optimize settings** combined with **Change payment methods**To start an optimization experiment following a recommendation, you need the following role:- **Merchant manage Uplift optimize settings**To start a risk experiment, you need the following role:- **Risk admin**                                                                                                      |
| **Limitations**                                | Optimization experiments:- You can only start optimization experiments following a recommendation.Checkout payment method experiments:- You can only start experiments on payment methods that you have already activated, and you must have at least three active payment methods.
- You cannot start an experiment on primary payment methods such as credit or debit cards.Checkout dynamic payment method ordering experiments:- You meet the [Personalize requirements](/uplift/uplift-requirements#module-requirements). For the Advanced flow, you must use the `shopperConversionId` field. |

## Experiment types

There are different types of experiments you can run to validate the effect of making changes to settings on your account:

* [Checkout experiments](#checkout-experiments)
* [Optimization experiments](#optimization-experiments)
* [Risk experiments](#risk-experiments)

### Checkout experiments

Run a [payment method experiment](#start-a-checkout-experiment) to analyze the impact on conversion and cost of temporarily removing a payment method from your checkout page in a country or region. You can do this, for example, to learn if removing a costly payment method negatively impacts conversion, or not.

Or, run a [dynamic ordering experiment](#start-a-dynamic-checkout-experiment) to see the effect of dynamically ordering payment methods on a cost or conversion optimization strategy.

### Optimization experiments

An Adyen Uplift [recommendation](/uplift#uplift-dashboards) can include the option to start an experiment when changing one or more settings is likely to lead to an uplift in performance or revenue.

When a recommendation gives you that option, you can [start an optimization experiment](#start-an-optimization-experiment) on a portion of your transactions. You get recommendations and can start experiments that apply to your integration, and that are relevant for the countries or regions you operate in.

By analyzing the results during the experiment, or after you stop it, you can validate the effect of any changes. You can then choose to change to the recommended settings, or decide not to act on the recommendation.

### Risk experiments

You can run a risk experiment to compare the performance of two risk profiles and determine which performs better. For example, you can run a risk experiment to see if changing, adding, or disabling a risk rule has the effect you want on your fraud rate.

See [run an A/B test experiments](/risk-management/run-ab-test-experiments/) for details on how to start, evaluate and stop risk experiments. Risk experiments require Protect premium.

## Start an experiment

### Start a checkout payment method experiment

To start an experiment, in your [Customer Area](https://ca-live.adyen.com/):

1. Go to **Settings** > **Checkout settings**.

2. Select the **Country** for which you want to start an experiment.

3. Find the payment method that you want to exclude from checkout for the experiment, and select the test button.

4. Select **Continue**.

5. For each experiment, do the following:

   1. Enter an experiment **Name**.

   2. Select the **Merchant account** from which you want to include transactions for the experiment. If you are logged in on the company account, select a single merchant account from the dropdown menu.

   3. Confirm the payment method and the country or region.

   4. Set a traffic percentage. This is the proportion of transactions that you want to include in your experiment.

      You can change the traffic percentage at any time during the experiment. For example, you can start with a low percentage and gradually increase the percentage of traffic if you see good results.

6. Select **Create** to start running your experiment.

Your experiment will continue running until you [stop the experiment](#stop-an-experiment).

### Start a checkout dynamic ordering experiment

You can run an experiment to compare the performance of different dynamic ordering settings and determine which performs better. Currently, there are two options for your dynamic ordering goal: **Conversion** or **Cost**.\
To start an experiment, [dynamic ordering](/online-payments/checkout-settings#checkout-payment-method-ordering) must be enabled.

In your [Customer Area](https://ca-live.adyen.com/):

1. Go to **Settings** > **Checkout settings**.

2. Select **Dynamic Ordering.**

3. Select the country for which you want to start an experiment.

4. Select **Experiment**.

5. For each experiment, do the following:

   1. Enter an **Experiment** name. The **Merchant account** and **Country/region** fields are pre-filled based on the country you selected.

   2. Set a traffic percentage. This is the proportion of transactions that you want to include in your experiment.

      Transactions in your experiment will be evenly split between your current dynamic ordering goal (Variant A) and the alternative dynamic ordering goal (Variant B).

      For example, if you set a **Traffic percentage** of 25%, and your current dynamic ordering goal is optimize for **Conversion**, the current (Variant A) setting to optimize for **Conversion** is applied to 12.5% of your transactions, and the alternative (Variant B) setting to optimize for **Cost** is applied to 12.5%.

6. Select **Create** to start running your experiment.

After you select **Create**, an experiment is generated for that country and appears in the **Running** section of the **Experiments** page.

While the experiment is running, the user who created the experiment can edit the name of the experiment and the traffic percentage.

Your experiment will continue running until you [stop the experiment](#stop-an-experiment).

### Start an optimization experiment

To start an experiment, in your [Customer Area](https://ca-live.adyen.com/):

1. Go to **Revenue & risk** > **Uplift overview** > **Recommendations**.

2. Select a recommendation and then select **Create experiment**.\
   This button is only available when the recommendation allows you to experiment, and when you meet the requirements to run the experiment. For example, certain recommendations require that you process payments in a specific country or region, or that you have enabled a payment method or feature. The recommendation contains details about what is required before you can create an experiment.

3. For each experiment, do the following:

   1. Enter an experiment **Name**.

   2. Select the **Merchant account** from which you want to include transactions for the experiment. If you are logged in on the company account, you can select multiple merchant accounts.

   3. Set a traffic percentage. This is the proportion of transactions that you want to include in your experiment.

      Transactions in your experiment will be evenly split between your current (Variant A) and recommended (Variant B) setting. For example, if you set a **Traffic percentage** of 20%, the current setting is applied to 10% of your transactions, and the recommended setting is applied to 10%.

4. Select **Create** to start running your experiment.

While the experiment is running, the user who created the experiment can edit the name of the experiment and the traffic percentage.

Your experiment will continue running until you [stop the experiment](#stop-an-experiment).

## View experiment results

You can view data from running and completed experiments. At the start of the experiment, it takes about four hours before you can see the first results. After that, the results of your running experiment are updated regularly.

To view data from an experiment in your [Customer Area](https://ca-live.adyen.com/):

1. Go to **Revenue & risk** > **Experiments**
2. Select **Risk**, **Optimizations**, or **Checkout**.
3. Select **Running** or **Completed** and then select an experiment to view the results.

For each experiment, you can view and compare the performance of the different setting or comparison variants. The data that you can compare depends on the experiment.

## Stop an experiment

When you [view a running or completed experiment](#view-results), the results show if the experiment has reached statistical significance. We recommend letting an experiment run until that point is reached. You can then stop the experiment and, if applicable, implement any changes to achieve the variant with the best results.

If you stop an experiment before a statistically significant result has been reached, we recommend to rerun the experiment for a longer time period, or on a larger portion of your transactions.

To stop an experiment, in your [Customer Area](https://ca-live.adyen.com/):

1. Go to **Revenue & risk** > **Experiments**.

2. In the **Optimizations** or **Checkout** tab, go to your experiment on the list, and select **End**.

   * For optimization experiments, select **End** to stop the experiment and keep your current setting, or select **End & change setting** to act on the recommendation and change your settings.
   * For checkout experiments, select **End** to stop the experiment.

## See also

* [Adyen Uplift landing page](/uplift)
* [Adyen Uplift detailed requirements and recommendations](/uplift/uplift-requirements/)
* [Run A/B test experiments (Protect)](/risk-management/run-ab-test-experiments/)
