What is a conversion lift study?

Analytics & measurement

How does a conversion lift study work?

Google's help page describes Conversion Lift as a tool that measures the conversions that happen because people saw your ads, with test groups built either from user data or from geography1. It also says the tool is not available for all accounts and points you to a Google representative1. Meta's developer documentation says it randomly assigns people to a test or a control group, and that access is limited and goes through a Meta representative2.

This makes it a close relative of a holdout test. The idea is the same. Some people do not see the ads, and the gap shows what the ads did.

Who marks the homework?

The platform sells the ads. It also designs the test, runs it and counts the result. That does not make the result wrong. It does mean you should look at the set-up, not just the headline.

One AdExchanger article makes a related point: do not let the platform decide whether a sale was incremental, or whether a customer was new3. A customer who is new to the platform may already be in your own CRM.

Look for these before you act on a result:

  • The size of the control group.
  • The uncertainty around the lift, not only the lift itself.
  • Which conversions were counted, and whether they match your own orders.

To turn lift into money, divide the extra revenue by spend. That gives iROAS, or incremental ROAS.

Worked example

Easily confused with

  • Conversion lift study vs Holdout test

    The general method. A lift study is a platform-run version of it.

  • Conversion lift study vs Ghost ads

    A way of building the control group. The system records when a control user would have seen your ad and shows them a different one.

  • Conversion lift study vs Brand lift

    Measures awareness or ad recall, usually by survey, not conversions.

For platform requirements and limits, read conversion lift study requirements.

FAQ

A rider in a red cape and bicorne hat on a rearing yellow plush horse, after David's Napoleon Crossing the Alps

Is a conversion lift study the same as an A/B test?

Close, but not the same. Both split an audience at random. A lift study compares seeing the ads with not seeing them, rather than comparing two versions of an ad.

Can I trust a platform's own lift study?

It is an experiment with a control group, which attributed numbers are not. Read it with the set-up in hand: who designed it, how big the control was, and how wide the uncertainty is.

Let’s find what’s actually working.

Next step. Check what your ROAS looks like on explicit assumptions. Use the Is your ROAS real? calculator.