Social and content design

Member lesson

Testing creative, one change at a time

Lesson 10 of 11 in Social and content design.

Checked against the makers' documentation on 9 October 2026.

How to Create an A/B Test in Experiments of Meta Ads Manager · Jon Loomer
Lesson

Opinions about creative are cheap, and the people closest to the work are not its audience. A test replaces the argument with a count. Meta's help describes its A/B test as comparing two versions of an ad strategy by changing a variable such as the image, the text, the audience or the placement. It shows each version to a separate part of the audience, makes sure nobody sees both, and then works out which did better.

Member

The rest of this is for members.

You have read the opening of this lesson. The rest of it comes with a membership.

One membership covers all four courses and Brands.

  • All lessons in the four Learn courses
  • All brand breakdowns in the Brands section
  • All quizzes, flashcards and crosswords
  • An AI teacher on every lesson, for up to 60 questions a day
  • All course material published during the membership

Price

Membership is from $12 a month on the Yearly plan, which is charged at $144 once a year. Lifetime access is $59, paid once.Membership is from ₹200 a month on the Yearly plan, which is charged at ₹2,400 + GST once a year. Lifetime access is ₹3,999 + GST, paid once.

Check what stuck

Members only

You can't take this check yet.

Members answer these 3 questions and keep the ticket for this lesson. Every lesson has one.

  1. Question 1, locked

    How long does Meta advise letting an A/B test run?

    • At least 7 days
    • Exactly 24 hours
    • At least 60 days
    • Until one ad reaches 100 clicks
  2. Question 2, locked

    What confidence percentage does Meta treat as a winning result in an A/B test?

    • 50% or higher
    • 65% or higher
    • 90% or higher
    • 99% or higher
  3. Question 3, locked

    In the Obama campaign's splash page test, what beat the video the staff favoured?

    • Another, shorter video
    • A page of plain text
    • A family photograph with a 'Learn More' button
    • A page with no button at all

Elsewhere in the library

Hear about new courses.

Leave an email and we will tell you when something new lands. We do not write often.