Chapter 3

Is A/B testing the cheapest way to learn, or priciest?

A/B là cách học rẻ nhất, hay đắt nhất?

The chapter's question

How can I test this hypothesis without splitting users into two groups?

Big idea

There are many ways to learn more cheaply than an A/B test.

In this chapter

  1. Part 3.1

    The Fake Door

    Is it acceptable to place a button for a feature that does not exist yet and count clicks?

  2. Part 3.2

    Manual Behind the Scenes

    Can I do this manually for ten customers before building it?

  3. Part 3.3

    Before and After

    How trustworthy is a before-and-after comparison, and what must I check?

  4. Part 3.4

    Testing With One Segment

    Is opening it to a small group of customers and observing enough to decide?

The reading for this chapter is inside Conan School

This chapter has 4 readings, with case stories and exercises. Chapter 1 of Experiments With Few Users is free to read right here.

Read in Conan School

Chapters of Experiments With Few Users

  1. 1.If any result fits, why run the experiment?
  2. 2.Can we still experiment with so few users?
  3. 3.Is A/B testing the cheapest way to learn, or priciest?
  4. 4.Is an early win skill, or just luck?
  5. 5.Is one win worth more than a year of notes?