Chapter 2

Do questions we invent test what users actually ask?

Đề do mình nghĩ ra có đang đo đúng người dùng?

The chapter's question

Which questions deserve a place in my test set?

Big idea

Good test questions come from what real users asked, not from what the builders imagined.

In this chapter

  1. Part 2.1

    Real Question Logs

    What did real users ask over the past month?

  2. Part 2.2

    Easy, Hard and Trap Questions

    Does my test set include all three types of question?

  3. Part 2.3

    How Many Is Enough

    How many questions are needed to see a difference?

  4. Part 2.4

    Questions That Failed

    Has every bug users reported become a question in the set?

The reading for this chapter is inside Conan School

This chapter has 4 readings, with case stories and exercises. Chapter 1 of An Exam Paper for the Machine is free to read right here.

Read in Conan School

Chapters of An Exam Paper for the Machine

  1. 1.Did yesterday's fix help, or just look better?
  2. 2.Do questions we invent test what users actually ask?
  3. 3.Do we really know what answer we want?
  4. 4.Is a more detailed rubric really a fairer one?
  5. 5.Which product is last year's test set still grading?