Chapter 3

Do we really know what answer we want?

Mình có thật biết mình muốn máy trả lời gì?

The chapter's question

What does a correct answer from my feature look like?

Big idea

If you cannot write a model answer, you are not yet clear what you want the machine to do.

In this chapter

  1. Part 3.1

    Write the Answer First

    Can I write the correct answer for each question?

  2. Part 3.2

    Partly Right

    How do I score an answer that is right in substance but missing detail?

  3. Part 3.3

    Questions With No Answer

    When is the correct answer a refusal?

  4. Part 3.4

    Domain Experts Grading

    Who in the company understands the work well enough to approve answers?

The reading for this chapter is inside Conan School

This chapter has 4 readings, with case stories and exercises. Chapter 1 of An Exam Paper for the Machine is free to read right here.

Read in Conan School

Chapters of An Exam Paper for the Machine

  1. 1.Did yesterday's fix help, or just look better?
  2. 2.Do questions we invent test what users actually ask?
  3. 3.Do we really know what answer we want?
  4. 4.Is a more detailed rubric really a fairer one?
  5. 5.Which product is last year's test set still grading?