Chapter 2

Mid-outage, should we hunt for the cause first?

Đang cháy nhà, có nên đi tìm ai châm lửa?

The chapter's question

What must be done in the first ten minutes when the system breaks?

Big idea

In an incident, the first job is to stop the bleeding, not to find the cause.

In this chapter

  1. Part 2.1

    One Person in Charge

    Who makes decisions while the incident is underway?

  2. Part 2.2

    Rolling Back

    How long does it take me to roll back to the last working version?

  3. Part 2.3

    Telling Users

    What are users told, through which channel, and how soon?

  4. Part 2.4

    Notes During the Incident

    Who records each action taken, and at what time?

The reading for this chapter is inside Conan School

This chapter has 4 readings, with case stories and exercises. Chapter 1 of The Two A.M. Incident is free to read right here.

Read in Conan School

Chapters of The Two A.M. Incident

  1. 1.Why do customers find our outages before we do?
  2. 2.Mid-outage, should we hunt for the cause first?
  3. 3.Can you trust your own judgment at 2 a.m.?
  4. 4.Does finding who's to blame make systems safer?
  5. 5.Is this a new incident, or an unpaid old one?