People Create Safety

Categories
Systems
Sources
How Complex Systems Fail

In complex systems, human practitioners are the adaptable element that continuously produces safety and reliability, by detecting problems, compensating for flaws, and adjusting to changing conditions. Safety is an ongoing activity, not a static state.

Why it Matters

Practitioners hold a dual role: they both operate the system and defend it against failure. Much of the reason complex systems work at all is this constant, often invisible, human adaptation. Removing or ignoring it, through over-automation or blame, erodes the very thing keeping the system up.

Signals

  • Incidents quietly averted by someone noticing in time.
  • Workarounds that keep production running.
  • Reliability that drops when experienced people leave.

Benefits

Valuing and supporting practitioner adaptation strengthens the system, and turns near-misses into learning instead of luck.

Risks

Treating people purely as a source of error and designing them out; failing to give them the information and authority to adapt; counting on heroics instead of building support.

Tensions

People are both the system's main defense and a source of error; the same designs that constrain error can also constrain the adaptation that creates safety.

Examples

An on-call engineer improvising a fix during a novel outage; an operator catching a bad input that the automation accepted.