People Create Safety
- Categories
- Systems
- Sources
- How Complex Systems Fail
In complex systems, human practitioners are the adaptable element that continuously produces safety and reliability, by detecting problems, compensating for flaws, and adjusting to changing conditions. Safety is an ongoing activity, not a static state.
Why it Matters
Practitioners hold a dual role: they both operate the system and defend it against failure. Much of the reason complex systems work at all is this constant, often invisible, human adaptation. Removing or ignoring it, through over-automation or blame, erodes the very thing keeping the system up.
Signals
- Incidents quietly averted by someone noticing in time.
- Workarounds that keep production running.
- Reliability that drops when experienced people leave.
Benefits
Valuing and supporting practitioner adaptation strengthens the system, and turns near-misses into learning instead of luck.
Risks
Treating people purely as a source of error and designing them out; failing to give them the information and authority to adapt; counting on heroics instead of building support.
Tensions
People are both the system's main defense and a source of error; the same designs that constrain error can also constrain the adaptation that creates safety.
Examples
An on-call engineer improvising a fix during a novel outage; an operator catching a bad input that the automation accepted.