Fundamental Rule...
With safety critical systems (in the specifying, designing, and marketing of same) one's 'Confidence / Competence Ratio' is absolutely critical.
As soon as this ratio exceeds unity, people get hurt.
Tesla's (Musk's) 'Confidence / Competence Ratio' for AutoPilot was seemingly about 1.25 (my estimate, based on the evidence before us...).
Note that the absolute value of Competence isn't the primary factor for safety (big mistake to believe it is). Even mediocre organizations can achieve perfect safety, if they're sufficiently paranoid and cautious. In other words, adjust their self-confidence down to keep the ratio well below one
For safety, it's this 'Confidence / Competence Ratio' that is absolutely key.
Hardly anybody knows this. But it's subtly built into many QA processes.
Biting the hand that feeds IT
