AI Safety
AI safety is the interdisciplinary field focused on minimising the systemic risks, operational failures and societal harms caused by artificial intelligence systems. Its work is technical as much as ethical: making model behaviour predictable in conditions the model was not trained on, blocking deliberate manipulation, and building fail-safes that stop a system when something goes wrong. The concern is autonomous software running in real-world conditions without a person checking every step.
In practice
In safety-critical or heavily regulated industries this sits with the chief risk officer, not the engineering team. The question that decides most of it commercially is what the system does when it is uncertain: stop, escalate, or carry on. Incidents cluster around systems that carry on.