Dario Amodei and Sam Altman Want to Slow Down AI. Are We Just Going Down the Cliff a Little Later?
Slowing AI down buys us time. Getting humans ahead requires AI, software, and humans to reason together.
Slowing AI down buys us time. Getting humans ahead requires AI, software, and humans to reason together.
Keeping humans around is not enough. Human judgment must become part of AI reasoning—and part of the organization’s reusable intelligence.
Autonomous agents can decide how to execute, but the enterprise must continue to define what they are executing and why. They need the equivalent of a skipper’s standing orders—not just permissions and guardrails.
On a boat the navigation log belongs to the boat, not the autopilot. Agent memory works the same way: the organization paid for the model, the data and the expertise, so the reasoning and the lessons should outlive whichever agent happens to be steering.
An autopilot steers for hours, but it is never autonomous from the skipper. AI agents should execute without asking permission for every step, while the human still owns the destination, the route, and the reasoning behind the plan.
A skipper keeps watch without inspecting every part of the boat. AI agents ask humans to approve everything, which trains them to approve nothing carefully. Oversight needs structured reasoning.
A day sail asks for one go/no-go answer. An ocean crossing asks for continuously better decisions in changing conditions. AI has the same distinction – and enterprise AI is the crossing.
Choosing between the skipper and the autopilot is the wrong question. The missing piece isn’t data – it’s judgment and reasoning, owned by the enterprise and amplified by the model.
Operational data is already trusted to run the business, so why assume it isn’t good enough for AI? Reasoning models also remove the need for months of upfront semantic modeling.
As AI grows more autonomous, the real question isn’t whether it should reason—it’s who owns that reasoning. AI is the autopilot; the enterprise is the skipper.