Who Manages the AI Agents Running Your Operations?

Every AI agent working in operations needs a named human manager, and the right person is usually the leader who already owns the process the agent works inside. That person sets the agent's limits and answers for what happens when it gets something wrong. Vendors now sell agents pre-built for specific jobs, and the management of those agents is still your organization's job.
Picture the weekly operations review. A new back-office agent has been processing supplier changes for a month. Most of it has gone well. Then a batch of records goes through with the wrong payment terms, and the room tries to work out whose problem that is. The vendor configured it. IT approved the integration. Finance owns the ledger. Procurement owns the suppliers. Nobody in the room was ever told they manage the agent, so the exception sits in a shared inbox until someone volunteers.
What changed in how AI agents are sold?
Agents are increasingly packaged as ready-made workers for a defined role. In its Dreamforce 2026 announcements, published September 28, 2026, Salesforce describes "job-ready agents" that are "pre-built for specific roles like inbound pipe gen or outbound sales." The named examples include Piper, a sales development agent, and Fin, a customer service agent. Marshall is presented as a job-ready agent "built to run your supply chain and back-office operations," producing "a fixed, approved path for every back-office process." The same post says, in its own words: "Operating an agent after launch takes defined roles, clear metrics and repeatable processes."
That is a vendor describing what it launched, and this piece makes no claim about how any of these agents perform. What matters for a COO is the framing. When an agent arrives with a name and a job, it is tempting to treat it as installed software and move on. In practice it needs what any new team member needs from operations, starting with a clear scope and a supervisor it can escalate to.
How fast are organizations deploying agents, and are controls keeping up?
Deployment is rising faster than the controls built into agents. The KPMG Q3 2026 AI Quarterly Pulse, released September 24, 2026, surveyed 314 US C-suite and business leaders at organizations with annual revenue of $1 billion or more between July 24 and August 25, and found 62% of organizations building, deploying or developing AI agents, up from 53% the previous quarter. The share building controls into their agents alongside monitoring and evaluation fell to 30%, from 43% two quarters earlier, which KPMG attributes to many relying on guardrails already in place.
Read together, those figures describe more agents in production with fewer controls designed for the agent itself. Existing guardrails were built for people and systems. They were rarely built for something that acts on its own across several of them.
Who should own an AI agent's exceptions?
The person who owns the process should own the agent's exceptions. If an agent changes supplier records, the leader accountable for supplier records is its manager, whatever team configured it. That keeps one rule intact: the person who answers for the outcome is the person who can change how the work is done.
This does not push IT out of the picture. IT still owns access and security, and should be able to switch an agent off quickly. The split that tends to hold is that IT owns whether the agent can act and the process owner decides what it should do. Salesforce's own line about defined roles and clear metrics points the same way. A metric needs somebody to read it. Useful ones for an operations agent are simple: how many cases it handled, how many it escalated, how long escalations waited and how many of its actions had to be reversed. The process owner reviews them, because only the process owner can tell whether a reversal was the agent's fault or a gap in the instructions it was given.
Average Robot frames the underlying choice as removing the human or raising the human. An organization that removes the human treats the agent as a replacement and lets oversight fall away with the role it replaced. An organization that raises the human gives a named person a new job: setting the agent's scope, reviewing what it escalates and deciding when its instructions change. The second approach takes more design up front. It is also the only one where somebody is responsible on the day an exception costs money.
This is the Direction link in the AI Profitability Gap, the chain Average Robot uses to trace AI spend through to return (how the chain works). Direction is about who decides what AI is pointed at and on whose authority. With agents, that decision repeats every time an agent's scope is set or widened, so it has to sit with a named operational owner and be revisited.
What should a COO set up before the next agent goes live?
These steps can start before any new purchase.
- List every agent already acting in your operations. Include vendor-built agents inside tools you already pay for, and anything a team switched on in a pilot.
- Give each agent a manager by name. Use the owner of the process it works in. Write it down where the operations team can see it.
- Write the agent's scope like a job description. State what it may do alone, what it must escalate and what it may never touch. KPMG's finding that 49% of leaders have defined high-risk use cases where agents may not decide autonomously is a useful prompt to define yours.
- Route exceptions to the manager, with a deadline. A shared inbox is where exceptions wait. A named queue with a response time is where they get fixed.
- Review each agent the way you review a team. Once a month, look at what it handled, what it escalated and whether its scope should change.
When you are ready to fix how one team's work runs with AI in it, see what the AI Profit Sprint covers. It is a 90-day engagement for a leader and a team of up to 20.
Take it with you
Download this as a PDF
A clean, branded version to read offline or share with your team.
Frequently Asked Questions
Who is responsible when an AI agent makes a mistake?
The leader who owns the process the agent works in should be responsible for its exceptions, regardless of which team configured it. That keeps accountability with the person who can change how the work is done. Without a named owner, agent errors tend to wait in shared queues while several teams each assume another one is handling them.
What are job-ready AI agents?
Job-ready agents is the term Salesforce used at Dreamforce 2026, announced September 28, 2026, for agents pre-built for specific roles. Its named examples include Piper for sales development, Fin for customer service and Marshall for supply chain and back-office operations. A pre-built agent still needs a defined scope, a human manager and an escalation route.
How many companies are deploying AI agents?
Most of the large US organizations in KPMG's Q3 2026 AI Quarterly Pulse said they were building, deploying or developing AI agents, up from the previous quarter. Over two quarters, the share building controls into their agents fell.
Should AI agents make decisions without human approval?
That depends on the decision's risk. In KPMG's Q3 2026 survey, nearly half of leaders had defined high-risk use cases where they do not allow autonomous decision-making by agents. A COO can set the line by writing each agent's scope as a job description: what it does alone, what it escalates and what it never touches.
Related reading
- How Should a CHRO Plan Junior Hiring as AI Changes the Work?
Fewer young people are being hired into AI-exposed jobs, while employers expect to hire more. How a CHRO plans entry-…
- How Should a CMO Fund AI When the Marketing Budget Is Flat?
Marketing budgets are barely moving and AI takes a meaningful share of them. How a CMO funds AI by reallocation, and …
- What Should a CEO Tell the Board About AI Next Quarter?
Two-thirds of S&P 500 earnings calls now cite AI. What a CEO can tell the board about AI that a director can check, a…