Agent orchestration
In short
Agent orchestration is the flow of agents in an application: which agents run, in what order, and how the next step is decided, by a language model, by code, or by a mix of the two1.
- Also called
- AI agent orchestration, Multi-agent orchestration
- Topic
- AI agents
- Level
- Some background helps
The OpenAI Agents SDK describes two patterns, and says they can be mixed. In the first, an agent is given an open-ended task and the model plans how to tackle it, using tools to take actions and acquire data, and using handoffs to delegate tasks to sub-agents1. One form is a manager that keeps control of the conversation and calls specialist agents as tools. Another is a triage agent that routes the turn to a specialist, who then remains the active agent for the rest of the turn1.
In the second pattern, code chooses the route. The SDK says this is more deterministic and more predictable for speed, cost and performance1. Code can pass one agent’s output in as the next agent’s input, run an evaluator in a loop until the evaluator says the output passes, or run agents that do not depend on each other at the same time1. One chaining example decomposes a blog post into research, an outline, the post, a critique and an improvement1.
Anthropic draws a related line. A workflow orchestrates models and tools through predefined code paths. An agent is a system in which the model directs its own process and its own tool use2. Agentic systems often trade latency and cost for better task performance, and Anthropic says to add that complexity only when it demonstrably improves the outcome2. In its orchestrator-workers pattern, a central model splits a task, delegates the parts and combines the results. The examples it gives are coding work that changes several files, and search that draws on several sources2.
Example
OpenAI’s orchestration guide gives writing a blog post as a chaining example: research, an outline, the post, a critique, then an improvement. Each step’s output becomes the next step’s input1.
Why it matters
Orchestration is the decision about which agent runs next, and who makes that decision1. Letting the model choose suits an open-ended task. Fixing the path in code makes the speed, cost and performance more predictable1.
Questions people ask
Is agent orchestration the same as a multi-agent system?
Orchestration is the flow between agents: which ones run, in what order, and whether a language model, code, or a mix of the two decides the next step1. That flow can be several agents. Anthropic separately uses workflow for a path fixed in code, and agent for a model that directs its own tool use2.
How does agent orchestration work?
Either a language model plans the task, calls tools and hands work to other agents, or code selects the next step, for example by chaining outputs or running independent agents together. The OpenAI Agents SDK says the two patterns can be combined1.
Does more orchestration make an AI system better?
Not by itself. Anthropic says agentic systems often trade latency and cost for better task performance, and that extra complexity should be added only when it demonstrably improves the outcome2. The OpenAI SDK says a code-defined flow is more predictable for speed, cost and performance1.
Related terms
Tools that use it
- AgentOpsMonitoring and debugging platform that records what AI agents do, what they cost and where they fail.
- LangChainOpen-source frameworks and the LangSmith platform for building, testing and running AI agents
- n8nA visual workflow automation tool for building AI agents and connecting apps, available hosted or self-hosted
- ChatGPT Workspace AgentsShared ChatGPT agents, built on Codex, that teams set up to run repeat work tasks in ChatGPT or Slack.