WHITEBOXX / GLOSSARY

Agent orchestration: coordinating
the steps and the agents.

AI agent orchestration is the coordination of the steps, agents and tools in an AI system: which part does what, in which order, how results pass between them and what happens when a step fails. It turns several capable parts into one dependable process.

By Gautam Mehra · Published · Updated

What is agent orchestration?

A single agent can handle a short task. Longer work, such as researching fifty companies and writing a report, is usually split into steps that run one after another or at the same time. Orchestration is the layer that plans those steps, passes results along, retries failures and decides when the work is done.

Orchestration can be written in code, handled by an agent acting as a coordinator, or both.

PATTERNS

Common orchestration patterns.

PATTERNS
PatternHow it worksGood for
ChainEach step uses the output of the one beforeTasks with a fixed order, such as extract, check, then summarise
RouteA first step decides which path or agent handles the requestRequests that vary in type
ParallelSeveral steps run at once and their results are combinedRepeating the same analysis across many items
Coordinator and workersOne agent plans the work and assigns parts to othersTasks where the steps are not known in advance
Check and reviseOne step produces a result and another reviews itWork with clear quality criteria

Should you use one agent or several?

Anthropic’s guide to building effective agents, published in December 2024, recommends starting with the simplest setup that works and adding agents only when a task needs them. Every extra agent adds cost, delay and another place for errors.

Fixed steps written in code are easier to test than an agent that decides its own plan. Use an agent where the path really does depend on what it finds.

How Evidence OS orchestrates work.

Evidence OS workflows set the order of steps, run execution-agent assignments within them and record the progress of each step. A workflow can run again on a schedule with the same structure.

See how workflows run