Orchestrating Intelligence: Multi-Agentic Design Patterns for Production AI

As generative AI systems evolve from single LLM calls to complex, goal‑driven workflows, multi‑agent architectures are becoming essential for robust, scalable, and explainable AI applications.

This talk presents a practical framework for designing and implementing multi‑agent generative AI systems, covering four core orchestration patterns that define how agents coordinate:

Orchestrator‑Worker: A central agent decomposes a task and delegates subtasks to specialized worker agents, then aggregates and validates results.

Hierarchical Agent: Agents are organized in layers (e.g., manager, specialist, executor), enabling abstraction, delegation, and error handling across levels.

Blackboard: Agents contribute to and react from a shared “blackboard” workspace, enabling loosely coupled, event‑driven collaboration.

Market‑Based: Agents act as autonomous participants that negotiate, bid, or compete for tasks and resources, useful in dynamic, resource‑constrained environments.

For each pattern, we show concrete use cases, such as customer support triage, research synthesis, code generation pipelines,  and discuss trade‑offs in latency, complexity, and observability.

About Mary Grygleski

Mary is a Java Champion, and the AI Practice Lead at Callibrity, a consulting firm based in Ohio. She started as an engineer in Unix/C, then transitioned to Java around 2000 and has never looked back since then. After 20+ years of being a software engineer and technical architect, she discovered her true passion in developer and customer advocacy. Most recently she has serviced companies of various sizes such as IBM, US Cellular, Bank of America, Chicago Mercantile Exchange, in topic areas that included Java, GenAI, Streaming systems, Open source, Cloud and Distributed messaging systems. She is also a very active tech community leader outside of her day job. She is the President of the Chicago Java Users Group (CJUG), and the Chicago Chapter Co-Lead for AICamp.

More About Mary »