Hallucinations, authentication, business rules: what you need to solve to take a Copilot prototype to production.
Building an agent for Microsoft 365 Copilot looks simple: a name, some instructions, a few documents… and the magic happens. At first, anyway.
In this session, we share an unfiltered account of turning a Copilot agent prototype into a system actually used in production.
We’ll start from a promising POC, able to answer users’ basic requests, and explore everything that breaks when you scale: hallucinations, limited capabilities, business rules ignored, authentication issues, ...
Through this “alchemy”, we’ll see how to turn that raw material into a reliable system:
- choosing between declarative agents and custom development
- structuring your agents (tools, orchestration, grounding)
- taking a product approach
- building with the help of AI
This talk is for developers who want to go beyond demos and build Copilot agents that truly hold up in production.
No magic here: just transformation, trade-offs, and lessons learned in the field.