AI Builders SF: Building & Evaluating the Next Generation of AI Agents

Join Arize AI and M12, Microsoft's Venture Fund for an evening of talks and networking at the GitHub office in San Francisco. Whether you're building AI agents, fine-tuning models, or scaling AI in production, connect with fellow builders pushing the industry forward. Hear firsthand lessons from teams shipping agents today — from architecture decisions to evaluation strategies — and stick around for drinks and conversation with the community. 📍 GitHub HQ, San Francisco 🍕 Food and drinks will be provided — AGENDA 5:30 – 6:30 PM Check-in & Welcome Reception 6:30 – 7:00 PM Manage AI Agents at Scale with Foundry Control Plane - Amanda Foster, Microsoft Take command of your AI agent fleet with Foundry Control Plane. As organizations evolve from isolated copilots to autonomous multi-agent systems, they need unified oversight. Learn how Foundry Control Plane gives AI developers the visibility, governance, and control to manage their entire agent fleet and scale reliably. 7:00 – 7:30 PM Alyx: Lessons Learned from Building and Evaluating a Production Agent — Arize AI We have thousands of customers building agents every day and learn a lot from them, but we learned even more when we built Alyx, our in-product AI assistant for using Arize AX. In this talk we'll share the architecture of Alyx, missteps and roads not taken, and the techniques we used to build a high-quality, performant agent in production. 7:30 – 8:30 PM Happy Hour & Networking Hosted by Arize AI & M12