Who Watches the Bots? Observability, Testing, and Trust for Agentic AI with MLflow
About this event
Agenda:
6:00 - 6:30 PM - Welcome and mingle6:30- 6:45 PM - Introductions6:45 - 7:30 PM - Talk7:30 - 8:00 PM - Wrap up
Description:
IAI coding agents can now scaffold entire applications from a single prompt. But for mission-critical systems that require compliance, reliability, and auditability, "it works on my machine" isn't enough. When your agent makes fifty tool calls, rewrites three files, and confidently hallucinates a security vulnerability, how do you even begin to debug that?
This talk introduces a practical, open-source toolkit for injecting observability, control, and systematic testing into agentic AI development. Using MLflow's tracing and evaluation framework, we'll follow a single throughline: building an AI agent with a coding assistant (Claude Code), tracing both the assistant's work and the agent it produces, then evaluating quality with LLM judges - closing the loop from development through production monitoring.
You'll walk away with a concrete workflow for turning the black box of agentic coding into something you can inspect, measure, and trust. No vendor lock-in required.
Speaker Bio:
Tim Lortz is an AI Product Specialist at Databricks, where he has worked since 2019. He currently serves as the technical lead for Databricks' go-to-market efforts for AI in regulated industries, focusing particularly on enterprise-grade governance for AI platforms.
Prior to Databricks, Tim spent many years in various data science practitioner and leadership roles in the Federal contracting space. He holds a PhD in Industrial & Operations Engineering from the University of Michigan (Go Blue!!) and a BS in Industrial Engineering from the University of Pittsburgh.
Sign in to view full event details
Create a free account to see descriptions, save events, and more
Topics & Tags
About Who Watches the Bots? Observability, Testing, and Trust for Agentic AI with MLflow in Washington
Who Watches the Bots? Observability, Testing, and Trust for Agentic AI with MLflow is a free independent taking place on Tuesday, May 5, 2026 at 2112 Pennsylvania Ave NW, Washington, DC 20037, USA, Washington, United States. This independent is organised by DC Data & AI Events. Attendance is free — register to secure your spot. Currently 25 people have registered out of 25 spots. The event runs for approximately 2 hours.
Who Watches the Bots? Observability, Testing, and Trust for Agentic AI with MLflow — key details
- Date:
- Tuesday, May 5, 2026
- Time:
- 10:00 PM – 12:00 AM (America/New_York)
- Duration:
- 2 hours
- Location:
- 2112 Pennsylvania Ave NW, Washington, DC 20037, USA, Washington, United States
- Price:
- Free
- Format:
- In-person
- Organiser:
- DC Data & AI Events
- Attending:
- 25 registered
What to expect at Who Watches the Bots? Observability, Testing, and Trust for Agentic AI with MLflow
Join this independent over 2 hours for an engaging session of learning, discussion, and networking with fellow attendees.
Who should attend Who Watches the Bots? Observability, Testing, and Trust for Agentic AI with MLflow?
This independent in Washington is ideal for:
- AI and machine learning enthusiasts and practitioners
- backend engineers and API developers
Why attend?
- Free to attend — no financial commitment required
- Intimate group size means more meaningful connections
Washington event — May 2026
This evening independent is part of the growing events scene in Washington. Whether you're based in Washington or visiting for the independent, it's a great opportunity to connect with the local community. Browse more upcoming events in Washington on Rifio.
Topics and categories
Who Watches the Bots? Observability, Testing, and Trust for Agentic AI with MLflow covers topics including AI. Find similar events by browsing these topics on Rifio.
Frequently asked questions about Who Watches the Bots? Observability, Testing, and Trust for Agentic AI with MLflow
- When is Who Watches the Bots? Observability, Testing, and Trust for Agentic AI with MLflow?
- Who Watches the Bots? Observability, Testing, and Trust for Agentic AI with MLflow takes place on Tuesday, May 5, 2026 from 10:00 PM to 12:00 AM (America/New_York).
- Where is Who Watches the Bots? Observability, Testing, and Trust for Agentic AI with MLflow held?
- Who Watches the Bots? Observability, Testing, and Trust for Agentic AI with MLflow takes place at 2112 Pennsylvania Ave NW, Washington, DC 20037, USA, Washington, United States.
- How much does Who Watches the Bots? Observability, Testing, and Trust for Agentic AI with MLflow cost?
- Who Watches the Bots? Observability, Testing, and Trust for Agentic AI with MLflow is free to attend. Register on the event page to secure your spot.
- Who is organising Who Watches the Bots? Observability, Testing, and Trust for Agentic AI with MLflow?
- Who Watches the Bots? Observability, Testing, and Trust for Agentic AI with MLflow is organised by DC Data & AI Events. You can find more of their events on Rifio.
- How many people are attending Who Watches the Bots? Observability, Testing, and Trust for Agentic AI with MLflow?
- 25 people have registered so far out of 25 available spots.
- How do I register for Who Watches the Bots? Observability, Testing, and Trust for Agentic AI with MLflow?
- You can register for Who Watches the Bots? Observability, Testing, and Trust for Agentic AI with MLflow through the original event page on Luma. Click the "View on Luma" button above, or save it to your Rifio account to get reminders.
- How long is Who Watches the Bots? Observability, Testing, and Trust for Agentic AI with MLflow?
- Who Watches the Bots? Observability, Testing, and Trust for Agentic AI with MLflow runs for approximately 2 hours, from 10:00 PM to 12:00 AM (America/New_York).