D365 FastTrack Agent Evaluation Series Part 1: Foundations & Evaluation Fundamentals for Agentic AI
This video introduces Microsoft’s Agent Evaluation Framework designed to address the complexities of testing AI agents in Dynamics 365. It explains why traditional testing methods are insufficient for non-deterministic AI and highlights how structured evaluation ensures quality, safety, and alignment with business goals. Key elements covered include the framework’s principles, evaluation lifecycle, the design document, and responsible AI checkpoints. The session also delves into five quality dimensions—correctness, safety, reliability, alignment, and efficiency—and outlines various evaluation methods and patterns. The video concludes with key takeaways and suggested next steps for implementing these practices effectively.
Video 4w
Login now to access my digest by 365.Training
Learn how my digest works
Features
- Articles, blogs, podcasts, training, and videos
- Quick read TL;DRs for each item
- Advanced filtering to prioritize what you care about
- Quick views to isolate what you are looking for right now
- Save your favorite items
- Share your favorites
- Snooze items you want to revisit when you have more time