Mastering LLM Chatbot Testing: Metrics, Methods and Mistakes to Avoid | James Massa | #Testflix 2024
In this session, James Massa, Senior Executive Director of Software Engineering and Architecture at JPMorgan Chase, dives into the critical elements of mastering LLM (Large Language Model) chatbot testing. As AI-driven chatbots take center stage in user interactions, even the slightest flaw in testing can result in significant, high-profile failures. James will guide you through the cutting-edge techniques used to rigorously test these advanced systems, ensuring optimal performance while helping you avoid common pitfalls that could derail your chatbot’s success.