In this session, Yaron Haviv, CTO Iguazio was joined by Ehud Barnea, PHD, Head of AI at Tasq.ai and Guy Lecker ML Engineering Team Lead, Iguazio to discuss how to validate, evaluate and fine tune an LLM effectively. They shared firsthand tips of how to solve the production hurdle of LLM evaluation, improving LLM performance, eliminating risks, along with a live demo of a fashion chatbot that leverages fine-tuning to significantly improve the model responses.

Iguazio would like to introduce two practical demonstrations showcasing our call center analysis tool and our innovative GenAI assistant. These demos illustrate how our GenAI assistant supports call center agents with real-time advice and recommendations during customer calls. This technology aims to improve customer interactions and boost call center efficiency. We're eager to share how our solutions can transform call center operations.

Many enterprises operate expansive call centers, employing thousands of representatives who provide support and consult with clients, often spanning various time zones and languages. However, the successful implementation of a gen AI-driven smart call center analysis applications presents unique challenges such as data privacy controls, potential biases, AI hallucinations, language translation and more.

Nuclio is a high-performance serverless framework focused on data, I/O, and compute intensive workloads. It is well integrated with popular data science tools, such as Jupyter and Kubeflow; supports a variety of data and streaming sources; and supports execution over CPUs and GPUs. The Nuclio project began in 2017 and is constantly and rapidly evolving; many start-ups and enterprises are now using Nuclio in production. In this video, Tomer takes you through a quick demo of Nuclio, triggering functions both from the UI and the CLI.