Systems | Development | Analytics | API | Testing

Iguazio

Deploying Gen AI in Production with NVIDIA NIM and MLRun

Dec 17, 2024 By Iguazio In Iguazio
In this demo, we showcase how to leverage MLRun, Iguazio, and NVIDIA NIMs to deploy and monitor a generative AI model at scale, focusing on reducing risks and ensuring seamless performance. Using NVIDIA's NIMs, the demo demonstrates advanced methods in model monitoring, logging, and continuous fine-tuning.
View Video
iguazio

2025 Gen AI Predictions: What Lies Ahead?

Dec 17, 2024 By Yaron Haviv In Iguazio
In 2024, organizations realized the revolutionizing business potential of gen AI. They accelerated their gen AI operationalization processes: explored new use cases to implement, researched LLMs and AI pipelines and contemplated underlying ethical issues. And with the seeds of the AI revolution now planted, the market is maturing accordingly.
Read Post
iguazio

Choosing the Right-Sized LLM for Quality and Flexibility: Optimizing Your AI Toolkit

Dec 16, 2024 By Guy Lecker In Iguazio
LLMs are the foundation of gen AI applications. To effectively operationalize and de-risk LLMs and ensure they bring business value, organizations need to consider not just the model itself, but the supporting infrastructure, including GPUs and operational frameworks. By optimizing them to your use case, you can ensure you are using an LLM that is the right fit to your needs.
Read Post
iguazio

MLRun v1.7 Launched - Solidifying Generative AI Implementation and LLM Monitoring

Nov 1, 2024 By Gilad Shaham In Iguazio
As the open-source maintainers of MLRun, we’re proud to announce the release of MLRun v1.7. MLRun is an open-source AI orchestration tool that accelerates the deployment of gen AI applications, with features such as LLM monitoring, fine-tuning, data management, guardrails and more. We provide ready-made scenarios that can be easily implemented by teams in organizations.
Read Post
iguazio

Gen AI for Marketing - From Hype to Implementation

Oct 20, 2024 By Sahar Dolev-Blitental In Iguazio
Gen AI has the potential to bring immense value for marketing use cases, from content creation to hyper-personalization to product insights, and many more. But if you’re struggling to scale and operationalize gen AI, you’re not alone. That’s where most enterprises struggle. To date, many companies are still in the excitement and exploitation phase of gen AI. Few have a number of initial pilots deployed and even fewer have simultaneous pilots and are building differentiating use cases.
Read Post

Gen AI for Marketing - From Hype to Implementation - MLOps Live #32 with McKinsey and Iguazio

Sep 25, 2024 By Iguazio In Iguazio
In this MLOps Live session we were joined by Eli Stein, Partner and Modern Marketing Capabilities Leader at McKinsey, to delve into how data scientists can leverage generative AI to support the company’s marketing strategy. We showcased a live demo of a customer-facing AI agent developed for a jewelry retailer, which can be used as a marketing tool to offer personalized product recommendations and purchasing information and support. Following the demo, we held an interactive discussion and Q&A session. Enjoy!
View Video

Copyright © 2024 OpsMatters™. All rights reserved.