Try Kong AI Gateway: https://bit.ly/3xhKw49

00:00 Introduction

00:57 How Kong's AI Gateway Simplifies AI Application Development

02:24 Architecture of AI Gateway

03:02 Support for various LLM providers

04:48 Centralized LLM management

05:39 Prompt management

06:41 Request and response transformers

07:11 Upcoming Features

07:38 Semantic caching

08:35 Semantic routing

09:20 Semantic firewalling

10:32 Future Vision: Kong Large Action Model (KLAM)

11:40 Conclusion

In this session, Marco Palladino, CTO and co-founder of Kong, discusses the importance of AI gateways in supporting the growing demand for AI and API usage. He explains how Kong's AI Gateway simplifies the creation of AI applications by providing a unified infrastructure layer that abstracts common requirements, such as authentication, authorization, traffic control, and observability.