Systems | Development | Analytics | API | Testing

Kong's AI Gateway applies the same architectural pattern as the API Gateway — now governing LLM, MCP, and agent traffic at the infrastructure layer. Just as API gateways abstracted rate limiting, auth, and caching across microservices, AI gateways do the same for large language models and agents — with token budgets, semantic caching, and semantic routing replacing their REST equivalents. Kong breaks this into three layers: LLM Gateway, MCP Gateway for tool calls, and Agents Gateway for agent-to-agent traffic.#Shorts.

Zscaler's Tiffany Blakeney shares how her team replaced fragmented tools and months-long development cycles with Snowflake's all-in-one AI platform. By consolidating all data, APIs, and AI models in one secure platform, Zscaler reduced campaign creation from months to minutes—and more importantly, gained the trustworthy, governed AI foundation a cybersecurity company demands. Learn how they're using Snowflake's integrated AI capabilities to move from POC to production faster than ever while maintaining the security posture critical to their industry.

Most AI revenue will flow through tokens — and the two bottlenecks are tokens per watt (energy cost) and tokens per second (throughput). Tokens per watt determines how much output you can generate from a fixed energy supply — already constrained and getting tighter. Tokens per second sets the ceiling on how fast that revenue can flow. Kong's AI Gateway optimizes both at the connectivity layer: semantic caching and semantic routing increase token output without adding watts or latency.#Shorts.