Istio Weaves ‘Future-Ready’ Service Mesh for AI
Istio manages traffic, security and observability between microservices through its use of a service mesh, a dedicated technology infrastructure layer designed to manage service-to-service communications, security and monitoring.
The company used its appearance at KubeCon + CloudNativeCon 2026 in Amsterdam, Netherlands to announce its ambient multi-cluster beta, Gateway API Inference Extension beta and experimental agentgateway support.
Terms Defined
There’s a lot there to unpack, so let’s go step-by-step. An ambient multi-cluster service is built to extend sidecar-less (a supporting process running alongside a primary application, or in this case, the absence of it) service mesh across clusters for unified security and traffic management.
Moving on, Gateway API Inference Extension technology works to standardize AI traffic management for Kubernetes clusters. And finally (for now), agentgateway (one word, not two) works as an AI-native proxy to secure and observe communication between agents, tools and models… and we can also note that agentgateway works as a component of the Istio data plane, the network of proxies used to manage all traffic between mesh services.
This bushel of new features is hoped to meet the rising needs of modern, AI-driven infrastructure.
CNCF Innovators & Explorers
The Cloud Native Computing Foundation’s (CNCF) Annual Cloud Native Survey found that 66% of organizations are running generative AI workloads on Kubernetes, yet only 7% achieve daily deployments for AI workloads. The data also suggests that developers with the highest propensity for innovation are nearly three times more likely than “explorers” to run service mesh in production, signaling that maturity in cloud native practices correlates with advanced traffic management and security adoption.
For completeness, let’s remind ourselves that the CNCF defines xplorers as organizations, teams or individuals in the early stages of cloud-native adoption; they are characterized by their experimental approach to application re-engineering.
As AI inference models increasingly run on Kubernetes clusters, projects such as Istio (arguably) have a role to play in securing, routing and observing that traffic.
Ambient Multicluster
New beta features, such as the simplified Ambient Multicluster service, are designed to eliminate the complexity that often impedes organizations from reaching daily deployment velocity for these critical AI workloads. For the record, an ambient multi-cluster approach is used to connect multiple clusters using shared node proxies and waypoint proxies (for “heavy lifting” such as traffic splitting, header routing and fault injection testing processes) for simplified networking.
Ambient Multicluster (beta): Ambient Multicluster extends Istio’s ambient mode to support traffic routing across multiple clusters without sidecars, simplifying the deployment and management of service mesh. The result is a simplified approach for teams running applications across regions or clouds for scale and resilience.
Simple, Right?
Istio says these updates reflect a broader shift toward platform engineering teams building guardrails and infrastructure needed to safely operate the rising demands of AI workloads.
“After nine years, Istio continues to evolve to meet users where they are and where they’re headed,” said Chris Aniszczyk, CTO, CNCF. “These new updates signal Istio’s commitment to being the service mesh of the future for agentic workloads and more.”
Istio’s latest updates are designed to meet the rising demands of AI workloads and simplify operations for all users.
Networking, Security & Observability
Together, these updates position Istio to support a shift already underway in cloud native environments. As AI workloads increasingly run on Kubernetes, service mesh technologies like Istio provide the networking, security and observability needed to manage that traffic at scale, supporting everything from model training and inference to agentic systems.
“Istio’s evolution reflects where cloud native infrastructure is headed,” said Keith Mattix, Istio maintainer. “Users want simpler multicluster operations and they want to run AI workloads with confidence. These releases deliver both while staying true to Istio’s roots.”
Experimental support for agentgateway, as part of the Istio data plane, reflects the community’s focus on exploring more flexible, lightweight traffic handling to keep pace with AI development.
Created by Solo.io and now a Linux Foundation project, agentgateway is designed to help manage dynamic AI-driven traffic patterns. Through this experimental integration, Istio aims to provide a foundation for emerging AI use cases while maintaining compatibility with existing service mesh deployments.
