seamless portability

Docker, AI, GenAI, Kubernetes, docker, ai, cloud-native AI Carbon Relay

Evolving Kubernetes and GKE for Gen AI Inference

The combination of foundational improvements in open-source Kubernetes and powerful, managed solutions on GKE represents a significant leap forward for any organization working with generative AI ...

Akshay Ram | June 19, 2025 | AI aware load balancing, AI aware routing, benchmark database, cloud-native applications, community driven effort, container orchestration, data driven decisions, developer velocity, Evolving Kubernetes, Gen AI inference, GKE, GKE features, GKE Inference Quickstart, GPUs, Inference Gateway, inference perf project, intelligent scheduling, Kubernetes primitives, KV cache utilization, large models, latency vs throughput curves, microservices, model replica routing, open source Kubernetes, request response patterns, scaling, seamless portability, specialized hardware, standardized benchmarking, tail latency reduction, throughput increase, total cost of ownership, TPU serving stack, TPUs, user experience, vLLM library

Techstrong TV

Click full-screen to enable volume control

Watch latest episodes and shows

Tech Field Day Events

UPCOMING WEBINARS

CloudNativeNow.com
Error
Error

Big Risks, Engineering Bottlenecks, and AI

23 October 2025

RSS Error: A feed could not be found at `https://devops.com/webinars/feed/`; the status code is `403` and content-type is `text/html; charset=UTF-8`

RSS Error: A feed could not be found at `https://securityboulevard.com/webinars/feed/`; the status code is `403` and content-type is `text/html; charset=UTF-8`