inference perf project

Docker, AI, GenAI, Kubernetes, docker, ai, cloud-native AI Carbon Relay

Evolving Kubernetes and GKE for Gen AI Inference

The combination of foundational improvements in open-source Kubernetes and powerful, managed solutions on GKE represents a significant leap forward for any organization working with generative AI ...

Akshay Ram | June 19, 2025 | AI aware load balancing, AI aware routing, benchmark database, cloud-native applications, community driven effort, container orchestration, data driven decisions, developer velocity, Evolving Kubernetes, Gen AI inference, GKE, GKE features, GKE Inference Quickstart, GPUs, Inference Gateway, inference perf project, intelligent scheduling, Kubernetes primitives, KV cache utilization, large models, latency vs throughput curves, microservices, model replica routing, open source Kubernetes, request response patterns, scaling, seamless portability, specialized hardware, standardized benchmarking, tail latency reduction, throughput increase, total cost of ownership, TPU serving stack, TPUs, user experience, vLLM library

Techstrong TV

Click full-screen to enable volume control

Watch latest episodes and shows

Tech Field Day Events

UPCOMING WEBINARS

CloudNativeNow.com
Error
SecurityBoulevard.com

Secure AI Everywhere: From Edge to Container

18 December 2025

RSS Error: A feed could not be found at `https://devops.com/webinars/feed/`; the status code is `403` and content-type is `text/html; charset=UTF-8`

Safeguarding Data & Compliance on Next-Gen iOS Devices

16 December 2025

Thoropass

11 December 2025

The Next Evolution of Application Security: AI-Accelerated DevSecOps

9 December 2025

Podcast

Listen to all of our podcasts

Press Releases

ThreatHunter.ai Halts Hundreds of Attacks in the past 48 hours: Combating Ransomware and Nation-State Cyber Threats Head-On

Deloitte Partners with Memcyco to Combat ATO and Other Online Attacks with Real-Time Digital Impersonation Protection Solutions

SUBSCRIBE TO CNN NEWSLETTER

BellSoft’s 3-in-1 Strategy for Container Security

November 11, 2025 Jeff Burt 0

Features Service Mesh Social - Facebook Social - LinkedIn Social - X Uncategorized

Buoyant to Add MCP Support to Linkerd Service Mesh

November 10, 2025 Mike Vizard 0

Features KubeCon + CloudNativeCon North America 2025 Social - Facebook Social - LinkedIn Social - X

Devtron Adds AI Agents to SRE Platform for Kubernetes Environments

November 10, 2025 Mike Vizard 0

Cloud-Native Platforms Social - Facebook Social - LinkedIn Social - X Sponsored Content

VCF and Ubuntu Join Forces to Ease Friction in Private Cloud Development

November 10, 2025 Guy Currier 0

Cloud-Native Platforms Social - Facebook Social - LinkedIn Social - X Sponsored Content

Faster Innovation, Longer Support and Simpler Operations: New VMware vSphere Kubernetes Service 3.5

November 10, 2025 Pankaj Gupta 0

inference perf project

ThreatHunter.ai Halts Hundreds of Attacks in the past 48 hours: Combating Ransomware and Nation-State Cyber Threats Head-On

Deloitte Partners with Memcyco to Combat ATO and Other Online Attacks with Real-Time Digital Impersonation Protection Solutions

Sidero Labs to Extend Scope of Talos Linux Platform for Kubernetes

Why Docker Matters for Data Science

Kubernetes or Chaos: The Risks of Running AI Workloads Without Orchestration

AI Agents Power Cloud-Native Transformation

Komodor Extends Autonomous AI Agent for Optimizing Kubernetes Clusters