Kubernetes
Prompt Injection in Cloud-Native AI Is Now an Access Control Problem
For a long time, prompt injection was treated like other model behavior problems, such as jailbreaks or strange responses. The usual fix was to improve the system prompt, add stronger filters, or ...
Autoscaling AI Workloads on Kubernetes With KEDA and What it Means for Agentic Systems
KEDA can scale Kubernetes AI workloads on real demand signals such as queue depth, helping model-serving and agent workloads respond faster while reducing idle compute costs ...
Kishor Patil | | agentic AI, AI agents, AI infrastructure, AI model serving, cloud native AI, devops, Event-Driven Autoscaling, horizontal pod autoscaling, HPA, inference scaling, KEDA, Kubernetes AI workloads, Kubernetes autoscaling, Kubernetes Event-Driven Autoscaling, platform engineering, Pub/Sub, queue depth, RabbitMQ, Redis, scale-to-zero, SQS
When Kubernetes Meets Real Data Center Networking: Building a Routable, Resilient On-Prem Cluster with BGP and ECMP
A routable on-prem Kubernetes design using BGP, ECMP and BFD can reduce NAT and overlay complexity, improve failure recovery and make packet paths far easier to troubleshoot ...
Sergey Speranskiy | | BFD, BGP, BIRD routing daemon, control plane resilience, data center networking, eBGP, ECMP, IPVS, kube-router, Kubernetes CNI, Kubernetes high availability, Kubernetes networking, Kubernetes observability, Kubernetes routing, NAT, network troubleshooting, on-prem Kubernetes, pod CIDR, pod networking, routable Kubernetes, ToR switches, VXLAN
Red Hat Readies an MCP Server to Help LLMs Manage Kubernetes
Red Hat is building an open source MCP server extension to help developers and administrators manage Kubernetes and Red Hat’s own OpenShift Kubernetes distribution. The extension can help AI assistants like Visual ...
Kubeflow’s Graduation Is a Vote for Kubernetes as the AI Control Plane
Kubeflow’s CNCF graduation signals growing confidence in Kubernetes as a common control plane for production AI workloads, from training and pipelines to governance and inference ...
Alan Shimel | | agentic AI, AI infrastructure, AI lifecycle, AI platform, AI Workloads, cloud native AI, cncf, Distributed Training, enterprise AI, GPU scheduling, KServe, Kubeflow, Kubeflow graduation, Kubeflow Pipelines, Kubeflow Trainer, kubernetes, Kubernetes AI, MLOps, OpenTelemetry, platform engineering
CNCF Graduates Kubeflow for Production AI on Kubernetes
The Cloud Native Computing Foundation has graduated Kubeflow, giving the open source AI and machine learning platform CNCF’s highest maturity designation as enterprises move more AI workloads into production. Kubeflow runs on ...
How We Cut Kubernetes Deployment Validation From 45 Minutes to 2 minutes
There is a moment every release engineer knows well. The CI/CD pipeline turns green. The deployment job reports success. Everyone exhales for a second and thinks, “Okay, the release is done.” But ...
Kubernetes Wasn’t Built for GPUs. Make It Behave
Kubernetes counts whole GPUs and treats pods as disposable. An LLM pod is neither. Share the silicon with MIG/MPS/time-slicing and stop paying for idle ...
Sneha Gullapalli | | A100, AI infrastructure, AI Workloads, cloud native AI, Dynamic Resource Allocation, GPU autoscaling, GPU cost reduction, GPU optimization, GPU partitioning, GPU sharing, GPU time-slicing, GPU utilization, H100, Karpenter, KServe, Kubernetes DRA, Kubernetes GPU scheduling, LLM Inference, model caching, multi-instance GPU, NVIDIA GPU Operator, NVIDIA MIG, NVIDIA MPS, scale-to-zero, VRAM
Stop Treating GPUs Like Web Pods
Kubernetes schedules accelerators as opaque integers, and your bill pays for it. Share the silicon, scale on the right signal and keep weights out of the image ...
Veera Ravindra Divi | | AI infrastructure, AI serving, autoscaling, cloud costs, cloud native AI, DCGM exporter, DRA, Dynamic Resource Allocation, GPU costs, GPU scheduling, GPU sharing, GPU utilization, GPUs, inference workloads, KEDA, kubernetes, Kubernetes GPU scheduling, LLM Inference, MIG, model weights, MPS, NVIDIA GPUs, NVIDIA MIG, Prometheus, scale-to-zero, time-slicing
A Green Kubernetes Deployment Does Not Mean a Healthy Application
The deployment finishes, kubectl rollout status reports success, and every pod shows Running and Ready. For most teams, that is the moment the release is considered done. Then a customer transaction fails ...

