AI infrastructure
Six Production Guardrails for Enterprise AI Applications on Kubernetes
Kubernetes is a strong runtime foundation, but production AI also needs controls for slow startup, uneven demand, streaming connections, credentials, telemetry and rollback. A prototype can look healthy with one developer, one ...
Write Access Is the Easy Part: The Verification Gap in Agentic Kubernetes Remediation
Giving an AI agent the power to change a cluster is now straightforward. Confirming the change landed, did not produce unintended duplicate effects and achieved the outcome the operator actually wanted is ...
Kubernetes Did Not Miss the AI Wave. It Absorbed It
Enterprise AI is settling onto the cloud native stack, and the strongest evidence is not a vendor roadmap. It is what the ecosystem has already standardized ...
Alan Shimel | | AI gateways, AI Inference, AI infrastructure, AI observability, AI operations, cloud native, cloud native AI, cncf, Dynamic Resource Allocation, enterprise AI, gateway API, generative AI, GPU scheduling, kubernetes, Kubernetes AI, Kueue, llm-d, model routing, model serving, platform engineering
Containers Became the Unit of Speed. AI Agents Are Making VMs the Unit of Trust
The container is not disappearing. But as autonomous agents generate code, install packages and invoke tools, cloud-native infrastructure is placing a VM-grade security boundary around it ...
Alan Shimel | | Agent Sandboxing, agent security, agentic AI, AI agents, AI infrastructure, autonomous agents, cloud native security, container security, containers, Docker Sandboxes, Firecracker, gVisor, Kata Containers, kubernetes, MCP security, MicroVMs, platform engineering, RuntimeClass, secure execution, virtualization, workload isolation, zero-trust
Autoscaling AI Workloads on Kubernetes With KEDA and What it Means for Agentic Systems
KEDA can scale Kubernetes AI workloads on real demand signals such as queue depth, helping model-serving and agent workloads respond faster while reducing idle compute costs ...
Kishor Patil | | agentic AI, AI agents, AI infrastructure, AI model serving, cloud native AI, devops, Event-Driven Autoscaling, horizontal pod autoscaling, HPA, inference scaling, KEDA, Kubernetes AI workloads, Kubernetes autoscaling, Kubernetes Event-Driven Autoscaling, platform engineering, Pub/Sub, queue depth, RabbitMQ, Redis, scale-to-zero, SQS
Kubeflow’s Graduation Is a Vote for Kubernetes as the AI Control Plane
Kubeflow’s CNCF graduation signals growing confidence in Kubernetes as a common control plane for production AI workloads, from training and pipelines to governance and inference ...
Alan Shimel | | agentic AI, AI infrastructure, AI lifecycle, AI platform, AI Workloads, cloud native AI, cncf, Distributed Training, enterprise AI, GPU scheduling, KServe, Kubeflow, Kubeflow graduation, Kubeflow Pipelines, Kubeflow Trainer, kubernetes, Kubernetes AI, MLOps, OpenTelemetry, platform engineering
Kubernetes Wasn’t Built for GPUs. Make It Behave
Kubernetes counts whole GPUs and treats pods as disposable. An LLM pod is neither. Share the silicon with MIG/MPS/time-slicing and stop paying for idle ...
Sneha Gullapalli | | A100, AI infrastructure, AI Workloads, cloud native AI, Dynamic Resource Allocation, GPU autoscaling, GPU cost reduction, GPU optimization, GPU partitioning, GPU sharing, GPU time-slicing, GPU utilization, H100, Karpenter, KServe, Kubernetes DRA, Kubernetes GPU scheduling, LLM Inference, model caching, multi-instance GPU, NVIDIA GPU Operator, NVIDIA MIG, NVIDIA MPS, scale-to-zero, VRAM
Stop Treating GPUs Like Web Pods
Kubernetes schedules accelerators as opaque integers, and your bill pays for it. Share the silicon, scale on the right signal and keep weights out of the image ...
Veera Ravindra Divi | | AI infrastructure, AI serving, autoscaling, cloud costs, cloud native AI, DCGM exporter, DRA, Dynamic Resource Allocation, GPU costs, GPU scheduling, GPU sharing, GPU utilization, GPUs, inference workloads, KEDA, kubernetes, Kubernetes GPU scheduling, LLM Inference, MIG, model weights, MPS, NVIDIA GPUs, NVIDIA MIG, Prometheus, scale-to-zero, time-slicing
NVIDIA Is Putting Real Skin in the Open AI Game
Open AI requires community-governed infrastructure and companies willing to contribute code, engineering and costly GPU cycles. NVIDIA is doing exactly that ...
The Foundation Was Already Poured
Techstrong's Experts Exchange this October, Cloud Native Now: The AI Stack, and this November's KubeCon in Salt Lake City are both making the same case for cloud native and AI. The argument ...
Alan Shimel | | agent governance, agent identity, agentic AI, AI agents, AI governance, AI infrastructure, AI security, AI stack, AI strategy, AI Workloads, cloud native, cloud native developers, cncf, enterprise AI, GPU scheduling, KubeCon, kubernetes, Kubernetes AI, MLOps, model serving, observability, platform engineering, sigstore, SLSA, software supply chain security

