AI infrastructure
Containers Became the Unit of Speed. AI Agents Are Making VMs the Unit of Trust
The container is not disappearing. But as autonomous agents generate code, install packages and invoke tools, cloud-native infrastructure is placing a VM-grade security boundary around it ...
Alan Shimel | | Agent Sandboxing, agent security, agentic AI, AI agents, AI infrastructure, autonomous agents, cloud native security, container security, containers, Docker Sandboxes, Firecracker, gVisor, Kata Containers, kubernetes, MCP security, MicroVMs, platform engineering, RuntimeClass, secure execution, virtualization, workload isolation, zero-trust
Autoscaling AI Workloads on Kubernetes With KEDA and What it Means for Agentic Systems
KEDA can scale Kubernetes AI workloads on real demand signals such as queue depth, helping model-serving and agent workloads respond faster while reducing idle compute costs ...
Kishor Patil | | agentic AI, AI agents, AI infrastructure, AI model serving, cloud native AI, devops, Event-Driven Autoscaling, horizontal pod autoscaling, HPA, inference scaling, KEDA, Kubernetes AI workloads, Kubernetes autoscaling, Kubernetes Event-Driven Autoscaling, platform engineering, Pub/Sub, queue depth, RabbitMQ, Redis, scale-to-zero, SQS
Kubeflow’s Graduation Is a Vote for Kubernetes as the AI Control Plane
Kubeflow’s CNCF graduation signals growing confidence in Kubernetes as a common control plane for production AI workloads, from training and pipelines to governance and inference ...
Alan Shimel | | agentic AI, AI infrastructure, AI lifecycle, AI platform, AI Workloads, cloud native AI, cncf, Distributed Training, enterprise AI, GPU scheduling, KServe, Kubeflow, Kubeflow graduation, Kubeflow Pipelines, Kubeflow Trainer, kubernetes, Kubernetes AI, MLOps, OpenTelemetry, platform engineering
Kubernetes Wasn’t Built for GPUs. Make It Behave
Kubernetes counts whole GPUs and treats pods as disposable. An LLM pod is neither. Share the silicon with MIG/MPS/time-slicing and stop paying for idle ...
Sneha Gullapalli | | A100, AI infrastructure, AI Workloads, cloud native AI, Dynamic Resource Allocation, GPU autoscaling, GPU cost reduction, GPU optimization, GPU partitioning, GPU sharing, GPU time-slicing, GPU utilization, H100, Karpenter, KServe, Kubernetes DRA, Kubernetes GPU scheduling, LLM Inference, model caching, multi-instance GPU, NVIDIA GPU Operator, NVIDIA MIG, NVIDIA MPS, scale-to-zero, VRAM
Stop Treating GPUs Like Web Pods
Kubernetes schedules accelerators as opaque integers, and your bill pays for it. Share the silicon, scale on the right signal and keep weights out of the image ...
Veera Ravindra Divi | | AI infrastructure, AI serving, autoscaling, cloud costs, cloud native AI, DCGM exporter, DRA, Dynamic Resource Allocation, GPU costs, GPU scheduling, GPU sharing, GPU utilization, GPUs, inference workloads, KEDA, kubernetes, Kubernetes GPU scheduling, LLM Inference, MIG, model weights, MPS, NVIDIA GPUs, NVIDIA MIG, Prometheus, scale-to-zero, time-slicing
NVIDIA Is Putting Real Skin in the Open AI Game
Open AI requires community-governed infrastructure and companies willing to contribute code, engineering and costly GPU cycles. NVIDIA is doing exactly that ...
The Foundation Was Already Poured
Techstrong's Experts Exchange this October, Cloud Native Now: The AI Stack, and this November's KubeCon in Salt Lake City are both making the same case for cloud native and AI. The argument ...
Alan Shimel | | agent governance, agent identity, agentic AI, AI agents, AI governance, AI infrastructure, AI security, AI stack, AI strategy, AI Workloads, cloud native, cloud native developers, cncf, enterprise AI, GPU scheduling, KubeCon, kubernetes, Kubernetes AI, MLOps, model serving, observability, platform engineering, sigstore, SLSA, software supply chain security
Beyond the Model: Why AI Agent Orchestration Requires Cloud-Native Engineering
AI agent orchestration is a distributed systems challenge. Cloud-native engineering provides the resilience, observability, security and scalability needed for production AI ...
Nithiya Dharshini | | agent communication, agentic AI infrastructure, AI agent orchestration, AI governance, AI infrastructure, AI observability, AI scalability, AI security, AI workflow monitoring, AI workload management, automated scaling, cloud native AI, cloud-native engineering, containerized AI services, distributed AI systems, distributed tracing, enterprise AI agents, event-driven architecture, GitOps, Kubernetes for AI, multi-agent systems, platform engineering, production AI systems, resilient AI systems
Your Model Works in the Notebook and Breaks in the Cluster
A model working in a notebook gives you a particular kind of confidence. The metrics look good, the code runs top to bottom, the researcher demos it, leadership nods, and everyone agrees ...
GitOps Wasn’t Built for Models, and It Shows
GitOps won the deployment argument. Everything goes in Git, the cluster reconciles itself to match, and your repository becomes the one place that tells you what’s actually running. It’s clean and auditable ...

