KServe
Kubernetes Wasn’t Built for GPUs. Make It Behave
Kubernetes counts whole GPUs and treats pods as disposable. An LLM pod is neither. Share the silicon with MIG/MPS/time-slicing and stop paying for idle ...
Open Source KServe AI Inference Platform Becomes CNCF Project
The CNCF adopts KServe to strengthen cloud-native AI inference on Kubernetes as platforms like Red Hat OpenShift AI expand model-as-a-service capabilities ...
