container orchestration

Evolving Kubernetes and GKE for Gen AI Inference
The combination of foundational improvements in open-source Kubernetes and powerful, managed solutions on GKE represents a significant leap forward for any organization working with generative AI ...
Akshay Ram | | AI aware load balancing, AI aware routing, benchmark database, cloud-native applications, community driven effort, container orchestration, data driven decisions, developer velocity, Evolving Kubernetes, Gen AI inference, GKE, GKE features, GKE Inference Quickstart, GPUs, Inference Gateway, inference perf project, intelligent scheduling, Kubernetes primitives, KV cache utilization, large models, latency vs throughput curves, microservices, model replica routing, open source Kubernetes, request response patterns, scaling, seamless portability, specialized hardware, standardized benchmarking, tail latency reduction, throughput increase, total cost of ownership, TPU serving stack, TPUs, user experience, vLLM library

Why Multi-Cloud Strategies Might Be Overrated for Startups
While multi-cloud strategies might be right for some organizations, they are not a prerequisite for success. In fact, for many startups, they are a distraction from what really matters: Building great products ...

The Best Kubernetes Tools for 2024
To aid developers, these Kubernetes tools are specifically designed to enhance productivity and streamline development workflows ...

Best of 2023: Using Airflow to Run Spark on Kubernetes
Here's how to set up a Spark application on Kubernetes using the Airflow scheduler for data-intensive workloads ...

Upbound Extends Reach of Crossplane Control Plane Service
Upbound's new version of Crossplane will make it simpler for IT teams to deploy the control plane across a hybrid cloud computing environment ...

Cloud-Native Security and the Risks of AI
Kubernetes security as it applies to AI involves no shortage of challenges and risks to overcome ...

Containers Vs. Virtual Machines: Why the Paradigm Shift Matters
Why are organizations migrating from virtual machines (VMs) to containers? DH2i's Don Boxley explains ...

Cosmonic Open Source Project Integrates Nomad and Cilium
Cosmonic has launched an open source Netreap project to integrate Nomad, an alternative for orchestrating containers from Hashicorp, with the Cilium networking overlay for cloud-native applications created by Isovalent. Dan Norris, head ...

Study Finds Kubernetes Usage Tied to Business Success
In 2023, cloud-native technologies are becoming the norm for modern software development. And new data showed that cloud-native platforms like Kubernetes are transforming how businesses operate for the better. Kubernetes is bringing ...

Kubernetes v1.27 Update Brings Chill Vibes
Kubernetes v1.27, the first K8s release of 2023, has been announced. The v1.27 release includes 60 enhancements, 18 of which are alpha, 29 are beta and 13 are stable at the time ...