Skip to main content

14 posts tagged with "GPU"

View All Tags

KubeCon China 2026 Recap: Keynotes, a Lightning Talk, and a Case Study Award

· 6 min read
HAMi Community

KubeCon + CloudNativeCon + OpenInfra Summit + PyTorch Conference China 2026 wrapped up on September 9 at the Shanghai International Convention Center. It was HAMi's first KubeCon China since the project moved to CNCF Incubating, and the community brought two keynotes, a lightning talk, a production session, a booth, and a case study award for China Merchants Bank announced from the keynote stage.

Slides for all four talks are available on the KubeCon China 2026 event page.

Composable GPU Scheduling Policies: How mutex, binpack, spread, and numa Work Together

· 9 min read

HAMi has always offered per-Pod GPU scheduling policies through the hami.io/gpu-scheduler-policy annotation: binpack to pack workloads onto as few cards as possible, spread to distribute them, mutex (new in v2.10.0) to demand an exclusive card. Until now, the annotation accepted exactly one value.

Real clusters rarely want just one behavior at a time. A typical production wish list looks like this: pack inference replicas tightly to leave whole cards free, but keep each Pod's GPUs on the same NUMA node for bandwidth, and give the latency-critical tier cards of its own. That is three policies in a single sentence. Before v2.10.0 you had to pick one and give up the rest.

v2.10.0 closes this gap: hami.io/gpu-scheduler-policy now accepts an ordered, comma-separated list of policies, so filter-style and sort-style policies compose (#2621, @mesutoezdil, closes #2010). This post explains how the combination actually works, and how to adopt and verify it. If you prefer to learn by doing, the companion Lab 14: Composable GPU Scheduling Policies on GKE walks through every scenario below on a real cluster.

HAMi at KubeCon China 2026: Two Keynotes, Two Talks, and a Booth in Shanghai

· 5 min read
HAMi Community

From September 7 to 9, KubeCon + CloudNativeCon + OpenInfra Summit + PyTorch Conference China 2026 will take place at the Shanghai International Convention Center. This will be HAMi's first KubeCon China appearance since the project was accepted as a CNCF Incubating project in July.

The HAMi community is bringing two keynotes, a lightning talk, a technical session, and a project booth to the show: from PD-disaggregated heterogeneous inference deployment, to dynamic MIG partitioning in five minutes, to a production story of GPU virtualization at thousand-GPU scale. If you are attending, come say hi.

HAMi v2.10.0 Release: Flexible MIG, Composable Scheduling, and an Expanded Accelerator Ecosystem

· 14 min read
HAMi Community

The HAMi community is proud to announce the official release of HAMi v2.10.0. This release advances HAMi on three fronts: more flexible scheduling policies, broader heterogeneous accelerator coverage, and a richer scheduler ecosystem.

v2.10.0 introduces dynamic Flexible MIG, a new mutex scheduling policy, a long-requested NUMA-aware sort fix, composable scheduler policies, gang-scheduling (PodGroup) support, and correct init-container resource accounting. On the device side it adds AMD MI300X and Biren support, heterogeneous Ascend management that lets template-based vNPU and HAMi-core nodes coexist in one cluster, and vNPU HAMi-core monitoring. It also debuts a KAI Scheduler + HAMi-core integration through the new KAI Resource Isolator companion project.

This article walks through the major updates in v2.10.0.

HAMi at KubeCon + CloudNativeCon India 2026: Bringing GPU Sharing to the Community

· 6 min read
HAMi Community

Held on June 18-19, 2026, in Mumbai, India, KubeCon + CloudNativeCon India 2026 brought together cloud native practitioners, platform engineers, AI infrastructure teams, and open source contributors from across the ecosystem. As AI emerged as one of the conference's defining themes, HAMi showcased how Kubernetes-native GPU sharing helps organizations maximize accelerator utilization while maintaining workload isolation and operational flexibility.

From the opening keynote to live booth demonstrations and technical discussions with engineering teams, the event highlighted a growing industry focus: making expensive GPU infrastructure practical for multi-tenant AI workloads.

HAMi v2.9.0 Release: Ascend User-Space Partitioning, DRA Generally Available, and Scheduler Ecosystem Expansion

· 12 min read
HAMi Community

The HAMi community is proud to announce the official release of HAMi v2.9.0. This represents a milestone version in terms of heterogeneous device virtualization depth, scheduler ecosystem expansion, and Kubernetes native standards alignment.

v2.9.0 introduces the Ascend 910C HAMi-core mode, HAMi-DRA general availability, and Volcano vGPU upgrade to v0.19, along with systematic enhancements in observability, security, and stability. This release also welcomes 19 new contributors for the first time.

This article provides a detailed overview of the major updates in v2.9.0.

Introducing HAMi WebUI: GPU Monitoring Dashboard for Kubernetes

· 6 min read
HAMi Community

Managing GPU resources in Kubernetes has long been a "blind spot" for operators. You know GPUs are being used, but answering questions like "which node has idle capacity?", "is this workload actually utilizing its allocated GPU?", or "what is the overall cluster utilization trend?" often requires piecing together kubectl get, Prometheus PromQL, and log output.

Today, the HAMi community is introducing HAMi WebUI - an open-source GPU monitoring dashboard that puts your entire GPU cluster into a single, visual interface.

HAMi WebUI v1.1.0 is now available as the first official major release.

Together with the core HAMi scheduler, WebUI completes the full loop: from GPU scheduling to visual observability.

CNCFHAMi is a CNCF Incubating project