HAMi logo

Kubernetes GPU virtualization and heterogeneous accelerator scheduling for AI infrastructure.

CNCF Incubating Releases build status codecov docker pulls LICENSE
OpenSSF Best Practices OpenSSF Scorecard FOSSA Status

slack discord website

English version | 中文版 | 日本語版

HAMi Architecture

HAMi stands for Heterogeneous AI Computing Virtualization Middleware. Formerly known as k8s-vGPU-scheduler, HAMi helps platform teams share expensive GPUs and other AI accelerators across Kubernetes workloads, isolate device memory and compute, and schedule pods with device-aware policies without changing application code.

HAMi is a CNCF Incubating and CNCF Landscape project. It is also listed in the CNAI Landscape.

CNCF logo

Documentation

Get started Configure and integrate Observe and maintain
Architecture Configuration and operations Device allocation metrics
GPU virtualization NVIDIA scheduling policies Device usage metrics
Supported devices and vendor guides NVIDIA dynamic MIG Grafana dashboards
Prerequisites Volcano integration WebUI
Install and run a first workload Kueue integration Upgrade and migrate values
Benchmarks Troubleshooting
Uninstall

Repository resources

Roadmap, Governance, and Contributing

Planned work for each release is tracked in the roadmap issues.

HAMi is governed by maintainers and contributors. Governance is described in the HAMi community repository.

To contribute code, documentation, tests, or device backend improvements, read CONTRIBUTING.md.

Community

License

HAMi is licensed under the Apache License 2.0. See LICENSE for details.

Copyright Contributors to HAMi, established as HAMi a Series of LF Projects, LLC.