Skip to main content

2 posts tagged with "vLLM"

View All Tags

HAMi v2.11 Remote GPU in Practice: Run CUDA Anywhere

· 17 min read

HAMi v2.11.0 introduces Remote GPU access, allowing CPU-only machines to use GPUs on other machines. CUDA workloads and GPU resources can now run on separate nodes.

Running CUDA or vLLM on Kubernetes usually means scheduling the Pod onto a GPU node. With Remote GPU, the Pod can run on a separate CPU node and use a GPU Server over the network. The client needs neither a local GPU nor an NVIDIA driver.

Are You Making Good Use of Your Compute? Three Stages of vLLM Inference Cluster Optimization

· 11 min read
HAMi Maintainer, Co-founder & CTO of Dynamia

Three Stages of vLLM Inference Cluster Optimization | Li Mengxuan

On July 16, 2026, Li Mengxuan, Co-founder & CTO of Dynamia and HAMi author, delivered a technical talk on vLLM deployment and compute optimization at vLLM Meetup. Built around one pointed question, "Are you making good use of your compute?", the talk laid out a complete evolution path for vLLM inference clusters, from "getting it to run" to "squeezing the hardware dry", broken down into three clear stages.

This recap walks through the talk slide by slide, combining the deck with the on-site Q&A notes.

CNCFHAMi is a CNCF Incubating project