From b10571be155f58815ecadfcdea26603040fba99e Mon Sep 17 00:00:00 2001 From: tjtanaa Date: Sun, 29 Mar 2026 07:28:44 +0000 Subject: [PATCH 01/11] update the ROCm wheel doc Signed-off-by: tjtanaa --- .../installation/gpu.rocm.inc.md | 116 +++++++++++++++++- 1 file changed, 112 insertions(+), 4 deletions(-) diff --git a/docs/getting_started/installation/gpu.rocm.inc.md b/docs/getting_started/installation/gpu.rocm.inc.md index 101ab9d56119..093fb79b5146 100644 --- a/docs/getting_started/installation/gpu.rocm.inc.md +++ b/docs/getting_started/installation/gpu.rocm.inc.md @@ -1,7 +1,12 @@ --8<-- [start:installation] -vLLM supports AMD GPUs with ROCm 6.3 or above. Pre-built wheels are available for ROCm 7.0. +vLLM supports AMD GPUs with ROCm 6.3 or above. Pre-built wheels are available for ROCm 7.0 and ROCm 7.2.1. + +List of release wheels: + +- ROCm Variant: `rocm700` (Python 3.12, ROCm 7.0 and `glibc >= 2.35`) is supported from version `0.14.0` to `0.18.0`. +- ROCm Variant: `rocm721` (Python 3.12, ROCm 7.2.1 and `glibc >= 2.35`) is supported since nightly releases after commit `171775f306a333a9cf105bfd533bf3e113d401d9` --8<-- [end:installation] --8<-- [start:requirements] @@ -29,20 +34,105 @@ uv pip install vllm --extra-index-url https://wheels.vllm.ai/rocm/ !!! tip You can find out about which ROCm version the latest vLLM supports by checking the index in extra-index-url [https://wheels.vllm.ai/rocm/](https://wheels.vllm.ai/rocm/) . + Another approach is that you can use this following commands to automatically extract the wheel variants: + + ```bash + # automatically extract the available rocm variant + export VLLM_ROCM_VARIANT=$(curl -s https://wheels.vllm.ai/rocm/ | \ + grep -oP 'rocm\d+' | head -1 | sed 's/%2B/+/g') + + # inspect if the ROCm version is compatible with your environment + echo $VLLM_ROCM_VARIANT + ``` + To install a specific version and ROCm variant of vLLM wheel. ```bash -uv pip install vllm --extra-index-url https://wheels.vllm.ai/rocm/0.15.0/rocm700 +# version without the `v` +uv pip install vllm==${VLLM_VERSION} --extra-index-url https://wheels.vllm.ai/rocm/${VLLM_VERSION}/${VLLM_ROCM_VARIANT} + +# Example +uv pip install vllm==0.18.0 --extra-index-url https://wheels.vllm.ai/rocm/0.18.0/rocm700 ``` !!! warning "Caveats for using `pip`" We recommend leveraging `uv` to install vLLM wheel. Using `pip` to install from custom indices is cumbersome, because `pip` combines packages from `--extra-index-url` and the default index, choosing only the latest version, which makes it difficult to install wheel from custom index if exact versions of all packages are specified exactly. In contrast, `uv` gives the extra index [higher priority than the default index](https://docs.astral.sh/uv/pip/compatibility/#packages-that-exist-on-multiple-indexes). - If you insist on using `pip`, you have to specify the exact vLLM version and full URL of the wheel path `https://wheels.vllm.ai/rocm//` (which can be obtained from the web page). + If you insist on using `pip`, you have to specify the exact vLLM version and full URL of the wheel path `https://wheels.vllm.ai/rocm/${VLLM_VERSION}/${VLLM_ROCM_VARIANT}` (which can be obtained from the web page). + + ```bash + pip install vllm==0.18.0+rocm700 --extra-index-url https://wheels.vllm.ai/rocm/0.18.0/rocm700 + ``` + +#### Install the latest code + +LLM inference is a fast-evolving field, and the latest code may contain bug fixes, performance improvements, and new features that are not released yet. To allow users to try the latest code without waiting for the next release, vLLM provides wheels for every commit since `v0.18.1` on . The indices can be used is + +- `https://wheels.vllm.ai/rocm/nightly/${VLLM_ROCM_VARIANT}` + +The first ROCm Variant that supports nightly wheel is ROCm 7.2.1 + +To install from latest nightly index, run: + +```bash +# automatically extract the available rocm variant +export VLLM_ROCM_VARIANT=$(curl -s https://wheels.vllm.ai/rocm/nightly | \ +grep -oP 'rocm\d+' | head -1 | sed 's/%2B/+/g') + +# inspect if the ROCm version is compatible with your environment +echo $VLLM_ROCM_VARIANT + +uv pip install --pre vllm \ + --extra-index-url https://wheels.vllm.ai/rocm/nightly/${VLLM_ROCM_VARIANT} \ + --index-strategy unsafe-best-match \ + --upgrade +``` + + +##### Install specific revisions + +If you want to access the wheels for previous commits (e.g. to bisect the behavior change, performance regression), you can specify the commit hash in the URL: + +```bash +export VLLM_COMMIT=5b8c30d62b754b575e043ce2fc0dcbf8a64f6306 + +export VLLM_ROCM_VARIANT=$(curl -s https://wheels.vllm.ai/rocm/${VLLM_COMMIT} | \ +grep -oP 'rocm\d+' | head -1 | sed 's/%2B/+/g') + +# Extract the version from the wheel URL +export VLLM_VERSION=$(curl -s https://wheels.vllm.ai/rocm/${VLLM_COMMIT}/${VLLM_ROCM_VARIANT}/vllm/ | \ +grep -oP 'vllm-\K[^-]+' | head -1 | sed 's/%2B/+/g') + +# inspect the version if it is compatible with the ROCm version of your environment +echo $VLLM_VERSION + +uv pip install vllm==${VLLM_VERSION} \ + --extra-index-url https://wheels.vllm.ai/rocm/${VLLM_COMMIT}/${VLLM_ROCM_VARIANT} \ + --index-strategy unsafe-best-match +``` + +!!! warning "`pip` caveat" + + Using `pip` to install from nightly indices is _not supported_, because `pip` combines packages from `--extra-index-url` and the default index, choosing only the latest version, which makes it difficult to install a development version prior to the released version. In contrast, `uv` gives the extra index [higher priority than the default index](https://docs.astral.sh/uv/pip/compatibility/#packages-that-exist-on-multiple-indexes). + + If you insist on using `pip`, you have to specify the full URL of the wheel file (which can be obtained from the web page). ```bash - pip install vllm==0.15.0+rocm700 --extra-index-url https://wheels.vllm.ai/rocm/0.15.0/rocm700 + export VLLM_COMMIT=5b8c30d62b754b575e043ce2fc0dcbf8a64f6306 + + export VLLM_ROCM_VARIANT=$(curl -s https://wheels.vllm.ai/rocm/${VLLM_COMMIT} | \ + grep -oP 'rocm\d+' | head -1 | sed 's/%2B/+/g') + + # Extract the version from the wheel URL + export VLLM_VERSION=$(curl -s https://wheels.vllm.ai/rocm/${VLLM_COMMIT}/${VLLM_ROCM_VARIANT}/vllm/ | \ + grep -oP 'vllm-\K[^-]+' | head -1 | sed 's/%2B/+/g') + + # inspect the version if it is compatible with the ROCm version of your environment + echo $VLLM_VERSION + + pip install vllm==${VLLM_VERSION} \ + --extra-index-url https://wheels.vllm.ai/rocm/${VLLM_COMMIT}/${VLLM_ROCM_VARIANT} ``` --8<-- [end:pre-built-wheels] @@ -193,6 +283,24 @@ docker run --rm \ --model Qwen/Qwen3-0.6B ``` +To use the docker image as base for development, you can launch it in interactive session through overriding the entrypoint. + +???+ console "Commands" + ```bash + docker run --rm -it \ + --group-add=video \ + --cap-add=SYS_PTRACE \ + --security-opt seccomp=unconfined \ + --device /dev/kfd \ + --device /dev/dri \ + -v ~/.cache/huggingface:/root/.cache/huggingface \ + --env "HF_TOKEN=$HF_TOKEN" \ + --network=host \ + --ipc=host \ + --entrypoint /bin/bash \ + vllm/vllm-openai-rocm: + ``` + #### Use AMD's Docker Images (Deprecated) !!! warning "Deprecated" From 27a94346aac583e8becc92a5b083a991ba3d1287 Mon Sep 17 00:00:00 2001 From: tjtanaa Date: Sun, 29 Mar 2026 07:55:12 +0000 Subject: [PATCH 02/11] fix desciption Signed-off-by: tjtanaa --- docs/getting_started/installation/gpu.rocm.inc.md | 5 ++--- 1 file changed, 2 insertions(+), 3 deletions(-) diff --git a/docs/getting_started/installation/gpu.rocm.inc.md b/docs/getting_started/installation/gpu.rocm.inc.md index 093fb79b5146..076b083ac2e7 100644 --- a/docs/getting_started/installation/gpu.rocm.inc.md +++ b/docs/getting_started/installation/gpu.rocm.inc.md @@ -57,9 +57,9 @@ uv pip install vllm==0.18.0 --extra-index-url https://wheels.vllm.ai/rocm/0.18.0 !!! warning "Caveats for using `pip`" - We recommend leveraging `uv` to install vLLM wheel. Using `pip` to install from custom indices is cumbersome, because `pip` combines packages from `--extra-index-url` and the default index, choosing only the latest version, which makes it difficult to install wheel from custom index if exact versions of all packages are specified exactly. In contrast, `uv` gives the extra index [higher priority than the default index](https://docs.astral.sh/uv/pip/compatibility/#packages-that-exist-on-multiple-indexes). + We recommend leveraging `uv` to install the vLLM wheel. Using `pip` to install from custom indices is cumbersome because `pip` combines packages from `--extra-index-url` and the default index, choosing only the latest version. This makes it difficult to install a wheel from a custom index unless exact versions of all packages are specified. In contrast, `uv` gives the extra index [higher priority than the default index](https://docs.astral.sh/uv/pip/compatibility/#packages-that-exist-on-multiple-indexes). - If you insist on using `pip`, you have to specify the exact vLLM version and full URL of the wheel path `https://wheels.vllm.ai/rocm/${VLLM_VERSION}/${VLLM_ROCM_VARIANT}` (which can be obtained from the web page). + If you insist on using `pip`, you need to specify the exact vLLM version in the package name and provide the custom index URL `https://wheels.vllm.ai/rocm/${VLLM_VERSION}/${VLLM_ROCM_VARIANT}` via `--extra-index-url`. ```bash pip install vllm==0.18.0+rocm700 --extra-index-url https://wheels.vllm.ai/rocm/0.18.0/rocm700 @@ -89,7 +89,6 @@ uv pip install --pre vllm \ --upgrade ``` - ##### Install specific revisions If you want to access the wheels for previous commits (e.g. to bisect the behavior change, performance regression), you can specify the commit hash in the URL: From 55d999061528b6bc0b907cd9914d0bd2039a5f09 Mon Sep 17 00:00:00 2001 From: tjtanaa Date: Sun, 29 Mar 2026 08:41:09 +0000 Subject: [PATCH 03/11] apply gemini suggestion Signed-off-by: tjtanaa --- docs/getting_started/installation/gpu.rocm.inc.md | 11 +++++++---- 1 file changed, 7 insertions(+), 4 deletions(-) diff --git a/docs/getting_started/installation/gpu.rocm.inc.md b/docs/getting_started/installation/gpu.rocm.inc.md index 076b083ac2e7..7684ab603f78 100644 --- a/docs/getting_started/installation/gpu.rocm.inc.md +++ b/docs/getting_started/installation/gpu.rocm.inc.md @@ -28,20 +28,23 @@ If you need a different ROCm version or want to use an existing PyTorch installa To install the latest version of vLLM for Python 3.12, ROCm 7.0 and `glibc >= 2.35`. ```bash -uv pip install vllm --extra-index-url https://wheels.vllm.ai/rocm/ +uv pip install vllm --extra-index-url https://wheels.vllm.ai/rocm/ --upgrade ``` !!! tip - You can find out about which ROCm version the latest vLLM supports by checking the index in extra-index-url [https://wheels.vllm.ai/rocm/](https://wheels.vllm.ai/rocm/) . + You can find out about which ROCm version the latest vLLM supports by checking the `vllm` package in index in extra-index-url at [https://wheels.vllm.ai/rocm/vllm](https://wheels.vllm.ai/rocm/vllm) . Another approach is that you can use this following commands to automatically extract the wheel variants: ```bash + # automatically extract the vLLM version + export VLLM_VERSION=$(curl -s https://wheels.vllm.ai/rocm/vllm | grep -oP 'vllm-\K[0-9.]+' | head -1) + # automatically extract the available rocm variant - export VLLM_ROCM_VARIANT=$(curl -s https://wheels.vllm.ai/rocm/ | \ - grep -oP 'rocm\d+' | head -1 | sed 's/%2B/+/g') + export VLLM_ROCM_VARIANT=$(curl -s https://wheels.vllm.ai/rocm/vllm | grep -oP 'rocm\d+' | head -1) # inspect if the ROCm version is compatible with your environment + echo $VLLM_VERSION echo $VLLM_ROCM_VARIANT ``` From bfb55c2144356a06106dc5b6fc0a2d85c66ca1c1 Mon Sep 17 00:00:00 2001 From: tjtanaa Date: Sun, 29 Mar 2026 10:24:10 +0000 Subject: [PATCH 04/11] fix sentences Signed-off-by: tjtanaa --- docs/getting_started/installation/gpu.rocm.inc.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/getting_started/installation/gpu.rocm.inc.md b/docs/getting_started/installation/gpu.rocm.inc.md index 7684ab603f78..5f7ddcc7fb6c 100644 --- a/docs/getting_started/installation/gpu.rocm.inc.md +++ b/docs/getting_started/installation/gpu.rocm.inc.md @@ -118,7 +118,7 @@ uv pip install vllm==${VLLM_VERSION} \ Using `pip` to install from nightly indices is _not supported_, because `pip` combines packages from `--extra-index-url` and the default index, choosing only the latest version, which makes it difficult to install a development version prior to the released version. In contrast, `uv` gives the extra index [higher priority than the default index](https://docs.astral.sh/uv/pip/compatibility/#packages-that-exist-on-multiple-indexes). - If you insist on using `pip`, you have to specify the full URL of the wheel file (which can be obtained from the web page). + If you insist on using `pip`, you need to specify the exact vLLM version in the package name and provide the custom index URL (which can be obtained from the web page). ```bash export VLLM_COMMIT=5b8c30d62b754b575e043ce2fc0dcbf8a64f6306 From 8b468e87ba554eca3e07ed6f0527b5c2b2624908 Mon Sep 17 00:00:00 2001 From: tjtanaa Date: Sun, 29 Mar 2026 10:25:38 +0000 Subject: [PATCH 05/11] update sentence Signed-off-by: tjtanaa --- docs/getting_started/installation/gpu.rocm.inc.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/getting_started/installation/gpu.rocm.inc.md b/docs/getting_started/installation/gpu.rocm.inc.md index 5f7ddcc7fb6c..3f35413a881a 100644 --- a/docs/getting_started/installation/gpu.rocm.inc.md +++ b/docs/getting_started/installation/gpu.rocm.inc.md @@ -70,7 +70,7 @@ uv pip install vllm==0.18.0 --extra-index-url https://wheels.vllm.ai/rocm/0.18.0 #### Install the latest code -LLM inference is a fast-evolving field, and the latest code may contain bug fixes, performance improvements, and new features that are not released yet. To allow users to try the latest code without waiting for the next release, vLLM provides wheels for every commit since `v0.18.1` on . The indices can be used is +LLM inference is a fast-evolving field, and the latest code may contain bug fixes, performance improvements, and new features that are not released yet. To allow users to try the latest code without waiting for the next release, vLLM provides wheels for every commit since commit `171775f306a333a9cf105bfd533bf3e113d401d9` on . The indices can be used is - `https://wheels.vllm.ai/rocm/nightly/${VLLM_ROCM_VARIANT}` From eb98fe7e4c944ca80401538071c073250bee495e Mon Sep 17 00:00:00 2001 From: tjtanaa Date: Sun, 29 Mar 2026 10:31:53 +0000 Subject: [PATCH 06/11] enhance description Signed-off-by: tjtanaa --- docs/getting_started/installation/gpu.rocm.inc.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/getting_started/installation/gpu.rocm.inc.md b/docs/getting_started/installation/gpu.rocm.inc.md index 3f35413a881a..d79027b6af8b 100644 --- a/docs/getting_started/installation/gpu.rocm.inc.md +++ b/docs/getting_started/installation/gpu.rocm.inc.md @@ -94,7 +94,7 @@ uv pip install --pre vllm \ ##### Install specific revisions -If you want to access the wheels for previous commits (e.g. to bisect the behavior change, performance regression), you can specify the commit hash in the URL: +If you want to access the wheels for previous commits (e.g. to bisect the behavior change, performance regression), you can specify the commit hash in the URL, example: ```bash export VLLM_COMMIT=5b8c30d62b754b575e043ce2fc0dcbf8a64f6306 From ea58a0428ae69d6409432d61750edc54a3dd3a84 Mon Sep 17 00:00:00 2001 From: tjtanaa Date: Mon, 30 Mar 2026 07:32:07 +0000 Subject: [PATCH 07/11] stamp all commands Signed-off-by: tjtanaa --- docs/getting_started/installation/gpu.rocm.inc.md | 13 +++++++------ 1 file changed, 7 insertions(+), 6 deletions(-) diff --git a/docs/getting_started/installation/gpu.rocm.inc.md b/docs/getting_started/installation/gpu.rocm.inc.md index d79027b6af8b..e87929d761fd 100644 --- a/docs/getting_started/installation/gpu.rocm.inc.md +++ b/docs/getting_started/installation/gpu.rocm.inc.md @@ -37,15 +37,15 @@ uv pip install vllm --extra-index-url https://wheels.vllm.ai/rocm/ --upgrade Another approach is that you can use this following commands to automatically extract the wheel variants: ```bash - # automatically extract the vLLM version - export VLLM_VERSION=$(curl -s https://wheels.vllm.ai/rocm/vllm | grep -oP 'vllm-\K[0-9.]+' | head -1) - # automatically extract the available rocm variant export VLLM_ROCM_VARIANT=$(curl -s https://wheels.vllm.ai/rocm/vllm | grep -oP 'rocm\d+' | head -1) + # automatically extract the vLLM version + export VLLM_VERSION=$(curl -s https://wheels.vllm.ai/rocm/vllm | grep -oP 'vllm-\K[0-9.]+' | head -1) + # inspect if the ROCm version is compatible with your environment - echo $VLLM_VERSION echo $VLLM_ROCM_VARIANT + echo $VLLM_VERSION ``` To install a specific version and ROCm variant of vLLM wheel. @@ -88,8 +88,7 @@ echo $VLLM_ROCM_VARIANT uv pip install --pre vllm \ --extra-index-url https://wheels.vllm.ai/rocm/nightly/${VLLM_ROCM_VARIANT} \ - --index-strategy unsafe-best-match \ - --upgrade + --index-strategy unsafe-best-match ``` ##### Install specific revisions @@ -107,6 +106,7 @@ export VLLM_VERSION=$(curl -s https://wheels.vllm.ai/rocm/${VLLM_COMMIT}/${VLLM_ grep -oP 'vllm-\K[^-]+' | head -1 | sed 's/%2B/+/g') # inspect the version if it is compatible with the ROCm version of your environment +echo $VLLM_ROCM_VARIANT echo $VLLM_VERSION uv pip install vllm==${VLLM_VERSION} \ @@ -131,6 +131,7 @@ uv pip install vllm==${VLLM_VERSION} \ grep -oP 'vllm-\K[^-]+' | head -1 | sed 's/%2B/+/g') # inspect the version if it is compatible with the ROCm version of your environment + echo $VLLM_ROCM_VARIANT echo $VLLM_VERSION pip install vllm==${VLLM_VERSION} \ From 69e365bc43a288d1353fd8528a129762e31fb739 Mon Sep 17 00:00:00 2001 From: tjtanaa Date: Mon, 30 Mar 2026 08:13:35 +0000 Subject: [PATCH 08/11] indent the command Signed-off-by: tjtanaa --- .../getting_started/installation/gpu.rocm.inc.md | 16 +++++++--------- 1 file changed, 7 insertions(+), 9 deletions(-) diff --git a/docs/getting_started/installation/gpu.rocm.inc.md b/docs/getting_started/installation/gpu.rocm.inc.md index e87929d761fd..894cf6f376cf 100644 --- a/docs/getting_started/installation/gpu.rocm.inc.md +++ b/docs/getting_started/installation/gpu.rocm.inc.md @@ -70,18 +70,16 @@ uv pip install vllm==0.18.0 --extra-index-url https://wheels.vllm.ai/rocm/0.18.0 #### Install the latest code -LLM inference is a fast-evolving field, and the latest code may contain bug fixes, performance improvements, and new features that are not released yet. To allow users to try the latest code without waiting for the next release, vLLM provides wheels for every commit since commit `171775f306a333a9cf105bfd533bf3e113d401d9` on . The indices can be used is +LLM inference is a fast-evolving field, and the latest code may contain bug fixes, performance improvements, and new features that are not released yet. To allow users to try the latest code without waiting for the next release, vLLM provides wheels for every commit since commit `171775f306a333a9cf105bfd533bf3e113d401d9` on . The custom index to be used is `https://wheels.vllm.ai/rocm/nightly/${VLLM_ROCM_VARIANT}` -- `https://wheels.vllm.ai/rocm/nightly/${VLLM_ROCM_VARIANT}` - -The first ROCm Variant that supports nightly wheel is ROCm 7.2.1 +**NOTE:** The first ROCm Variant that supports nightly wheel is ROCm 7.2.1 To install from latest nightly index, run: ```bash # automatically extract the available rocm variant export VLLM_ROCM_VARIANT=$(curl -s https://wheels.vllm.ai/rocm/nightly | \ -grep -oP 'rocm\d+' | head -1 | sed 's/%2B/+/g') + grep -oP 'rocm\d+' | head -1 | sed 's/%2B/+/g') # inspect if the ROCm version is compatible with your environment echo $VLLM_ROCM_VARIANT @@ -99,11 +97,11 @@ If you want to access the wheels for previous commits (e.g. to bisect the behavi export VLLM_COMMIT=5b8c30d62b754b575e043ce2fc0dcbf8a64f6306 export VLLM_ROCM_VARIANT=$(curl -s https://wheels.vllm.ai/rocm/${VLLM_COMMIT} | \ -grep -oP 'rocm\d+' | head -1 | sed 's/%2B/+/g') + grep -oP 'rocm\d+' | head -1 | sed 's/%2B/+/g') # Extract the version from the wheel URL export VLLM_VERSION=$(curl -s https://wheels.vllm.ai/rocm/${VLLM_COMMIT}/${VLLM_ROCM_VARIANT}/vllm/ | \ -grep -oP 'vllm-\K[^-]+' | head -1 | sed 's/%2B/+/g') + grep -oP 'vllm-\K[^-]+' | head -1 | sed 's/%2B/+/g') # inspect the version if it is compatible with the ROCm version of your environment echo $VLLM_ROCM_VARIANT @@ -124,11 +122,11 @@ uv pip install vllm==${VLLM_VERSION} \ export VLLM_COMMIT=5b8c30d62b754b575e043ce2fc0dcbf8a64f6306 export VLLM_ROCM_VARIANT=$(curl -s https://wheels.vllm.ai/rocm/${VLLM_COMMIT} | \ - grep -oP 'rocm\d+' | head -1 | sed 's/%2B/+/g') + grep -oP 'rocm\d+' | head -1 | sed 's/%2B/+/g') # Extract the version from the wheel URL export VLLM_VERSION=$(curl -s https://wheels.vllm.ai/rocm/${VLLM_COMMIT}/${VLLM_ROCM_VARIANT}/vllm/ | \ - grep -oP 'vllm-\K[^-]+' | head -1 | sed 's/%2B/+/g') + grep -oP 'vllm-\K[^-]+' | head -1 | sed 's/%2B/+/g') # inspect the version if it is compatible with the ROCm version of your environment echo $VLLM_ROCM_VARIANT From 61e319c6d43b0b518c16dcc19e080c3dfb11b2b3 Mon Sep 17 00:00:00 2001 From: tjtanaa Date: Mon, 30 Mar 2026 08:26:02 +0000 Subject: [PATCH 09/11] turn the list of prebuilt release wheels into a table Signed-off-by: tjtanaa --- docs/getting_started/installation/gpu.rocm.inc.md | 8 +++++--- 1 file changed, 5 insertions(+), 3 deletions(-) diff --git a/docs/getting_started/installation/gpu.rocm.inc.md b/docs/getting_started/installation/gpu.rocm.inc.md index 894cf6f376cf..6ce9ced20d14 100644 --- a/docs/getting_started/installation/gpu.rocm.inc.md +++ b/docs/getting_started/installation/gpu.rocm.inc.md @@ -3,10 +3,12 @@ vLLM supports AMD GPUs with ROCm 6.3 or above. Pre-built wheels are available for ROCm 7.0 and ROCm 7.2.1. -List of release wheels: +#### Release Wheels -- ROCm Variant: `rocm700` (Python 3.12, ROCm 7.0 and `glibc >= 2.35`) is supported from version `0.14.0` to `0.18.0`. -- ROCm Variant: `rocm721` (Python 3.12, ROCm 7.2.1 and `glibc >= 2.35`) is supported since nightly releases after commit `171775f306a333a9cf105bfd533bf3e113d401d9` +| ROCm Variant | Python Version | ROCm Version | glibc Requirement | Supported Versions | +| ------------ | -------------- | ------------ | ----------------- | ------------------ | +| `rocm700` | 3.12 | 7.0 | >= 2.35 | `0.14.0` to `0.18.0` | +| `rocm721` | 3.12 | 7.2.1 | >= 2.35 | Nightly releases after commit `171775f306a333a9cf105bfd533bf3e113d401d9` | --8<-- [end:installation] --8<-- [start:requirements] From ac56211669e59a110eab0e3f19e66bb7531a0d56 Mon Sep 17 00:00:00 2001 From: tjtanaa Date: Mon, 30 Mar 2026 08:27:23 +0000 Subject: [PATCH 10/11] turn the list of prebuilt release wheels into a table Signed-off-by: tjtanaa --- docs/getting_started/installation/gpu.rocm.inc.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/getting_started/installation/gpu.rocm.inc.md b/docs/getting_started/installation/gpu.rocm.inc.md index 6ce9ced20d14..bf94b8b69d19 100644 --- a/docs/getting_started/installation/gpu.rocm.inc.md +++ b/docs/getting_started/installation/gpu.rocm.inc.md @@ -3,7 +3,7 @@ vLLM supports AMD GPUs with ROCm 6.3 or above. Pre-built wheels are available for ROCm 7.0 and ROCm 7.2.1. -#### Release Wheels +Prebuilt Wheels | ROCm Variant | Python Version | ROCm Version | glibc Requirement | Supported Versions | | ------------ | -------------- | ------------ | ----------------- | ------------------ | From fc7114fff81b7806da93486c8f44a94f8fd0f4e6 Mon Sep 17 00:00:00 2001 From: tjtanaa Date: Mon, 30 Mar 2026 08:29:57 +0000 Subject: [PATCH 11/11] emphasise the prebuild wheel Signed-off-by: tjtanaa --- docs/getting_started/installation/gpu.rocm.inc.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/getting_started/installation/gpu.rocm.inc.md b/docs/getting_started/installation/gpu.rocm.inc.md index bf94b8b69d19..4ab01ee8c687 100644 --- a/docs/getting_started/installation/gpu.rocm.inc.md +++ b/docs/getting_started/installation/gpu.rocm.inc.md @@ -3,7 +3,7 @@ vLLM supports AMD GPUs with ROCm 6.3 or above. Pre-built wheels are available for ROCm 7.0 and ROCm 7.2.1. -Prebuilt Wheels +#### Prebuilt Wheels | ROCm Variant | Python Version | ROCm Version | glibc Requirement | Supported Versions | | ------------ | -------------- | ------------ | ----------------- | ------------------ |