Docker 容器内编译 vllm-ascend 源码

1. 拉取 vllm-ascend 镜像

docker pull quay.io/ascend/vllm-ascend:nightly-main

登录容器

docker attach vllm-ascend
cd ~

克隆源码

git clone https://github.com/vllm-project/vllm-ascend.git
cd vllm-ascned

源码编译安装

export PIP_EXTRA_INDEX_URL=https://mirrors.huaweicloud.com/ascend/repos/pypi
export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/usr/local/Ascend/ascend-toolkitatest/x86_64-linux/devlib
pip install -r requirements-dev.txt
python3 -m pip install -v -e . --extra-index https://download.pytorch.org/whl/cpu/