Unverified Commit 128781cf by ZSL98 Committed by GitHub

vllm: fix issue #438 (#440)

parent fb13a07d
...@@ -62,7 +62,7 @@ Using the vLLM V1 engine can avoid instability issues and achieve additional per ...@@ -62,7 +62,7 @@ Using the vLLM V1 engine can avoid instability issues and achieve additional per
``` ```
git clone https://github.com/vllm-project/vllm.git git clone https://github.com/vllm-project/vllm.git
cd vllm cd vllm
git checkout eb24dc4 git checkout 2275784
sed -i "903a\ data_parallel_size = world_size // pipeline_model_parallel_size // tensor_model_parallel_size" ./vllm/distributed/parallel_state.py sed -i "903a\ data_parallel_size = world_size // pipeline_model_parallel_size // tensor_model_parallel_size" ./vllm/distributed/parallel_state.py
VLLM_USE_PRECOMPILED=1 pip install --editable . VLLM_USE_PRECOMPILED=1 pip install --editable .
``` ```
......
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment