Skip to content

Commit 6f0e389

Browse files
author
xusenlin
committed
support vllm=0.5.0
1 parent f674085 commit 6f0e389

File tree

3 files changed

+3
-3
lines changed

3 files changed

+3
-3
lines changed

docker/Dockerfile.vllm

+1-1
Original file line numberDiff line numberDiff line change
@@ -6,6 +6,6 @@ COPY requirements.txt /workspace/
66

77
RUN pip config set global.index-url https://pypi.tuna.tsinghua.edu.cn/simple && \
88
pip install bitsandbytes --upgrade && \
9-
pip install vllm==0.4.3 && \
9+
pip install vllm>=0.4.3 && \
1010
pip install --no-cache-dir -r /workspace/requirements.txt && \
1111
pip uninstall transformer-engine -y

docs/VLLM_SCRIPT.md

+1-1
Original file line numberDiff line numberDiff line change
@@ -15,7 +15,7 @@ docker build -f docker/Dockerfile.vllm -t llm-api:vllm .
1515
安装依赖,确保安装顺序严格按照下面的命令:
1616

1717
```shell
18-
pip install vllm==0.4.3
18+
pip install vllm>=0.4.3
1919
pip install -r requirements.txt
2020
# pip uninstall transformer-engine -y
2121
```

tests/glm4v.py

+1-1
Original file line numberDiff line numberDiff line change
@@ -18,7 +18,7 @@
1818
"type": "image_url",
1919
"image_url": {
2020
# Either an url or a local path
21-
"url": "http://djclub.cdn.bcebos.com/uploads/images/pageimg/20230325/64-230325205T52.jpg"
21+
"url": "http://djclub.cdn.bcebos.com/uploads/images/pageimg/20230325/64-2303252115313.jpg"
2222
}
2323
}
2424
]

0 commit comments

Comments
 (0)