Skip to content

gpt_server v0.4.2

Latest
Latest
Compare
Choose a tag to compare
@shell-nlp shell-nlp released this 25 Apr 06:50
· 18 commits to main since this release
v0.4.2
c576e87

gpt_server v0.4.2

What's Changed

  1. 更新 lmdeploy==0.7.3 and vllm==0.8.4
  2. 支持了 Spark-TTS 后端,支持流式输出 #30
  3. 支持了SGLang推理后端
  4. SGLang后端支持VL模型
Assets 2
Loading