Skip to content

gpt_server v0.3.6
Compare
Choose a tag to compare
@shell-nlp shell-nlp released this 11 Feb 02:50
· 23 commits to main since this release
v0.3.6
5a4cf81

gpt_server v0.3.6

What's Changed

  1. vllm 后端支持QVQ模型 #28
  2. 更新 vllm==0.7.2 lmdeploy=0.7.0.post3 transformers==4.48.2 pynvml==12.0.0
  3. 修复lmdepy 解析模型类型的bug
  4. 支持文本审核模型
  5. 支持edge-TTS
  6. HF后端支持guided_decoding
  7. 使用高性能json序列化库
  8. 优化架构
Assets 2
Loading