CC/gpt_academic
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity

Add ChatGLM4 local deployment support and refactor ChatGLM bridge's path configuration (#2062)

Browse Source 
* ✨ feat(request_llms and config.py): ChatGLM4 Deployment

Add support for local deployment of ChatGLM4 model

* 🦄 refactor(bridge_chatglm3.py): ChatGLM3 model path

Added ChatGLM3 path customization (in config.py).
Removed useless quantization model options that have been annotated

---------

Co-authored-by: MarkDeia <17290550+MarkDeia@users.noreply.github.com>
This commit is contained in:
YE Ke 叶柯
2024-12-07 23:43:51 +08:00
committed by GitHub
parent 239894544e
commit 294df6c2d5
6 changed files with 124 additions and 20 deletions
Download Patch File Download Diff File Expand all files Collapse all files

7
request_llms/requirements_chatglm4.txt Normal file
View File

@@ -0,0 +1,7 @@
protobuf
cpm_kernels
torch>=1.10
transformers>=4.44
mdtex2html
sentencepiece
accelerate