15308555518/ MaxKB
1
0
Fork 0
mirror of https://github.com/1Panel-dev/MaxKB.git synced 2025-12-26 01:33:05 +00:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity

fix: 修复vllm模型不能正常生成问题的bug

This commit is contained in:
CaptainB 2024-10-18 11:54:44 +08:00 committed by 刘瑞斌
parent 12d348439c
commit cb3c064463
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
apps/setting/models_provider/impl/base_chat_open_ai.py
View File

@ -54,5 +54,5 @@ class BaseChatOpenAI(ChatOpenAI):
**kwargs,
).generations[0][0],
).message
self.usage_metadata = chat_result.response_metadata['token_usage']
self.usage_metadata = chat_result.response_metadata['token_usage'] if 'token_usage' in chat_result.response_metadata else chat_result.usage_metadata
return chat_result