langchain-chatchat开源项目,运行成功后,使用LLM(chatglm2-6b-int4)模型,不能正常对话 #4027
-
错误信息:ERROR: RemoteProtocolError: Caught exception: peer closed connection without sending complete message body (incomplete chunked read) |
Beta Was this translation helpful? Give feedback.
Replies: 2 comments 1 reply
-
To address the
If these steps do not resolve the issue, providing more detailed error messages, stack traces, and any relevant configurations can help in diagnosing the problem further.
|
Beta Was this translation helpful? Give feedback.
-
没有做int4的适配,需要自己改 |
Beta Was this translation helpful? Give feedback.
没有做int4的适配,需要自己改