[Bug] 使用nvidia提供的llama3接口，消息被截断

[EucalyZ]

Bug Description

当我在ChatGPT-Next-Web中使用nvidia提供的llama3接口时，出现消息被截断的问题，已尝试max_tokens设置为4000、39999

接口在测试中表现良好

Steps to Reproduce

如上

Expected Behavior

能接收到完整信息

Screenshots

No response

Deployment Method

• Docker
• Vercel
• Server

Desktop OS

No response

Desktop Browser

No response

Desktop Browser Version

No response

Smartphone Device

No response

Smartphone OS

No response

Smartphone Browser

No response

Smartphone Browser Version

No response

Additional Logs

data: {"id":"chatcmpl-a77268e0-c815-4f0b-8a7e-3452ea838046","object":"chat.completion.chunk","created":1714240413,"model":"meta/llama3-70b-instruct","choices":[{"index":0,"delta":{"role":"assistant","content":""},"finish_reason":null,"logprobs":null}]}

data: {"id":"chatcmpl-a77268e0-c815-4f0b-8a7e-3452ea838046","object":"chat.completion.chunk","created":1714240413,"model":"meta/llama3-70b-instruct","choices":[{"index":0,"delta":{"role":"assistant","content":"**"},"finish_reason":null,"logprobs":{"content":[{"token":null,"logprob":0.0,"bytes":null,"top_logprobs":null}]}}]}

data: {"id":"chatcmpl-a77268e0-c815-4f0b-8a7e-3452ea838046","object":"chat.completion.chunk","created":1714240413,"model":"meta/llama3-70b-instruct","choices":[{"index":0,"delta":{"role":"assistant","content":"What is a Computer?**\n\nA computer is an electronic device that can perform"},"finish_reason":null,"logprobs":{"content":[{"token":null,"logprob":0.0,"bytes":null,"top_logprobs":null}]}}]}

data: {"id":"chatcmpl-a77268e0-c815-4f0b-8a7e-3452ea838046","object":"chat.completion.chunk","created":1714240413,"model":"meta/llama3-70b-instruct","choices":[{"index":0,"delta":{"role":"assistant","content":""},"finish_reason":"stop","logprobs":null}]}

data: [DONE]

[Issues-translate-bot]

Bot detected the issue body's language is not English, translate it automatically.

---

Title: [Bug] Using the llama3 interface provided by nvidia, the message is truncated

[yanye99]

你怎么用nvidia的接口的？

[Issues-translate-bot]

Bot detected the issue body's language is not English, translate it automatically.

---

How do you use nvidia's interface?