New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
stream_options #1423
Comments
+1 |
按 azure 的文档, 确实没有这个参数, 之前设计的 azure 和 openai 是完全兼容的, 现在可能 azure 那边慢了, 如果 azure 那边更新慢, oneapi 这边估计只能用 adaptor 做兼容了 https://learn.microsoft.com/en-us/azure/ai-services/openai/reference#completions |
+1 |
1 similar comment
+1 |
OpenAI ,5.6 才支持这个参数 Azure ,这种 非关键性 的参数(除了超高并发中转为了节省 CPU 计算资源外,没多少系统会在意) 但是这种参数(获取重要数据,更改后会造成严重后果的),不要由 one-api 来做处理 |
伪造确实不是好的实现,我比较建议oneapi照着 azure的接口 spec 对传过来的请求进行改写,这样可以在请求时去掉一些azure 不支持的参数,oneapi会更健壮 |
例行检查
问题描述
relay error (channel #1): Unrecognized request argument supplied: stream_options. Please contact us through an Azure support request at: https://go.microsoft.com/fwlink/?linkid=2213926 for further questions. (request id: 2024051109314182812859242806014)
复现步骤
2024-05-06 OpenAI add argument: stream_options
相关截图
The text was updated successfully, but these errors were encountered: