-
-
Notifications
You must be signed in to change notification settings - Fork 10.8k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. Weโll occasionally send you account related emails.
Already on GitHub? Sign in to your account
โจ feat: add custom stream handle support for LobeOpenAICompatibleFactory #5039
base: main
Are you sure you want to change the base?
Conversation
@hezhijie0327 is attempting to deploy a commit to the LobeHub Team on Vercel. A member of the Team first needs to authorize it. |
๐ @hezhijie0327 Thank you for raising your pull request and contributing to our Community |
Codecov ReportAttention: Patch coverage is
Additional details and impacted files@@ Coverage Diff @@
## main #5039 +/- ##
==========================================
- Coverage 92.20% 92.16% -0.05%
==========================================
Files 568 569 +1
Lines 43395 43463 +68
Branches 2706 3890 +1184
==========================================
+ Hits 40012 40056 +44
- Misses 3383 3407 +24
Flags with carried forward coverage won't be shown. Click here to find out more. โ View full report in Codecov by Sentry. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
่ฟๅๆฏไธๆฏๆๅฅฝ็ไธๅช้้่ฆ็ปๅทฅๅๅฝๆฐๅผๆงฝ็๏ผ็ปๅผไธชๆงฝ๏ผๅ็ฌๅฎ็ฐไธไธชๆ่งๅ็ปญ็็ปดๆคๆๆฌๆฏ่พ้ซ
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
ๅ ไบ handleStream
ๅ handleTtransformResponseToStream
ๆฅๅฃ๏ผๅ่ฝไธๆฒกๅฅ้ฎ้ขไบ ๏ผ่ฟๅทฎไธไธช้ๆตๅผ่ฝฌๆตๅผ็่ชๅฎไนๅค็
โฆpatibleFactory, custom stream handle
โฆtransform handle
โฆable_search` for Qwen LLM
@arvinxx ๆน้ ๅฅฝไบ
|
@arvinxx has been transformed
|
๐ป ๅๆด็ฑปๅ | Change Type
๐ ๅๆด่ฏดๆ | Description of Change
handleStream
ๅhandleTransformResponseToStream
ๆฅๅฃ๏ผ็จไบๅบ็จ่ชๅฎไนๆตๅค็a. ๅฏน่ฏญ่จๆจกๅ้ป่ฎคๅฏ็จๅ ็ฝฎ่็ฝๆ็ดข่ฝๅ๏ผๅผๅ ฅ
enable_search
(ๅฐ่ฑก้ไนๅๆไธช Issue ๆไบ่ฟไธช feat๏ผ่ฟไผๅฟ็ฟปไธ) [Request] ๅขๅ ้ไนๅ้ฎๆๅผ่็ฝๆ็ดข็ๅผๅ ณย #4877b. ๅฏน
frequency_penalty
presence_penalty
temperature
top_p
่ฟ่ก่ๅด้ๅถ- ref: https://help.aliyun.com/zh/dashscope/developer-reference/tongyi-qianwen-vl-plus-api
- ref: https://help.aliyun.com/zh/dashscope/developer-reference/qwen-api
a. ้่ฟๆน้ ๅฎ็ฐไบ Spark ็ Function Call ๅ่ฝ๏ผๆดไฝๅทฅๅ ท่ฐ็จๆๆไธๆฏ็นๅซๅฅฝ๏ผๅญๅจ้ๅถ๏ผ
b. ๆฏๆๆตๅผๅ้ๆตๅผๅฏน่ฏ
c. ่ฏไบไธๅทฅๅ ท่ฐ็จๆฏๆๆตๅผ๏ผไฝๆฏ้คไบ
max-32k
ๆจกๅๆฏๆๅทฅๅ ทๅ่ฐๅค๏ผๅ ถไฝๅไธๆฏๆ๏ผcurl
่ฐ็จๆต่ฏไนไธบ็ฉบ๏ผmax-32k
ๅญๅจ็ธๅ payload๏ผไธไธ็ง่ฟ่ฝๅบๅ ๅฎน๏ผๅๆฌกๆง่ก็ดๆฅ่ฟๅ็ฉบ็้ฎ้ข๏ผtransformSparkStream
transformSparkResponseToStream
Spark ็ๅทฅๅ ท่ฐ็จๆตๅพๆช๏ผ่ฟๅ็ๆฏๅฏน่ฑกไธๆฏๆฐ็ป๏ผ้่ฟ้ญๆน OpenAI ๆตๅค็ๅฏน้ๆ ๅ่ฟๅๅผบๅถ่ฝฌๆขไธบๆฐ็ป
PS: ็ป่ฎฏ้ฃๅผไบๅทฅๅ๏ผๅฐ่ฟไธไธชๅคๆๆ ่ฟๅฑ
๐ ่กฅๅ ไฟกๆฏ | Additional Information
้ๆตๅผๅๅบๆต
ๆตๅผ่พๅบๅๅบๆต