Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Hope to increase stream mode #15

Closed
iofu728 opened this issue Mar 3, 2023 · 16 comments
Closed

Hope to increase stream mode #15

iofu728 opened this issue Mar 3, 2023 · 16 comments
Labels
enhancement New feature or request

Comments

@iofu728
Copy link

iofu728 commented Mar 3, 2023

Thank you to the developers for their work. This is a very meaningful tool!
However, it was found that it was not as fast in the process as the turbo API previously used. After referring to the implementation of other tools, like https://github.com/ddiu8081/chatgpt-demo/blob/main/src/pages/api/generate.ts#L26 and https://platform.openai.com/docs/api-reference/completions/create#completions/create-stream, it was found that they had enabled stream mode.
I do not know if it is possible to increase stream mode. Thank you.
@yetone
Copy link
Collaborator

yetone commented Mar 3, 2023

Thank you for your suggestion. It's my first time hearing about stream mode, and I'm going to look into it now!

@yetone
Copy link
Collaborator

yetone commented Mar 3, 2023

Just to confirm, are you currently using the gpt-3.5-turbo model?
image

@iofu728
Copy link
Author

iofu728 commented Mar 3, 2023

Yeah, I use the gpt-3.5-turbo. If I translate more than 1k tokens, It'll take more than 10s too.

@Ukenn2112
Copy link
Contributor

Bob currently does not support stream. You can follow this issue for updates.

ripperhe/Bob#451

@iofu728
Copy link
Author

iofu728 commented Mar 6, 2023

Bob currently does not support stream. You can follow this issue for updates.

ripperhe/Bob#451

Thank you for the information.

@liby liby pinned this issue Apr 6, 2023
@liby liby added the enhancement New feature or request label Apr 6, 2023
@liby liby mentioned this issue Apr 6, 2023
Closed
@fredericky123
Copy link

好像官方的bob实现了stream功能
咱们这款插件能否实现呢

@Ukenn2112
Copy link
Contributor

好像官方的bob实现了stream功能

咱们这款插件能否实现呢

目前只有Bob自带的OpenAi翻译可以使用，并未开放给插件调用。

ripperhe/Bob#451 (comment)

据说后续会开放

@liby liby mentioned this issue May 16, 2023
Closed
2 tasks
@xieft
Copy link

xieft commented May 19, 2023

BOB已支持
ripperhe/Bob#451 (comment)

@liby
Copy link
Member

liby commented May 19, 2023 •
edited

BOB已支持 ripperhe/Bob#451 (comment)

#83

@liby
Copy link
Member

liby commented May 20, 2023 •
edited

https://github.com/openai-translator/bob-plugin-openai-translator/releases/tag/v1.0.0

@liby liby closed this as completed May 20, 2023
@fredericky123
Copy link

请问能关闭stream模式吗

@liby
Copy link
Member

liby commented Jul 6, 2023

请问能关闭stream模式吗

https://github.com/openai-translator/bob-plugin-openai-translator/releases/tag/v0.4.1

@fredericky123
Copy link

请问能关闭stream模式吗

https://github.com/openai-translator/bob-plugin-openai-translator/releases/tag/v0.4.1

还是没看懂怎么关闭

@liby
Copy link
Member

liby commented Jul 6, 2023

v0.4.1 不支持 stream

@fredericky123
Copy link

v0.4.1 不支持 stream

谢谢了，我期待的是具有后面的更新，并且取消stream显示方式

@liby
Copy link
Member

liby commented Jul 6, 2023 •
edited

v0.4.1 支持最新的 GPT models，也支持 custom prompts，不支持 stream，还有哪里不满足你的需求？

另外这个 issue 已经关闭了，频繁回复会影响到其他人。且讨论已经 off topic 了，推荐到 https://github.com/openai-translator/bob-plugin-openai-translator/discussions 新开一个讨论

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
6 participants
@yetone @fredericky123 @iofu728 @xieft @liby @Ukenn2112