Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

支持llama3么,有个小程序接入模型接口,不包括llama,想用openai解决,第三方买的llama APPI #1419

Open
5 tasks
onlyhuman028 opened this issue May 9, 2024 · 6 comments
Labels
enhancement New feature or request

Comments

@onlyhuman028
Copy link

例行检查

  • 我已确认目前没有类似 issue
  • 我已确认我已升级到最新版本
  • 我已完整查看过项目 README,已确定现有版本无法满足需求
  • 我理解并愿意跟进此 issue,协助测试和提供反馈
  • 我理解并认可上述内容,并理解项目维护者精力有限,不遵循规则的 issue 可能会被无视或直接关闭

功能描述

应用场景

@onlyhuman028 onlyhuman028 added the enhancement New feature or request label May 9, 2024
@QAbot-zh
Copy link

QAbot-zh commented May 9, 2024

llama3 支持的

@onlyhuman028
Copy link
Author

收到,已经完成部署,openai和grok 测试都通过。但是有一个 deepinfra.com的账号,购买了key 。在oneapi 的接口怎么填都通不过测试。我填的是
https://api.deepinfra.com/v1。官方指导文件:https://deepinfra.com/meta-llama/Meta-Llama-3-70B-Instruct/api?example=js-text-gen。 谢谢先

@onlyhuman028
Copy link
Author

是不是模型名称问题

@QAbot-zh
Copy link

看了下例程,是调用格式跟OpenAI不匹配,得让oneapi适配这个渠道了

@onlyhuman028
Copy link
Author

onlyhuman028 commented May 12, 2024

看了下例程,是调用格式跟OpenAI不匹配,得让oneapi适配这个渠道了

哦,谢谢。您的意思是 需要oneapi 官方适配一下deepinfra.com ,oneapi的用户才能正常用?

@onlyhuman028
Copy link
Author

up

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants