New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

add gitee-ai model resources that are compatible with openai format #2431

Open

6vision wants to merge 1 commit into zhayujie:master from 6vision:support-GiteeAI

Collaborator

6vision commented Dec 21, 2024 •

edited

Loading

新增Gitee AI模型资源，兼容openai格式，目前支持的对话模型列表：

["Yi-34B-Chat", "InternVL2-8B", "deepseek-coder-33B-instruct", "InternVL2.5-26B", "Qwen2-VL-72B", "Qwen2.5-32B-Instruct", "glm-4-9b-chat", "codegeex4-all-9b", "Qwen2.5-Coder-32B-Instruct", "Qwen2.5-72B-Instruct", "Qwen2.5-7B-Instruct", "Qwen2-72B-Instruct", "Qwen2-7B-Instruct", "code-raccoon-v1", "Qwen2.5-14B-Instruct"]

更多模型见：serverless-api

API_KEY获取：在 Gitee AI 工作台 - 设置 - 访问令牌，复制访问令牌（API key）

配置文件修改：

"bot_type": "chatGPT",
"model": "Qwen2.5-72B-Instruct",
"open_ai_api_key": "K8CJTFxxxxxxxxxxxxxxxxxxxxxxxxxx7IBTQEJFA5Z"
"open_ai_api_base": "https://ai.gitee.com/v1",

同时支持在对话中通过#model指令修改模型：#model Qwen2.5-32B-Instruct


          add gitee-ai model resources that are compatible with openai format

abf79bf

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet