Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

I do all thing to deploy a demo on radio, but the server can not load the model #173

Open
chengfengke opened this issue May 16, 2024 · 4 comments

Comments

@chengfengke
Copy link

image image
@czczup
Copy link
Member

czczup commented May 16, 2024

Is there any error message when starting the model worker?

@chengfengke
Copy link
Author

2024-05-17 15:30:19 | ERROR | stderr | Traceback (most recent call last):
2024-05-17 15:30:19 | ERROR | stderr | File "/home/ubuntu/anaconda3/envs/internvl/lib/python3.10/runpy.py", line 196, in _run_module_as_main
2024-05-17 15:30:19 | ERROR | stderr | return _run_code(code, main_globals, None,
2024-05-17 15:30:19 | ERROR | stderr | File "/home/ubuntu/anaconda3/envs/internvl/lib/python3.10/runpy.py", line 86, in _run_code
2024-05-17 15:30:19 | ERROR | stderr | exec(code, run_globals)
2024-05-17 15:30:19 | ERROR | stderr | File "/home/ubuntu/Documents/zxh/InternVL/internvl_chat/internvl/serve/model_worker.py", line 307, in
2024-05-17 15:30:19 | ERROR | stderr | worker = ModelWorker(args.controller_address,
2024-05-17 15:30:19 | ERROR | stderr | File "/home/ubuntu/Documents/zxh/InternVL/internvl_chat/internvl/serve/model_worker.py", line 75, in init
2024-05-17 15:30:19 | ERROR | stderr | self.model = InternVLChatModel.from_pretrained(
2024-05-17 15:30:19 | ERROR | stderr | File "/home/ubuntu/anaconda3/envs/internvl/lib/python3.10/site-packages/transformers/modeling_utils.py", line 3075, in from_pretrained
2024-05-17 15:30:19 | ERROR | stderr | config, model_kwargs = cls.config_class.from_pretrained(
2024-05-17 15:30:19 | ERROR | stderr | File "/home/ubuntu/anaconda3/envs/internvl/lib/python3.10/site-packages/transformers/configuration_utils.py", line 612, in from_pretrained
2024-05-17 15:30:19 | ERROR | stderr | return cls.from_dict(config_dict, **kwargs)
2024-05-17 15:30:19 | ERROR | stderr | File "/home/ubuntu/anaconda3/envs/internvl/lib/python3.10/site-packages/transformers/configuration_utils.py", line 764, in from_dict
2024-05-17 15:30:19 | ERROR | stderr | config = cls(**config_dict)
2024-05-17 15:30:19 | ERROR | stderr | File "/home/ubuntu/Documents/zxh/InternVL/internvl_chat/internvl/model/internvl_chat/configuration_internvl_chat.py", line 51, in init
2024-05-17 15:30:19 | ERROR | stderr | if llm_config['architectures'][0] == 'LlamaForCausalLM':
2024-05-17 15:30:19 | ERROR | stderr | KeyError: 'architectures'。Now I got this.

@chengfengke
Copy link
Author

image
is this the architectures?

@chengfengke
Copy link
Author

image now I got this when I use lmdeploy

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants