-
Notifications
You must be signed in to change notification settings - Fork 133
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
运行报错 TypeError: expected str, bytes or os.PathLike object, not NoneType #67
Comments
您好,看起来问题应该是checkpoint的路径设定有问题,能告诉我们WEBGLM_CKPT的环境变量值吗? |
你好,按照readme步骤,我没有设置WEBGLM_CKPT,不知道是否有huggingface默认地址。 |
有可能是本地环境变量无意设置了WEBGLM_CKPT导致的错误。可以尝试手动设置下WEBGLM_CKPT环境变量或传入参数webglm_ckpt_path。详细可见: WebGLM/model/modeling_webglm.py Line 56 in 74d3bca
|
请问有官方仓库吗?不知道这里手动设置路径该选择哪里,感谢。 |
有的,我们的官方仓库是https://huggingface.co/THUDM/WebGLM 和 https://huggingface.co/THUDM/WebGLM-2B 。也可以从这里进行下载。 |
不好意思,修改为官方仓库后还是同样的报错。并且本地的WEBGLM_CKPT路径为None,默认应该从huggingface上下载。请问还有可能是哪些地方的问题呢? |
WebGLM Initializing...
Traceback (most recent call last):
File "/home/e222/YWT/WebGLM-main/web_demo.py", line 63, in
webglm = load_model(args)
File "/home/e222/YWT/WebGLM-main/model/modeling_webglm.py", line 66, in load_model
webglm = WebGLM(webglm_ckpt_path, retiever_ckpt_path, args.device, args.filter_max_batch_size, args.searcher)
File "/home/e222/YWT/WebGLM-main/model/modeling_webglm.py", line 9, in init
self.tokenizer = AutoTokenizer.from_pretrained(webglm_ckpt_path, trust_remote_code=True)
File "/home/e222/anaconda3/envs/webglm/lib/python3.9/site-packages/transformers/models/auto/tokenization_auto.py", line 693, in from_pretrained
return tokenizer_class.from_pretrained(pretrained_model_name_or_path, *inputs, **kwargs)
File "/home/e222/anaconda3/envs/webglm/lib/python3.9/site-packages/transformers/tokenization_utils_base.py", line 1812, in from_pretrained
return cls._from_pretrained(
File "/home/e222/anaconda3/envs/webglm/lib/python3.9/site-packages/transformers/tokenization_utils_base.py", line 1975, in _from_pretrained
tokenizer = cls(*init_inputs, **init_kwargs)
File "/home/e222/anaconda3/envs/webglm/lib/python3.9/site-packages/transformers/models/gpt2/tokenization_gpt2.py", line 188, in init
with open(vocab_file, encoding="utf-8") as vocab_handle:
TypeError: expected str, bytes or os.Path Like object, not NoneType
疑似webglm_ckpt_path = args.webglm_ckpt_path or os.getenv("WEBGLM_CKPT") or 'THUDM/WebGLM'没有找到,应该修改哪里呢?
The text was updated successfully, but these errors were encountered: