Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

训练的时候显存不大,但是测试的时候会瞬间爆显存是什么情况 #97

Open
AllesOderNicht opened this issue Nov 2, 2022 · 3 comments

Comments

@AllesOderNicht
Copy link

sim_map = torch.bmm(query_local, key_local) # batch matrix multiplication
RuntimeError: CUDA out of memory. Tried to allocate 64.00 GiB (GPU 0; 23.69 GiB total capacity; 554.08 MiB already allocated; 21.34 GiB free; 666.00 MiB reserved in total by PyTorch) If reserved memory is >> allocated memory try setting max_split_size_mb to avoid fragmentation. See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF

@chicheng567
Copy link

請問您解決了嗎,我也遇到一樣的問題。

@AllesOderNicht
Copy link
Author

AllesOderNicht commented Aug 13, 2023 via email

@chicheng567
Copy link

我看到了,在val.opt_preprocess把所有的transform都清掉了 難怪跑 val時內存要求總會特別多。非常感謝您的協助

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants