Fix 'AdamW' object has no attribute 'optim_bits' error when deepspeed zero2 is enabled#3305

Open

bursteratom wants to merge 2 commits intohuggingface:mainfrom bursteratom:main

+5-3

Commits on Dec 18, 2024

fix adamw optimizer for zero2
bursteratom
committed

Commits on Dec 19, 2024

pop adamw_mode from defaults
bursteratom
committed