"No operator found for memory_efficient_attention_forward with inputs" issue on Mac Pro M1

[LinearFalcon]

Hi folks, run out of all my hacks so wanna to post here to see if anyone know how to run the latest sv3d_u model on Mac Pro M1 with device set to cpu?
I kept running into this issue even if I have already make sure the input PNG file is 576x576:

NotImplementedError: No operator found for `memory_efficient_attention_forward` with inputs:
     query       : shape=(1, 5184, 1, 512) (torch.float16)
     key         : shape=(1, 5184, 1, 512) (torch.float16)
     value       : shape=(1, 5184, 1, 512) (torch.float16)
     attn_bias   : <class 'NoneType'>
     p           : 0.0
`ck_decoderF` is not supported because:
    max(query.shape[-1] != value.shape[-1]) > 256
    device=cpu (supported: {'cuda'})
    operator wasn't built - see `python -m xformers.info` for more info
`ckF` is not supported because:
    max(query.shape[-1] != value.shape[-1]) > 256
    device=cpu (supported: {'cuda'})
    operator wasn't built - see `python -m xformers.info` for more info