Skip to content

Commit

Permalink
update doc
Browse files Browse the repository at this point in the history
  • Loading branch information
mobicham committed Apr 24, 2024
1 parent 980c623 commit 085dd96
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions Readme.md
Original file line number Diff line number Diff line change
Expand Up @@ -51,6 +51,7 @@ HQQLinear.set_backend(HQQBackend.PYTORCH_COMPILE) #Compiled Pytorch via dynamo
HQQLinear.set_backend(HQQBackend.ATEN) #C++ Aten/CUDA backend (set automatically by default if available)
```
The ```HQQBackend.ATEN``` backend is automatically installed and used by default when available.
Note that ```HQQBackend.ATEN``` only supports `axis=0`. For `axis=1` you ned to use ```HQQBackend.PYTORCH``` or ```HQQBackend.PYTORCH_COMPILE```.

Below you can find the speed-up benchmark with various backends, ```HQQBackend.PYTORCH``` being the baseline:

Expand Down

0 comments on commit 085dd96

Please sign in to comment.