-
Notifications
You must be signed in to change notification settings - Fork 40
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
AMX support for tiled matrix multiplications #26
Comments
I'll try doing the BF16 dot product with this. Shall we add a new function matmul as well for matrix multiplication? |
I think it may be a new file called "dots.h", that implements matrix multiplications 🤗 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Both Intel and Apple now have specialized AMX tiled matrix multiplication extensions. Both are tricky to use, but may result in substantial performance improvements. Potentially even for single vector dot-products and cosine distances.
Resources:
The text was updated successfully, but these errors were encountered: