New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for huggingface seq2seq #1101

Open

microcoder-py opened this issue Jun 5, 2023 · 3 comments

microcoder-py commented Jun 5, 2023

Any easy way to import HF seq2seq models and use model.generate? Trying to run t5

Collaborator

kali commented Jun 5, 2023

Just export them to ONNX, I guess.

Author

microcoder-py commented Jun 12, 2023

did not work. Some functions were not implemented in ONNX

Collaborator

kali commented Jun 13, 2023

You'll need to give me the onnx file and some input in npz form so I can have a look.

See https://github.com/sonos/tract/blob/main/doc/cli-recipe.md#running-a-test-case for inspiration.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment