Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add ONNXRuntimePackages builds for Java #697

Open
7 tasks
HichemMaiza opened this issue Nov 5, 2023 · 5 comments
Open
7 tasks

Add ONNXRuntimePackages builds for Java #697

HichemMaiza opened this issue Nov 5, 2023 · 5 comments
Labels
enhancement New feature or request

Comments

@HichemMaiza
Copy link

HichemMaiza commented Nov 5, 2023

Proposal Summary

ONNX Runtime already supports Java and has been in production, empowering numerous systems for several years. Java represents millions of developers. I have already tested the whisper example on both platforms, Windows and Linux, and it works perfectly. I am ready to discuss my work further if you're interested.
Here are the java builds of onnxruntime-extensions that I am using along with the official onnxruntime java package.

What component(s) does this request affect?

  • OliveModels
  • OliveSystems
  • OliveEvaluator
  • Metrics
  • Engine
  • Passes
  • Other
@HichemMaiza HichemMaiza added the enhancement New feature or request label Nov 5, 2023
@xiaoyu-work
Copy link
Contributor

Hi @HichemMaiza , I can add a new README.md file for how to add onnxruntime as a dependency for Maven Java project like https://central.sonatype.com/artifact/com.microsoft.onnxruntime/onnxruntime/1.16.1

@HichemMaiza
Copy link
Author

@xiaoyu-work Thank you for your feedback. Olive models use operations built in onnxruntime-extensions .
with onnxruntime, we also need to build and package onnxruntime-extensions https://github.com/microsoft/onnxruntime-extensions. I have built the 0.9.0 version here: https://github.com/HichemMaiza/onnxruntime-extensions-java.
I used these builds to run Whisper Olive model in java, which, by the way, can benefit from the multithreading in java without pain.

@xiaoyu-work
Copy link
Contributor

@HichemMaiza Thanks for your contribution for onnxruntime-extension java, but unfortunately I can't add your build here. Can you please raise an issue to onnxruntime-extensions repo referring your java build, so they can add an official java build?

@HichemMaiza
Copy link
Author

@xiaoyu-work, Yes ! Let us raise an issue on the onnxruntime-extensions side to publish the builds on maven central. This way, we can add them as a maven dependency to any project that uses Olive model.

@HichemMaiza
Copy link
Author

@xiaoyu-work, Here is the issue link microsoft/onnxruntime-extensions#597. It would be nice if you could assist with this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants