Onnx - Load external data from memory

[kckeiks]

Hello,
Awesome project!
It would be great to have this feature. In our project, a process loads models fetched from the network but we're currently restricted to only supporting models <2GB because storing/loading models from disk is not an option for us.
Cheers!

[kali]

Hey, thanks for your interest!

Could you have a look at #1358 ? I think by replacing the data_provider on the Onnx structure by your own implementation, you would be able to redirect the data access to wherever you want. Please tell me what you think.

[kckeiks]

Hey, thanks for your interest!

Could you have a look at #1358 ? I think by replacing the data_provider on the Onnx structure by your own implementation, you would be able to redirect the data access to wherever you want. Please tell me what you think.

Thanks for taking the time, it looks good! I think it will work for our case since we have the model and external data in memory so we could just implement ModelDataResolver. Looking forward to trying it!