Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow using the http driver with dlite.storage_path #869

Open
jesper-friis opened this issue Jun 28, 2024 · 0 comments
Open

Allow using the http driver with dlite.storage_path #869

jesper-friis opened this issue Jun 28, 2024 · 0 comments

Comments

@jesper-friis
Copy link
Collaborator

jesper-friis commented Jun 28, 2024

Goal: allow to use online repository of data models in dlite.storage_path (e.g. stored in a public git repository).

It should support different backend drivers, like json, yaml, ...

This could be implemented as an improved version of the http driver.

GitHub driver
To support query on data models stored in a github repo, one can use the trees API. For example: https://api.github.com/repos/HEU-MatCHMaker/DataDocumentation/git/trees/master

Should use subdirectory URLs, like https://api.github.com/repos/HEU-MatCHMaker/DataDocumentation/git/trees/46d909ade1423ceb17f5a3933ad12bb724d5d0fd

Subdirectories can be reached by recursively following the url links. Alternatively, add option ?recursive=1, as in https://api.github.com/repos/HEU-MatCHMaker/DataDocumentation/git/trees/master?recursive=1. Some help functions for finding the subdirectory URLs can be provided.

Probably better to implement this as a dedicated github storage plugin.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant