Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Task 1-2: Benchmark HUC Query of NWM Gridded Zarr Output #27

Open
lewfish opened this issue May 3, 2022 · 1 comment
Open

Task 1-2: Benchmark HUC Query of NWM Gridded Zarr Output #27

lewfish opened this issue May 3, 2022 · 1 comment
Labels
task an SBIR project task

Comments

@lewfish
Copy link
Contributor

lewfish commented May 3, 2022

While the most likely query pattern for gridded output data will be by HUCs, the performance of the Zarr library relative to the size of the query needs to be benchmarked. To that end, we will perform this benchmarking for several HUC 8, 10, and 12 regions. These will also be recorded as a sample documentation notebook in the project repository.

@lewfish lewfish added the task an SBIR project task label May 3, 2022
@lewfish
Copy link
Contributor Author

lewfish commented May 20, 2022

For sample benchmark #1, it's not clear if we should be running these aggregations for each stream individually, or across all streams. It's also not clear if "daily averages" should be averaged across all days in the dataset, or we should be computing an average for each individual day. I would also like to know typical values for the number of HUC8s, and the length of date/time range.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
task an SBIR project task
Projects
None yet
Development

No branches or pull requests

1 participant