Skip to content
This repository has been archived by the owner on Apr 30, 2021. It is now read-only.

establish dask-mpi batch processing functionality #38

Open
matt-long opened this issue Jan 25, 2019 · 1 comment
Open

establish dask-mpi batch processing functionality #38

matt-long opened this issue Jan 25, 2019 · 1 comment

Comments

@matt-long
Copy link
Contributor

Based on a discussion today, I think we want to have a batch processing capability in esmlab based on dask-mpi.

All the functions in esmlab.climatology accept and return arguments of type xr.Dataset; explicit attention has been paid to ensure that the returned Dataset is suitable to write to file (attributes and dtypes preserved, etc.).

@kmpaul, @andersy005: can you please provide @alperaltuntas with a dask-mpi example?

cc: @mnlevy1981, @jukent

@andersy005
Copy link
Contributor

@alperaltuntas, is https://github.com/alperaltuntas/mncPy the repo with the scripts you mentioned?

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants