You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The command line tool ncrcat can combine netcdf files along a record dimension (commonly time). If we defined the dimension "index" as a record dimension, and made sure it was increasing across files, we could use ncrcat. Not sure if this would be faster than using open_mfdataset, but maybe worth looking into? Note that it would require different threads to somehow keep, and syncronise, a running particle count, so it might not be feasible in practice.
The text was updated successfully, but these errors were encountered:
Version 2.5.11 introduced a new method for merging netcdf files which should solve the merge speed issue. Particle counts are available in the image_stats group in the netcdf files.
The command line tool
ncrcat
can combine netcdf files along a record dimension (commonly time). If we defined the dimension "index" as a record dimension, and made sure it was increasing across files, we could usencrcat
. Not sure if this would be faster than usingopen_mfdataset
, but maybe worth looking into? Note that it would require different threads to somehow keep, and syncronise, a running particle count, so it might not be feasible in practice.The text was updated successfully, but these errors were encountered: