Concatenation of miaplpy results (S1_* file in radar coordinates)

[falkamelung]

I uploaded test data to jetstream (4 chunks, NW stands for NorthWest, etc) to try concatenating an S1_* file in radar coordinates:

data/HDF5EOS/testGalalapagosSenDT128[2015] lsd
miaplpy_NW_201606_201608/
miaplpy_NE_201606_201608/
miaplpy_SE_201606_201608/
miaplpy_SW_201606_201608/:

They can be displayed using:

NW:
https://insarmaps.miami.edu/start/-0.7569/-91.1024/11.0000?flyToDatasetCenter=false&startDataset=S1_IW1_128_0596_0597_20160605_XXXXXXXX_S00820_S00740_W091190_W091130_Del4PS&minScale=-80&maxScale=80

NE:
https://insarmaps.miami.edu/start/-0.7569/-91.1024/11.0000?flyToDatasetCenter=false&startDataset=S1_IW1_128_0596_0597_20160605_XXXXXXXX_S00820_S00740_W091120_W091090_Del4PS&minScale=-80&maxScale=80

SE:
https://insarmaps.miami.edu/start/-0.7569/-91.1024/11.0000?flyToDatasetCenter=false&startDataset=S1_IW1_128_0596_0597_20160605_XXXXXXXX_S00820_S00740_W091120_W091090_Del4PS&minScale=-80&maxScale=80

SW
https://insarmaps.miami.edu/start/-0.7569/-91.1024/11.0000?flyToDatasetCenter=false&startDataset=S1_IW1_128_0596_0597_20160605_XXXXXXXX_S00860_S00810_W091190_W091130_Del4PS&minScale=-80&maxScale=80

For the geocoded data it roughly works (for 3 chunks, the 4th gave an error (for testing I created a directory structure similar to the chunk processing):

mkdir $SCRATCHDIR/testGalalapagosChunk1SenDT128
mkdir $SCRATCHDIR/testGalalapagosChunk2SenDT128
mkdir $SCRATCHDIR/testGalalapagosChunk3SenDT128
mkdir $SCRATCHDIR/testGalalapagosChunk4SenDT128

ln -s $SCRATCHDIR/testGalalapagosSenDT128/miaplpy_SE_201606_201608/network_delaunay_4  $SCRATCHDIR/testGalalapagosChunk4SenDT128/mintpy
ln -s $SCRATCHDIR/testGalalapagosSenDT128/miaplpy_SW_201606_201608/network_delaunay_4  $SCRATCHDIR/testGalalapagosChunk3SenDT128/mintpy
ln -s $SCRATCHDIR/testGalalapagosSenDT128/miaplpy_NW_201606_201608/network_delaunay_4  $SCRATCHDIR/testGalalapagosChunk2SenDT128/mintpy
ln -s $SCRATCHDIR/testGalalapagosSenDT128/miaplpy_NE_201606_201608/network_delaunay_4  $SCRATCHDIR/testGalalapagosChunk1SenDT128/mintpy

# Geocoded:
# concatenate 2  chunks:
concatenate_chunks.py testGalalapagosChunk1SenDT128/mintpy/S1_IW1_128_0596_0597_20160605_XXXXXXXX_S00829_S00732_W091144_W091063.he5 testGalalapagosChunk2SenDT128/mintpy/S1_IW1_128_0596_0597_20160605_XXXXXXXX_S00835_S00725_W091211_W091106.he5    --project testGalalapagosSenDT128 --datatype velocity --dir mimtpy

# concatenate 3  chunks:
concatenate_chunks.py testGalalapagosChunk1SenDT128/mintpy/S1_IW1_128_0596_0597_20160605_XXXXXXXX_S00829_S00732_W091144_W091063.he5 testGalalapagosChunk2SenDT128/mintpy/S1_IW1_128_0596_0597_20160605_XXXXXXXX_S00835_S00725_W091211_W091106.he5   testGalalapagosChunk3SenDT128/mintpy/S1_IW1_128_0596_0597_20160605_XXXXXXXX_S00875_S00795_W091198_W091118.he5 --project testGalalapagosSenDT128 --datatype velocity --dir mimtpy

(The seams are a result of interpolation and not present in radar geometry).

The equivalent command applied to S1_* files in radar coordinates would be

concatenate_chunks.py testGalalapagosChunk1SenDT128/mintpy/S1_IW1_128_0596_0597_20160605_XXXXXXXX_S00820_S00740_W091120_W091090_Del4PSDS.he5 testGalalapagosChunk2SenDT128/mintpy/S1_IW1_128_0596_0597_20160605_XXXXXXXX_S00820_S00740_W091190_W091130_Del4PSDS.he5 --project testGalalapagosSenDT128 --datatype velocity --dir mimtpy

did not work. But this is also not expected. We just have to concatenate the individual slices from each file to create larger matrices:

 info.py miaplpy_SW_201606_201608/network_delaunay_4/S1_IW1_128_0596_0597_20160605_XXXXXXXX_S008*PSDS.* --slice
HDFEOS/GRIDS/timeseries/observation/displacement-20160605
HDFEOS/GRIDS/timeseries/observation/displacement-20160629
HDFEOS/GRIDS/timeseries/observation/displacement-20160711
HDFEOS/GRIDS/timeseries/observation/displacement-20160723
HDFEOS/GRIDS/timeseries/observation/displacement-20160804
HDFEOS/GRIDS/timeseries/observation/displacement-20160816
HDFEOS/GRIDS/timeseries/observation/displacement-20160828
HDFEOS/GRIDS/timeseries/quality/avgSpatialCoherence
HDFEOS/GRIDS/timeseries/quality/mask
HDFEOS/GRIDS/timeseries/quality/temporalCoherence
HDFEOS/GRIDS/timeseries/geometry/azimuthAngle
HDFEOS/GRIDS/timeseries/geometry/height
HDFEOS/GRIDS/timeseries/geometry/incidenceAngle
HDFEOS/GRIDS/timeseries/geometry/latitude
HDFEOS/GRIDS/timeseries/geometry/longitude
HDFEOS/GRIDS/timeseries/geometry/shadowMask
HDFEOS/GRIDS/timeseries/geometry/slantRangeDistance

And we have to allow for the miaplpy chunk format, which currently is multiple miaply_* directories in the project directory:

/testGalalapagosSenDT128/miaplpy_SE_201606_201608/network_delaunay_4  
/testGalalapagosSenDT128/miaplpy_SW_201606_201608/network_delaunay_4  
/testGalalapagosSenDT128/miaplpy_NW_201606_201608/network_delaunay_4  
/testGalalapagosSenDT128/miaplpy_NE_201606_201608/network_delaunay_4  

A possible call is:

concatenate_chunks.py testGalalapagosChunk1SenDT128/miaplpy_SE_201606_201608/network_delaunay_4/S1_*l4PSDS.he5  testGalalapagosSenDT128/miaplpy_SW_201606_201608/network_delaunay_4/S1_*l4PSDS.he5  --project testGalalapagosSenDT128 --datatype velocity --dir mimtpy

( I believe it currently has mintpy hardwired and the above doe snot work)