Load Data

Currently, only interface to the GAMMA software is porvided.

Load GAMMA result

The data from gamma software needed for this tutorial:

!ls -R ../../../data/gamma/

../../../data/gamma/:
DEM  geocoding  rslc

../../../data/gamma/DEM:
dem_seg  dem_seg_par

../../../data/gamma/geocoding:
20210802.diff_par  20210802.lt_fine  20210802.lv_theta
20210802.hgt       20210802.lv_phi

../../../data/gamma/rslc:
20210802.rslc      20211011.rslc.par  20220718.rslc  20220912.rslc.par
20210802.rslc.par  20211025.rslc      20220718.rslc.par  20220926.rslc
20210816.rslc      20211025.rslc.par  20220801.rslc  20220926.rslc.par
20210816.rslc.par  20220606.rslc      20220801.rslc.par  20221010.rslc
20210830.rslc      20220606.rslc.par  20220815.rslc  20221010.rslc.par
20210830.rslc.par  20220620.rslc      20220815.rslc.par  20221024.rslc
20210913.rslc      20220620.rslc.par  20220829.rslc  20221024.rslc.par
20210913.rslc.par  20220704.rslc      20220829.rslc.par
20211011.rslc      20220704.rslc.par  20220912.rslc

Import Moraine:

import moraine.cli as mc

logger = mc.get_logger()

rslc_dir = '../../../data/gamma/rslc'
reference = '20220620'
rslc_par = '../../../data/gamma/rslc/20220620.rslc.par'
hgt = '../../../data/gamma/geocoding/20210802.hgt'
lt = '../../../data/gamma/geocoding/20210802.lt_fine'
diff_par = '../../../data/gamma/geocoding/20210802.diff_par'
dem_par = '../../../data/gamma/DEM/dem_seg_par'
theta = '../../../data/gamma/geocoding/20210802.lv_theta'
phi = '../../../data/gamma/geocoding/20210802.lv_phi'

scratch_dir = './load_data/scratch'
rslc_zarr = './load_data/rslc.zarr'
lat_zarr = './load_data/lat.zarr'
lon_zarr = './load_data/lon.zarr'
theta_zarr = './load_data/theta.zarr'
phi_zarr = './load_data/phi.zarr'
hgt_zarr = './load_data/hgt.zarr'
range_zarr = './load_data/range.zarr'
meta_file = './load_data/meta.toml'

mc.load_gamma_flatten_rslc(rslc_dir,reference,hgt,scratch_dir,rslc_zarr,chunks=(1000,1000),threads_per_worker=4)
mc.load_gamma_lat_lon_hgt(diff_par,rslc_par,dem_par,hgt,scratch_dir,lat_zarr,lon_zarr,hgt_zarr,chunks=(1000,1000))
mc.load_gamma_look_vector(theta,phi,lt,rslc_par,dem_par,scratch_dir,theta_zarr,phi_zarr,chunks=(1000,1000))
mc.load_gamma_range(rslc_par,range_zarr,chunks=(1000,1000))
mc.load_gamma_metadata(rslc_dir,dem_par,reference,meta_file)

2024-08-07 17:07:35 - log_args - INFO - running function: load_gamma_flatten_rslc
2024-08-07 17:07:35 - log_args - INFO - fetching args:
2024-08-07 17:07:35 - log_args - INFO - rslc_dir = '../../../data/gamma/rslc'
2024-08-07 17:07:35 - log_args - INFO - reference = '20220620'
2024-08-07 17:07:35 - log_args - INFO - hgt = '../../../data/gamma/geocoding/20210802.hgt'
2024-08-07 17:07:35 - log_args - INFO - scratch_dir = './load_data/scratch'
2024-08-07 17:07:35 - log_args - INFO - rslc = './load_data/rslc.zarr'
2024-08-07 17:07:35 - log_args - INFO - chunks = (1000, 1000)
2024-08-07 17:07:35 - log_args - INFO - processes = False
2024-08-07 17:07:35 - log_args - INFO - n_workers = 1
2024-08-07 17:07:35 - log_args - INFO - threads_per_worker = 4
2024-08-07 17:07:35 - log_args - INFO - dask_cluster_arg = {}
2024-08-07 17:07:35 - log_args - INFO - fetching args done.
2024-08-07 17:07:36 - load_gamma_flatten_rslc - INFO - rslc found: 
        date                                    rslc  \
0   20210802  ../../../data/gamma/rslc/20210802.rslc   
1   20210816  ../../../data/gamma/rslc/20210816.rslc   
2   20210830  ../../../data/gamma/rslc/20210830.rslc   
3   20210913  ../../../data/gamma/rslc/20210913.rslc   
4   20211011  ../../../data/gamma/rslc/20211011.rslc   
5   20211025  ../../../data/gamma/rslc/20211025.rslc   
6   20220606  ../../../data/gamma/rslc/20220606.rslc   
7   20220620  ../../../data/gamma/rslc/20220620.rslc   
8   20220704  ../../../data/gamma/rslc/20220704.rslc   
9   20220718  ../../../data/gamma/rslc/20220718.rslc   
10  20220801  ../../../data/gamma/rslc/20220801.rslc   
11  20220815  ../../../data/gamma/rslc/20220815.rslc   
12  20220829  ../../../data/gamma/rslc/20220829.rslc   
13  20220912  ../../../data/gamma/rslc/20220912.rslc   
14  20220926  ../../../data/gamma/rslc/20220926.rslc   
15  20221010  ../../../data/gamma/rslc/20221010.rslc   
16  20221024  ../../../data/gamma/rslc/20221024.rslc   

                                           par  
0   ../../../data/gamma/rslc/20210802.rslc.par  
1   ../../../data/gamma/rslc/20210816.rslc.par  
2   ../../../data/gamma/rslc/20210830.rslc.par  
3   ../../../data/gamma/rslc/20210913.rslc.par  
4   ../../../data/gamma/rslc/20211011.rslc.par  
5   ../../../data/gamma/rslc/20211025.rslc.par  
6   ../../../data/gamma/rslc/20220606.rslc.par  
7   ../../../data/gamma/rslc/20220620.rslc.par  
8   ../../../data/gamma/rslc/20220704.rslc.par  
9   ../../../data/gamma/rslc/20220718.rslc.par  
10  ../../../data/gamma/rslc/20220801.rslc.par  
11  ../../../data/gamma/rslc/20220815.rslc.par  
12  ../../../data/gamma/rslc/20220829.rslc.par  
13  ../../../data/gamma/rslc/20220912.rslc.par  
14  ../../../data/gamma/rslc/20220926.rslc.par  
15  ../../../data/gamma/rslc/20221010.rslc.par  
16  ../../../data/gamma/rslc/20221024.rslc.par  
2024-08-07 17:07:36 - load_gamma_flatten_rslc - INFO - number of images: 17.
2024-08-07 17:07:36 - load_gamma_flatten_rslc - INFO - image number of lines: 2500.
2024-08-07 17:07:36 - load_gamma_flatten_rslc - INFO - image width: 1834.
2024-08-07 17:07:36 - load_gamma_flatten_rslc - INFO - run gamma command to generate required data for flattened rslcs:
2024-08-07 17:07:36 - load_gamma_flatten_rslc - INFO - run command: create_offset ../../../data/gamma/rslc/20220620.rslc.par ../../../data/gamma/rslc/20210802.rslc.par load_data/scratch/20220620_20210802.off 1 1 1 0 >> load_data/scratch/gamma.log
2024-08-07 17:07:36 - load_gamma_flatten_rslc - INFO - load_data/scratch/20220620_20210802.sim_orb exists. skip runing phase_sim_orb ../../../data/gamma/rslc/20220620.rslc.par ../../../data/gamma/rslc/20210802.rslc.par load_data/scratch/20220620_20210802.off ../../../data/gamma/geocoding/20210802.hgt load_data/scratch/20220620_20210802.sim_orb ../../../data/gamma/rslc/20220620.rslc.par - - 1 1 >> load_data/scratch/gamma.log
2024-08-07 17:07:36 - load_gamma_flatten_rslc - INFO - run command: create_offset ../../../data/gamma/rslc/20220620.rslc.par ../../../data/gamma/rslc/20210816.rslc.par load_data/scratch/20220620_20210816.off 1 1 1 0 >> load_data/scratch/gamma.log
2024-08-07 17:07:36 - load_gamma_flatten_rslc - INFO - load_data/scratch/20220620_20210816.sim_orb exists. skip runing phase_sim_orb ../../../data/gamma/rslc/20220620.rslc.par ../../../data/gamma/rslc/20210816.rslc.par load_data/scratch/20220620_20210816.off ../../../data/gamma/geocoding/20210802.hgt load_data/scratch/20220620_20210816.sim_orb ../../../data/gamma/rslc/20220620.rslc.par - - 1 1 >> load_data/scratch/gamma.log
2024-08-07 17:07:36 - load_gamma_flatten_rslc - INFO - run command: create_offset ../../../data/gamma/rslc/20220620.rslc.par ../../../data/gamma/rslc/20210830.rslc.par load_data/scratch/20220620_20210830.off 1 1 1 0 >> load_data/scratch/gamma.log
2024-08-07 17:07:36 - load_gamma_flatten_rslc - INFO - load_data/scratch/20220620_20210830.sim_orb exists. skip runing phase_sim_orb ../../../data/gamma/rslc/20220620.rslc.par ../../../data/gamma/rslc/20210830.rslc.par load_data/scratch/20220620_20210830.off ../../../data/gamma/geocoding/20210802.hgt load_data/scratch/20220620_20210830.sim_orb ../../../data/gamma/rslc/20220620.rslc.par - - 1 1 >> load_data/scratch/gamma.log
2024-08-07 17:07:36 - load_gamma_flatten_rslc - INFO - run command: create_offset ../../../data/gamma/rslc/20220620.rslc.par ../../../data/gamma/rslc/20210913.rslc.par load_data/scratch/20220620_20210913.off 1 1 1 0 >> load_data/scratch/gamma.log
2024-08-07 17:07:36 - load_gamma_flatten_rslc - INFO - load_data/scratch/20220620_20210913.sim_orb exists. skip runing phase_sim_orb ../../../data/gamma/rslc/20220620.rslc.par ../../../data/gamma/rslc/20210913.rslc.par load_data/scratch/20220620_20210913.off ../../../data/gamma/geocoding/20210802.hgt load_data/scratch/20220620_20210913.sim_orb ../../../data/gamma/rslc/20220620.rslc.par - - 1 1 >> load_data/scratch/gamma.log
2024-08-07 17:07:36 - load_gamma_flatten_rslc - INFO - run command: create_offset ../../../data/gamma/rslc/20220620.rslc.par ../../../data/gamma/rslc/20211011.rslc.par load_data/scratch/20220620_20211011.off 1 1 1 0 >> load_data/scratch/gamma.log
2024-08-07 17:07:37 - load_gamma_flatten_rslc - INFO - load_data/scratch/20220620_20211011.sim_orb exists. skip runing phase_sim_orb ../../../data/gamma/rslc/20220620.rslc.par ../../../data/gamma/rslc/20211011.rslc.par load_data/scratch/20220620_20211011.off ../../../data/gamma/geocoding/20210802.hgt load_data/scratch/20220620_20211011.sim_orb ../../../data/gamma/rslc/20220620.rslc.par - - 1 1 >> load_data/scratch/gamma.log
2024-08-07 17:07:37 - load_gamma_flatten_rslc - INFO - run command: create_offset ../../../data/gamma/rslc/20220620.rslc.par ../../../data/gamma/rslc/20211025.rslc.par load_data/scratch/20220620_20211025.off 1 1 1 0 >> load_data/scratch/gamma.log
2024-08-07 17:07:37 - load_gamma_flatten_rslc - INFO - load_data/scratch/20220620_20211025.sim_orb exists. skip runing phase_sim_orb ../../../data/gamma/rslc/20220620.rslc.par ../../../data/gamma/rslc/20211025.rslc.par load_data/scratch/20220620_20211025.off ../../../data/gamma/geocoding/20210802.hgt load_data/scratch/20220620_20211025.sim_orb ../../../data/gamma/rslc/20220620.rslc.par - - 1 1 >> load_data/scratch/gamma.log
2024-08-07 17:07:37 - load_gamma_flatten_rslc - INFO - run command: create_offset ../../../data/gamma/rslc/20220620.rslc.par ../../../data/gamma/rslc/20220606.rslc.par load_data/scratch/20220620_20220606.off 1 1 1 0 >> load_data/scratch/gamma.log
2024-08-07 17:07:37 - load_gamma_flatten_rslc - INFO - load_data/scratch/20220620_20220606.sim_orb exists. skip runing phase_sim_orb ../../../data/gamma/rslc/20220620.rslc.par ../../../data/gamma/rslc/20220606.rslc.par load_data/scratch/20220620_20220606.off ../../../data/gamma/geocoding/20210802.hgt load_data/scratch/20220620_20220606.sim_orb ../../../data/gamma/rslc/20220620.rslc.par - - 1 1 >> load_data/scratch/gamma.log
2024-08-07 17:07:37 - load_gamma_flatten_rslc - INFO - run command: create_offset ../../../data/gamma/rslc/20220620.rslc.par ../../../data/gamma/rslc/20220620.rslc.par load_data/scratch/20220620_20220620.off 1 1 1 0 >> load_data/scratch/gamma.log
2024-08-07 17:07:37 - load_gamma_flatten_rslc - INFO - load_data/scratch/20220620_20220620.sim_orb exists. skip runing phase_sim_orb ../../../data/gamma/rslc/20220620.rslc.par ../../../data/gamma/rslc/20220620.rslc.par load_data/scratch/20220620_20220620.off ../../../data/gamma/geocoding/20210802.hgt load_data/scratch/20220620_20220620.sim_orb ../../../data/gamma/rslc/20220620.rslc.par - - 1 1 >> load_data/scratch/gamma.log
2024-08-07 17:07:37 - load_gamma_flatten_rslc - INFO - run command: create_offset ../../../data/gamma/rslc/20220620.rslc.par ../../../data/gamma/rslc/20220704.rslc.par load_data/scratch/20220620_20220704.off 1 1 1 0 >> load_data/scratch/gamma.log
2024-08-07 17:07:37 - load_gamma_flatten_rslc - INFO - load_data/scratch/20220620_20220704.sim_orb exists. skip runing phase_sim_orb ../../../data/gamma/rslc/20220620.rslc.par ../../../data/gamma/rslc/20220704.rslc.par load_data/scratch/20220620_20220704.off ../../../data/gamma/geocoding/20210802.hgt load_data/scratch/20220620_20220704.sim_orb ../../../data/gamma/rslc/20220620.rslc.par - - 1 1 >> load_data/scratch/gamma.log
2024-08-07 17:07:37 - load_gamma_flatten_rslc - INFO - run command: create_offset ../../../data/gamma/rslc/20220620.rslc.par ../../../data/gamma/rslc/20220718.rslc.par load_data/scratch/20220620_20220718.off 1 1 1 0 >> load_data/scratch/gamma.log
2024-08-07 17:07:37 - load_gamma_flatten_rslc - INFO - load_data/scratch/20220620_20220718.sim_orb exists. skip runing phase_sim_orb ../../../data/gamma/rslc/20220620.rslc.par ../../../data/gamma/rslc/20220718.rslc.par load_data/scratch/20220620_20220718.off ../../../data/gamma/geocoding/20210802.hgt load_data/scratch/20220620_20220718.sim_orb ../../../data/gamma/rslc/20220620.rslc.par - - 1 1 >> load_data/scratch/gamma.log
2024-08-07 17:07:37 - load_gamma_flatten_rslc - INFO - run command: create_offset ../../../data/gamma/rslc/20220620.rslc.par ../../../data/gamma/rslc/20220801.rslc.par load_data/scratch/20220620_20220801.off 1 1 1 0 >> load_data/scratch/gamma.log
2024-08-07 17:07:37 - load_gamma_flatten_rslc - INFO - load_data/scratch/20220620_20220801.sim_orb exists. skip runing phase_sim_orb ../../../data/gamma/rslc/20220620.rslc.par ../../../data/gamma/rslc/20220801.rslc.par load_data/scratch/20220620_20220801.off ../../../data/gamma/geocoding/20210802.hgt load_data/scratch/20220620_20220801.sim_orb ../../../data/gamma/rslc/20220620.rslc.par - - 1 1 >> load_data/scratch/gamma.log
2024-08-07 17:07:37 - load_gamma_flatten_rslc - INFO - run command: create_offset ../../../data/gamma/rslc/20220620.rslc.par ../../../data/gamma/rslc/20220815.rslc.par load_data/scratch/20220620_20220815.off 1 1 1 0 >> load_data/scratch/gamma.log
2024-08-07 17:07:37 - load_gamma_flatten_rslc - INFO - load_data/scratch/20220620_20220815.sim_orb exists. skip runing phase_sim_orb ../../../data/gamma/rslc/20220620.rslc.par ../../../data/gamma/rslc/20220815.rslc.par load_data/scratch/20220620_20220815.off ../../../data/gamma/geocoding/20210802.hgt load_data/scratch/20220620_20220815.sim_orb ../../../data/gamma/rslc/20220620.rslc.par - - 1 1 >> load_data/scratch/gamma.log
2024-08-07 17:07:37 - load_gamma_flatten_rslc - INFO - run command: create_offset ../../../data/gamma/rslc/20220620.rslc.par ../../../data/gamma/rslc/20220829.rslc.par load_data/scratch/20220620_20220829.off 1 1 1 0 >> load_data/scratch/gamma.log
2024-08-07 17:07:37 - load_gamma_flatten_rslc - INFO - load_data/scratch/20220620_20220829.sim_orb exists. skip runing phase_sim_orb ../../../data/gamma/rslc/20220620.rslc.par ../../../data/gamma/rslc/20220829.rslc.par load_data/scratch/20220620_20220829.off ../../../data/gamma/geocoding/20210802.hgt load_data/scratch/20220620_20220829.sim_orb ../../../data/gamma/rslc/20220620.rslc.par - - 1 1 >> load_data/scratch/gamma.log
2024-08-07 17:07:37 - load_gamma_flatten_rslc - INFO - run command: create_offset ../../../data/gamma/rslc/20220620.rslc.par ../../../data/gamma/rslc/20220912.rslc.par load_data/scratch/20220620_20220912.off 1 1 1 0 >> load_data/scratch/gamma.log
2024-08-07 17:07:37 - load_gamma_flatten_rslc - INFO - load_data/scratch/20220620_20220912.sim_orb exists. skip runing phase_sim_orb ../../../data/gamma/rslc/20220620.rslc.par ../../../data/gamma/rslc/20220912.rslc.par load_data/scratch/20220620_20220912.off ../../../data/gamma/geocoding/20210802.hgt load_data/scratch/20220620_20220912.sim_orb ../../../data/gamma/rslc/20220620.rslc.par - - 1 1 >> load_data/scratch/gamma.log
2024-08-07 17:07:37 - load_gamma_flatten_rslc - INFO - run command: create_offset ../../../data/gamma/rslc/20220620.rslc.par ../../../data/gamma/rslc/20220926.rslc.par load_data/scratch/20220620_20220926.off 1 1 1 0 >> load_data/scratch/gamma.log
2024-08-07 17:07:37 - load_gamma_flatten_rslc - INFO - load_data/scratch/20220620_20220926.sim_orb exists. skip runing phase_sim_orb ../../../data/gamma/rslc/20220620.rslc.par ../../../data/gamma/rslc/20220926.rslc.par load_data/scratch/20220620_20220926.off ../../../data/gamma/geocoding/20210802.hgt load_data/scratch/20220620_20220926.sim_orb ../../../data/gamma/rslc/20220620.rslc.par - - 1 1 >> load_data/scratch/gamma.log
2024-08-07 17:07:37 - load_gamma_flatten_rslc - INFO - run command: create_offset ../../../data/gamma/rslc/20220620.rslc.par ../../../data/gamma/rslc/20221010.rslc.par load_data/scratch/20220620_20221010.off 1 1 1 0 >> load_data/scratch/gamma.log
2024-08-07 17:07:37 - load_gamma_flatten_rslc - INFO - load_data/scratch/20220620_20221010.sim_orb exists. skip runing phase_sim_orb ../../../data/gamma/rslc/20220620.rslc.par ../../../data/gamma/rslc/20221010.rslc.par load_data/scratch/20220620_20221010.off ../../../data/gamma/geocoding/20210802.hgt load_data/scratch/20220620_20221010.sim_orb ../../../data/gamma/rslc/20220620.rslc.par - - 1 1 >> load_data/scratch/gamma.log
2024-08-07 17:07:37 - load_gamma_flatten_rslc - INFO - run command: create_offset ../../../data/gamma/rslc/20220620.rslc.par ../../../data/gamma/rslc/20221024.rslc.par load_data/scratch/20220620_20221024.off 1 1 1 0 >> load_data/scratch/gamma.log
2024-08-07 17:07:37 - load_gamma_flatten_rslc - INFO - load_data/scratch/20220620_20221024.sim_orb exists. skip runing phase_sim_orb ../../../data/gamma/rslc/20220620.rslc.par ../../../data/gamma/rslc/20221024.rslc.par load_data/scratch/20220620_20221024.off ../../../data/gamma/geocoding/20210802.hgt load_data/scratch/20220620_20221024.sim_orb ../../../data/gamma/rslc/20220620.rslc.par - - 1 1 >> load_data/scratch/gamma.log
2024-08-07 17:07:37 - load_gamma_flatten_rslc - INFO - gamma command finished.
2024-08-07 17:07:37 - load_gamma_flatten_rslc - INFO - using dask to load data in gamma binary format to calculate flatten rslcs and save it to zarr.
2024-08-07 17:07:37 - load_gamma_flatten_rslc - INFO - starting dask local cluster.
2024-08-07 17:07:38 - load_gamma_flatten_rslc - INFO - dask local cluster started.
2024-08-07 17:07:38 - dask_cluster_info - INFO - dask cluster: LocalCluster(dashboard_link='http://10.211.48.15:8787/status', workers=1, threads=4, memory=1.46 TiB)
2024-08-07 17:07:38 - darr_info - INFO - flattened rslc dask array shape, chunksize, dtype: (2500, 1834, 17), (2500, 1834, 1), complex64
2024-08-07 17:07:38 - zarr_info - INFO - ./load_data/rslc.zarr zarray shape, chunks, dtype: (2500, 1834, 17), (1000, 1000, 1), complex64
2024-08-07 17:07:38 - load_gamma_flatten_rslc - INFO - computing graph setted. doing all the computing.
2024-08-07 17:07:41 - load_gamma_flatten_rslc - INFO - computing finished.
2024-08-07 17:07:41 - load_gamma_flatten_rslc - INFO - dask cluster closed.
2024-08-07 17:07:41 - log_args - INFO - running function: load_gamma_lat_lon_hgt
2024-08-07 17:07:41 - log_args - INFO - fetching args:
2024-08-07 17:07:41 - log_args - INFO - diff_par = '../../../data/gamma/geocoding/20210802.diff_par'
2024-08-07 17:07:41 - log_args - INFO - rslc_par = '../../../data/gamma/rslc/20220620.rslc.par'
2024-08-07 17:07:41 - log_args - INFO - dem_par = '../../../data/gamma/DEM/dem_seg_par'
2024-08-07 17:07:41 - log_args - INFO - hgt = '../../../data/gamma/geocoding/20210802.hgt'
2024-08-07 17:07:41 - log_args - INFO - scratch_dir = './load_data/scratch'
2024-08-07 17:07:41 - log_args - INFO - lat_zarr = './load_data/lat.zarr'
2024-08-07 17:07:41 - log_args - INFO - lon_zarr = './load_data/lon.zarr'
2024-08-07 17:07:41 - log_args - INFO - hgt_zarr = './load_data/hgt.zarr'
2024-08-07 17:07:41 - log_args - INFO - chunks = (1000, 1000)
2024-08-07 17:07:41 - log_args - INFO - fetching args done.
2024-08-07 17:07:41 - load_gamma_lat_lon_hgt - INFO - image shape: (2500,1834)
2024-08-07 17:07:41 - load_gamma_lat_lon_hgt - INFO - run gamma command to generate longitude, latitude and height:
2024-08-07 17:07:41 - load_gamma_lat_lon_hgt - INFO - load_data/scratch/plist exists. skip runing mkgrid load_data/scratch/plist 1834 2500 1 1 >> load_data/scratch/gamma.log
2024-08-07 17:07:41 - load_gamma_lat_lon_hgt - INFO - load_data/scratch/phgt_wgs84 exists. skip runing pt2geo load_data/scratch/plist - ../../../data/gamma/rslc/20220620.rslc.par - ../../../data/gamma/geocoding/20210802.hgt ../../../data/gamma/DEM/dem_seg_par ../../../data/gamma/geocoding/20210802.diff_par 1 1 - - load_data/scratch/plat_lon load_data/scratch/phgt_wgs84 >> load_data/scratch/gamma.log
2024-08-07 17:07:41 - load_gamma_lat_lon_hgt - INFO - writing zarr file.
2024-08-07 17:07:42 - load_gamma_lat_lon_hgt - INFO - write done.
2024-08-07 17:07:42 - log_args - INFO - running function: load_gamma_look_vector
2024-08-07 17:07:42 - log_args - INFO - fetching args:
2024-08-07 17:07:42 - log_args - INFO - theta = '../../../data/gamma/geocoding/20210802.lv_theta'
2024-08-07 17:07:42 - log_args - INFO - phi = '../../../data/gamma/geocoding/20210802.lv_phi'
2024-08-07 17:07:42 - log_args - INFO - lt = '../../../data/gamma/geocoding/20210802.lt_fine'
2024-08-07 17:07:42 - log_args - INFO - rslc_par = '../../../data/gamma/rslc/20220620.rslc.par'
2024-08-07 17:07:42 - log_args - INFO - dem_par = '../../../data/gamma/DEM/dem_seg_par'
2024-08-07 17:07:42 - log_args - INFO - scratch_dir = './load_data/scratch'
2024-08-07 17:07:42 - log_args - INFO - theta_zarr = './load_data/theta.zarr'
2024-08-07 17:07:42 - log_args - INFO - phi_zarr = './load_data/phi.zarr'
2024-08-07 17:07:42 - log_args - INFO - chunks = (1000, 1000)
2024-08-07 17:07:42 - log_args - INFO - fetching args done.
2024-08-07 17:07:42 - load_gamma_look_vector - INFO - image shape: (2500,1834)
2024-08-07 17:07:42 - load_gamma_look_vector - INFO - load_data/scratch/theta_rdc exists. skip runing geocode ../../../data/gamma/geocoding/20210802.lt_fine ../../../data/gamma/geocoding/20210802.lv_theta 5741 load_data/scratch/theta_rdc 1834 2500 >> load_data/scratch/gamma.log
2024-08-07 17:07:42 - load_gamma_look_vector - INFO - writing data.
2024-08-07 17:07:42 - load_gamma_look_vector - INFO - load_data/scratch/phi_rdc exists. skip runing geocode ../../../data/gamma/geocoding/20210802.lt_fine ../../../data/gamma/geocoding/20210802.lv_phi 5741 load_data/scratch/phi_rdc 1834 2500 >> load_data/scratch/gamma.log
2024-08-07 17:07:42 - load_gamma_look_vector - INFO - writing data.
2024-08-07 17:07:42 - load_gamma_look_vector - INFO - Done.
2024-08-07 17:07:42 - log_args - INFO - running function: load_gamma_range
2024-08-07 17:07:42 - log_args - INFO - fetching args:
2024-08-07 17:07:42 - log_args - INFO - rslc_par = '../../../data/gamma/rslc/20220620.rslc.par'
2024-08-07 17:07:42 - log_args - INFO - range_zarr = './load_data/range.zarr'
2024-08-07 17:07:42 - log_args - INFO - chunks = (1000, 1000)
2024-08-07 17:07:42 - log_args - INFO - fetching args done.
2024-08-07 17:07:42 - load_gamma_range - INFO - image shape: (2500,1834)
2024-08-07 17:07:42 - load_gamma_range - INFO - Calculating slant range distance.
2024-08-07 17:07:42 - load_gamma_range - INFO - writing data.
2024-08-07 17:07:42 - load_gamma_range - INFO - Done.
2024-08-07 17:07:42 - log_args - INFO - running function: load_gamma_metadata
2024-08-07 17:07:42 - log_args - INFO - fetching args:
2024-08-07 17:07:42 - log_args - INFO - rslc_dir = '../../../data/gamma/rslc'
2024-08-07 17:07:42 - log_args - INFO - dem_par = '../../../data/gamma/DEM/dem_seg_par'
2024-08-07 17:07:42 - log_args - INFO - reference = '20220620'
2024-08-07 17:07:42 - log_args - INFO - meta_file = './load_data/meta.toml'
2024-08-07 17:07:42 - log_args - INFO - fetching args done.
2024-08-07 17:07:42 - load_gamma_metadata - INFO - fetching slc related metadata.
2024-08-07 17:07:42 - load_gamma_metadata - INFO - Fetching heading angle
2024-08-07 17:07:42 - load_gamma_metadata - INFO - Fetching range pixel spacing
2024-08-07 17:07:42 - load_gamma_metadata - INFO - fetching azimuth pixel spacing
2024-08-07 17:07:42 - load_gamma_metadata - INFO - Fetching randar wavelength
2024-08-07 17:07:42 - load_gamma_metadata - INFO - fetching dem related metadata
2024-08-07 17:07:42 - load_gamma_metadata - INFO - Run gamma command to calculate baseline:
2024-08-07 17:07:42 - load_gamma_metadata - INFO - run command: base_calc /tmp/tmp5f4_ain_/slc_tab ../../../data/gamma/rslc/20220620.rslc.par /tmp/tmp5f4_ain_/bperp /tmp/tmp5f4_ain_/itab - > /tmp/tmp5f4_ain_/log
2024-08-07 17:07:43 - load_gamma_metadata - INFO - gamma command finished.
2024-08-07 17:07:43 - load_gamma_metadata - INFO - All meta data: 
dates = [ "20210802", "20210816", "20210830", "20210913", "20211011", "20211025", "20220606", "20220620", "20220704", "20220718", "20220801", "20220815", "20220829", "20220912", "20220926", "20221010", "20221024",]
radar_wavelength = 0.24245249210715603
range_pixel_spacing = 4.29054
azimuth_pixel_spacing = 3.740105
lonlat_bbox = [ -148.2606018, 61.099475398661994, -147.89598577255998, 61.2183333,]
merca_bbox = [ -16504294.694782883, 8648700.085300261, -16463705.824278845, 8676129.004166307,]
perpendicular_baseline = [ -97.61360168457031, -45.58580017089844, 17.86680030822754, -26.258899688720703, -63.72420120239258, -56.363399505615234, 64.75759887695312, 0.0, -9.043999671936035, -13.02869987487793, -112.94960021972656, -86.09490203857422, -129.9635009765625, -127.6594009399414, -182.29519653320312, -129.735107421875, -184.31100463867188,]

2024-08-07 17:07:43 - load_gamma_metadata - INFO - writing data in toml file.
2024-08-07 17:07:43 - load_gamma_metadata - INFO - Done.

Here we get all needed data: look vector, latitude, lontitude, height, metadata, slant range distance, and flattened rslc stack.

visualize the loaded interferograms

Then we can visualize the loaded data, e.g., the interferograms:

mc.ras_pyramid(rslc_zarr, './load_data/rslc_pyramid')

2024-08-07 17:07:43 - log_args - INFO - running function: ras_pyramid
2024-08-07 17:07:43 - log_args - INFO - fetching args:
2024-08-07 17:07:43 - log_args - INFO - ras = './load_data/rslc.zarr'
2024-08-07 17:07:43 - log_args - INFO - out_dir = './load_data/rslc_pyramid'
2024-08-07 17:07:43 - log_args - INFO - chunks = (256, 256)
2024-08-07 17:07:43 - log_args - INFO - processes = False
2024-08-07 17:07:43 - log_args - INFO - n_workers = 1
2024-08-07 17:07:43 - log_args - INFO - threads_per_worker = 2
2024-08-07 17:07:43 - log_args - INFO - dask_cluster_arg = {}
2024-08-07 17:07:43 - log_args - INFO - fetching args done.
2024-08-07 17:07:44 - zarr_info - INFO - ./load_data/rslc.zarr zarray shape, chunks, dtype: (2500, 1834, 17), (1000, 1000, 1), complex64
2024-08-07 17:07:44 - ras_pyramid - INFO - rendered raster pyramid with zoom level ranging from 0 (finest resolution) to 10 (coarsest resolution).
2024-08-07 17:07:44 - ras_pyramid - INFO - dask local cluster started.
2024-08-07 17:07:44 - dask_cluster_info - INFO - dask cluster: LocalCluster(dashboard_link='http://10.211.48.15:8787/status', workers=1, threads=2, memory=1.46 TiB)
2024-08-07 17:07:44 - darr_info - INFO - downsampled ras dask array in level 0 dask array shape, chunksize, dtype: (2500, 1834, 17), (2500, 1834, 1), complex64
2024-08-07 17:07:44 - zarr_info - INFO - load_data/rslc_pyramid/0.zarr zarray shape, chunks, dtype: (2500, 1834, 17), (256, 256, 1), complex64
2024-08-07 17:07:44 - darr_info - INFO - downsampled ras dask array in level 1 dask array shape, chunksize, dtype: (1250, 917, 17), (1250, 917, 1), complex64
2024-08-07 17:07:44 - zarr_info - INFO - load_data/rslc_pyramid/1.zarr zarray shape, chunks, dtype: (1250, 917, 17), (256, 256, 1), complex64
2024-08-07 17:07:44 - darr_info - INFO - downsampled ras dask array in level 2 dask array shape, chunksize, dtype: (625, 459, 17), (625, 459, 1), complex64
2024-08-07 17:07:44 - zarr_info - INFO - load_data/rslc_pyramid/2.zarr zarray shape, chunks, dtype: (625, 459, 17), (256, 256, 1), complex64
2024-08-07 17:07:44 - darr_info - INFO - downsampled ras dask array in level 3 dask array shape, chunksize, dtype: (313, 230, 17), (313, 230, 1), complex64
2024-08-07 17:07:44 - zarr_info - INFO - load_data/rslc_pyramid/3.zarr zarray shape, chunks, dtype: (313, 230, 17), (256, 256, 1), complex64
2024-08-07 17:07:44 - darr_info - INFO - downsampled ras dask array in level 4 dask array shape, chunksize, dtype: (157, 115, 17), (157, 115, 1), complex64
2024-08-07 17:07:44 - zarr_info - INFO - load_data/rslc_pyramid/4.zarr zarray shape, chunks, dtype: (157, 115, 17), (256, 256, 1), complex64
2024-08-07 17:07:44 - darr_info - INFO - downsampled ras dask array in level 5 dask array shape, chunksize, dtype: (79, 58, 17), (79, 58, 1), complex64
2024-08-07 17:07:44 - zarr_info - INFO - load_data/rslc_pyramid/5.zarr zarray shape, chunks, dtype: (79, 58, 17), (256, 256, 1), complex64
2024-08-07 17:07:44 - darr_info - INFO - downsampled ras dask array in level 6 dask array shape, chunksize, dtype: (40, 29, 17), (40, 29, 1), complex64
2024-08-07 17:07:44 - zarr_info - INFO - load_data/rslc_pyramid/6.zarr zarray shape, chunks, dtype: (40, 29, 17), (256, 256, 1), complex64
2024-08-07 17:07:44 - darr_info - INFO - downsampled ras dask array in level 7 dask array shape, chunksize, dtype: (20, 15, 17), (20, 15, 1), complex64
2024-08-07 17:07:44 - zarr_info - INFO - load_data/rslc_pyramid/7.zarr zarray shape, chunks, dtype: (20, 15, 17), (256, 256, 1), complex64
2024-08-07 17:07:44 - darr_info - INFO - downsampled ras dask array in level 8 dask array shape, chunksize, dtype: (10, 8, 17), (10, 8, 1), complex64
2024-08-07 17:07:44 - zarr_info - INFO - load_data/rslc_pyramid/8.zarr zarray shape, chunks, dtype: (10, 8, 17), (256, 256, 1), complex64
2024-08-07 17:07:44 - darr_info - INFO - downsampled ras dask array in level 9 dask array shape, chunksize, dtype: (5, 4, 17), (5, 4, 1), complex64
2024-08-07 17:07:44 - zarr_info - INFO - load_data/rslc_pyramid/9.zarr zarray shape, chunks, dtype: (5, 4, 17), (256, 256, 1), complex64
2024-08-07 17:07:44 - darr_info - INFO - downsampled ras dask array in level 10 dask array shape, chunksize, dtype: (3, 2, 17), (3, 2, 1), complex64
2024-08-07 17:07:44 - zarr_info - INFO - load_data/rslc_pyramid/10.zarr zarray shape, chunks, dtype: (3, 2, 17), (256, 256, 1), complex64
2024-08-07 17:07:44 - ras_pyramid - INFO - computing graph setted. doing all the computing.
2024-08-07 17:07:49 - ras_pyramid - INFO - computing finished. 4.6s

2024-08-07 17:07:49,535 - distributed.worker - ERROR - Unexpected exception during heartbeat. Closing worker.
Traceback (most recent call last):
  File "/users/kangl/miniforge3/envs/work/lib/python3.10/site-packages/distributed/worker.py", line 1252, in heartbeat
    response = await retry_operation(
  File "/users/kangl/miniforge3/envs/work/lib/python3.10/site-packages/distributed/utils_comm.py", line 455, in retry_operation
    return await retry(
  File "/users/kangl/miniforge3/envs/work/lib/python3.10/site-packages/distributed/utils_comm.py", line 434, in retry
    return await coro()
  File "/users/kangl/miniforge3/envs/work/lib/python3.10/site-packages/distributed/core.py", line 1392, in send_recv_from_rpc
    comm = await self.pool.connect(self.addr)
  File "/users/kangl/miniforge3/envs/work/lib/python3.10/site-packages/distributed/core.py", line 1591, in connect
    raise RuntimeError("ConnectionPool is closed")
RuntimeError: ConnectionPool is closed
2024-08-07 17:07:49,538 - tornado.application - ERROR - Exception in callback <bound method Worker.heartbeat of <Worker 'inproc://10.211.48.15/1986199/14', name: 0, status: closed, stored: 0, running: 0/2, ready: 0, comm: 0, waiting: 0>>
Traceback (most recent call last):
  File "/users/kangl/miniforge3/envs/work/lib/python3.10/site-packages/tornado/ioloop.py", line 939, in _run
    await val
  File "/users/kangl/miniforge3/envs/work/lib/python3.10/site-packages/distributed/worker.py", line 1252, in heartbeat
    response = await retry_operation(
  File "/users/kangl/miniforge3/envs/work/lib/python3.10/site-packages/distributed/utils_comm.py", line 455, in retry_operation
    return await retry(
  File "/users/kangl/miniforge3/envs/work/lib/python3.10/site-packages/distributed/utils_comm.py", line 434, in retry
    return await coro()
  File "/users/kangl/miniforge3/envs/work/lib/python3.10/site-packages/distributed/core.py", line 1392, in send_recv_from_rpc
    comm = await self.pool.connect(self.addr)
  File "/users/kangl/miniforge3/envs/work/lib/python3.10/site-packages/distributed/core.py", line 1591, in connect
    raise RuntimeError("ConnectionPool is closed")
RuntimeError: ConnectionPool is closed

2024-08-07 17:07:49 - ras_pyramid - INFO - dask cluster closed.

import toml
with open(meta_file,'r') as f:
    meta = toml.load(f)
dates = meta['dates']

import holoviews as hv
hv.extension('bokeh')
hv.output(widget_location='bottom')
from bokeh.models import WheelZoomTool
from holoviews import opts
import numpy as np

Interferograms with the first slc as secondary:

intf0_plot = mc.ras_plot('./load_data/rslc_pyramid', post_proc='intf_0', level_increase=0)

intf0_plot = intf0_plot.redim(i=hv.Dimension('i', label='Interferogram', range=(0,len(dates)-1), value_format=(lambda i: dates[i]+'_'+dates[0])),
                              x=hv.Dimension('r', label='Range'), y=hv.Dimension('az',label='Azimuth'), z=hv.Dimension('Phase',range=(-np.pi,np.pi)))

intf0_plot.opts(opts.Image(cmap='colorwheel',width=600, height=600, colorbar=True,
                          invert_yaxis=True,
                          default_tools=['pan',WheelZoomTool(zoom_on_axis=False),'save','reset','hover'],active_tools=['wheel_zoom']))

Or all of the interferograms:

intf_plot = mc.ras_plot('./load_data/rslc_pyramid',post_proc='intf_all',n_kdim=2,level_increase=0)

intf_plot = intf_plot.redim(i=hv.Dimension('i', label='Reference Image', range=(0,16), value_format=(lambda i: dates[i])),
                            j=hv.Dimension('j', label='Secondary Image', range=(0,16), value_format=(lambda i: dates[i])),
                            x=hv.Dimension('r', label='Range'), y=hv.Dimension('az',label='Azimuth'), z=hv.Dimension('Phase',range=(-np.pi,np.pi)))

Specify plotting options and plot:

hv.output(widget_location='bottom')
intf_plot.opts(opts.Image(cmap='colorwheel',frame_width=500, frame_height=600, colorbar=True,
                          invert_yaxis=True,
                          default_tools=['pan',WheelZoomTool(zoom_on_axis=False),'save','reset','hover'],active_tools=['wheel_zoom']))

calculate Web Mercator coordinates

For visulization on Google Map tiles, coordinates on Web Mercator projection is needed:

e_zarr = './load_data/e.zarr'
n_zarr = './load_data/n.zarr'

mc.transform(lon_zarr,lat_zarr,e_zarr,n_zarr)

2024-08-07 17:07:50 - log_args - INFO - running function: transform
2024-08-07 17:07:50 - log_args - INFO - fetching args:
2024-08-07 17:07:50 - log_args - INFO - xx_in = './load_data/lon.zarr'
2024-08-07 17:07:50 - log_args - INFO - yy_in = './load_data/lat.zarr'
2024-08-07 17:07:50 - log_args - INFO - xx_out = './load_data/e.zarr'
2024-08-07 17:07:50 - log_args - INFO - yy_out = './load_data/n.zarr'
2024-08-07 17:07:50 - log_args - INFO - epsg_in = 4326
2024-08-07 17:07:50 - log_args - INFO - epsg_out = 3857
2024-08-07 17:07:50 - log_args - INFO - fetching args done.
2024-08-07 17:07:50 - transform - INFO - input EPSG: 4326.
2024-08-07 17:07:50 - zarr_info - INFO - xx_in zarray shape, chunks, dtype: (2500, 1834), (1000, 1000), float64
2024-08-07 17:07:50 - zarr_info - INFO - yy_in zarray shape, chunks, dtype: (2500, 1834), (1000, 1000), float64
2024-08-07 17:07:50 - transform - INFO - output EPSG: 3857.
2024-08-07 17:07:50 - transform - INFO - do the transformation.

Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.

2024-08-07 17:07:55 - transform - INFO - write output.
2024-08-07 17:07:55 - transform - INFO - write done.