[DOWNLOADER] downloads Sentinel-2A L2A data instead of L1C data
I just noticed that the pgSQL database contains entries like this:
The entityid states that the entry belongs to ESA´s processing level L2A but the datasetid 249 is specified to be processing level L1C:
That causes gms_preprocessing to crash in case I try to process an S2A L1C scene which is actually L2A. Thats why the homogenization pipeline is written for S2A L1C data:
gfz-fe@geoms:~/scheffler/python/gms_preprocessing/bin$ python run_gms.py sceneids 28573379
run_gms.py:32: UserWarning: Currently the console argument parser expects the given scenes as already downloaded.
warnings.warn('Currently the console argument parser expects the given scenes as already downloaded.') # TODO
run_gms.py:36: UserWarning: Currently the console argument parser expects the database at localhost.
warnings.warn('Currently the console argument parser expects the database at localhost.') # TODO
run_gms.py:38: UserWarning: Currently the console argument parser sets the virtual sensor ID to 1.
warnings.warn('Currently the console argument parser sets the virtual sensor ID to 1.') # TODO
run_gms.py:40: UserWarning: Currently the console argument parser sets the dataset ID of the spatial reference to 249.
warnings.warn('Currently the console argument parser sets the dataset ID of the spatial reference to 249.') # TODO
New job created successfully. job-ID: 26186485
The job contains:
- 1 Sentinel-2A MSI scene
run_gms.py:112: UserWarning: Currently the console argument parser sets the parallelization level to 'scenes'.
warnings.warn("Currently the console argument parser sets the parallelization level to 'scenes'.") # TODO
2017/09/27 00:01:38: Checking system environment...
2017/09/27 00:01:38: Process Controller initialized for job ID 26186485 (comment: ).
2017/09/27 00:01:38: Execution of entire GeoMultiSens pre-processing chain started...
No logfile named 'Sentinel-2A__MSI__S2A20__L2A_T38SKH_A009613_20170425T075932.log' found for L2A_T38SKH_A009613_20170425T075932 at /geoms/data/processed_scenes/Sentinel-2A/MSI/L2A_T38SKH_A009613_20170425T075932. Dataset has to be reprocessed.
No logfile named 'Sentinel-2A__MSI__S2A60__L2A_T38SKH_A009613_20170425T075932.log' found for L2A_T38SKH_A009613_20170425T075932 at /geoms/data/processed_scenes/Sentinel-2A/MSI/L2A_T38SKH_A009613_20170425T075932. Dataset has to be reprocessed.
No logfile named 'Sentinel-2A__MSI__S2A10__L2A_T38SKH_A009613_20170425T075932.log' found for L2A_T38SKH_A009613_20170425T075932 at /geoms/data/processed_scenes/Sentinel-2A/MSI/L2A_T38SKH_A009613_20170425T075932. Dataset has to be reprocessed.
2017/09/27 00:01:38:
##### Level 1A Processing started - raster format and metadata homogenization ####
2017/09/27 00:01:38 [28573379]: L1A object for Sentinel-2A MSI S2A60 (entity-ID L2A_T38SKH_A009613_20170425T075932) successfully initialized.
2017/09/27 00:01:38 [28573379]: L1A object for Sentinel-2A MSI S2A20 (entity-ID L2A_T38SKH_A009613_20170425T075932) successfully initialized.
2017/09/27 00:01:38 [28573379]: Reading Sentinel-2A MSI S2A60 image data...
2017/09/27 00:01:38 [28573379]: Reading Sentinel-2A MSI S2A20 image data...
2017/09/27 00:01:38 [28573379]: L1A object for Sentinel-2A MSI S2A10 (entity-ID L2A_T38SKH_A009613_20170425T075932) successfully initialized.
2017/09/27 00:01:38 [28573379]: Reading Sentinel-2A MSI S2A10 image data...
2017/09/27 00:01:38 [28573379]:
Traceback (most recent call last):
File "/home/gfz-fe/scheffler/python/gms_preprocessing/gms_preprocessing/misc/exception_handler.py", line 71, in wrapped_GMS_mapper
GMS_objs = GMS_mapper(GMS_objs, **kwargs)
File "/home/gfz-fe/scheffler/python/gms_preprocessing/gms_preprocessing/processing/pipeline.py", line 30, in L1A_map
L1A_obj.import_rasterdata()
File "/home/gfz-fe/scheffler/python/gms_preprocessing/gms_preprocessing/algorithms/L1A_P.py", line 78, in import_rasterdata
self.archive_to_rasObj(self.path_archive, path_output=self.path_InFilePreprocessor)
File "/home/gfz-fe/scheffler/python/gms_preprocessing/gms_preprocessing/algorithms/L1A_P.py", line 133, in archive_to_rasObj
len(image_files))
AssertionError: Expected 3 image files in '/geoms/data/downloaded_data/Sentinel-2A/MSI/S2A_MSIL2A_20170425T075611_N0204_R035_T38SKH_20170425T075932.zip'. Found 0.