Commits · f78b5261c73fc754314738478484bb3a6372f7b5 · geomultisens / gms_preprocessing

27 Nov, 2020 1 commit

SpatialIndexMediator.getFullSceneDataForDataset() now retries the query 10... · ea6bf250

Daniel Scheffler authored Nov 27, 2020

SpatialIndexMediator.getFullSceneDataForDataset() now retries the query 10 times in case of a struct.error (relates to issue #103

).

Signed-off-by: Daniel Scheffler <danschef@gfz-potsdam.de>

ea6bf250

15 Sep, 2020 1 commit

Replaced calls of sorted_nicely with new dependency 'natsort'. Fixed circular... · 51d8c6c2

Daniel Scheffler authored Sep 15, 2020


Replaced calls of sorted_nicely with new dependency 'natsort'. Fixed circular imports. Fixed AssertionError caused by new version of pyproj.

Signed-off-by: Daniel Scheffler <danschef@gfz-potsdam.de>

51d8c6c2

31 Mar, 2020 2 commits

Fixed copy/paste error in license headers. Added .h5 files to GitLFS. Fixed... · ed5527f0

Daniel Scheffler authored Mar 31, 2020


Fixed copy/paste error in license headers. Added .h5 files to GitLFS. Fixed missing bracket. Updated HISTORY.rst and version info.

Signed-off-by: Daniel Scheffler <danschef@gfz-potsdam.de>

ed5527f0

Updated license texts with respect to tqdm. · ddd49df5
Daniel Scheffler authored Mar 31, 2020
```
Signed-off-by: Daniel Scheffler <danschef@gfz-potsdam.de>
```
ddd49df5

30 Mar, 2020 1 commit
- Converted all regular expression strings to raw strings. Revised code style in metadata.py. · 26034202
  Daniel Scheffler authored Mar 30, 2020
```
Signed-off-by: Daniel Scheffler <danschef@gfz-potsdam.de>
```
  26034202
22 Jul, 2019 1 commit
- Added license texts. Updated version info. · 04c0f6e7
  Daniel Scheffler authored Jul 22, 2019
```
Signed-off-by: Daniel Scheffler <danschef@gfz-potsdam.de>
```
  04c0f6e7
28 Mar, 2018 2 commits
- Refactored class process_controller to ProcessController. Merged... · 76a2d7b4
  Daniel Scheffler authored Mar 28, 2018
```
Refactored class process_controller to ProcessController. Merged ProcessController.run_all_processors and ProcessController.run_all_processors_OLD.
```
  76a2d7b4
- Fix tests. Deleted deprecated GMS_system_setup.py. · 7a11d8f9
  Daniel Scheffler authored Mar 28, 2018
  
  7a11d8f9
27 Mar, 2018 2 commits
- Fix tests. · 15b51ddc
  Daniel Scheffler authored Mar 27, 2018
  
  15b51ddc
- Job config is now automatically saved as JSON file. · e4a672bc
  Daniel Scheffler authored Mar 27, 2018
  
  e4a672bc
21 Mar, 2018 2 commits
- Simplified process controller. GMS jobs now delete their own GMS_mem_acquire_lock during shutdown. · 20083316
  Daniel Scheffler authored Mar 21, 2018
  
  20083316
- Replaced SystemExit(). · 2fe80988
  Daniel Scheffler authored Mar 21, 2018
  
  2fe80988
20 Mar, 2018 1 commit
- Fixed logging permission errors. · 0dd12593
  Mathias Peters authored Mar 20, 2018
  
  0dd12593
14 Mar, 2018 4 commits
- Revised process_controller.stop(). · 541b261e
  Daniel Scheffler authored Mar 14, 2018
  
  541b261e
- Disabled SystemExit in process_controller.stop(). · 9fa9e926
  Daniel Scheffler authored Mar 14, 2018
  
  9fa9e926
- Fixed issue #89 . · fbab3ade
  Daniel Scheffler authored Mar 14, 2018
  
  fbab3ade
- Further developed recording of memory usage statistics. Deleted deprecated... · 5c9644e0
  Daniel Scheffler authored Mar 14, 2018
```
Further developed recording of memory usage statistics. Deleted deprecated classes within 'locks' module. Added system overload blocking. Revised default resource limits. Bugfix for not raising exceptions during GMS_pipeline.
```
  5c9644e0
13 Mar, 2018 2 commits
- Bugfix. · 25c10a27
  Daniel Scheffler authored Mar 13, 2018
  
  25c10a27
- SIGTERM (kill/pkill commands) is now properly handled (locks are closed, etc.). · b2f8fbba
  Daniel Scheffler authored Mar 13, 2018
  
  b2f8fbba
12 Mar, 2018 1 commit
- IOLock and ProcessLock are now working properly. Added redis-semaphore to dependencies. · 15267b3f
  Daniel Scheffler authored Mar 12, 2018
  
  15267b3f
08 Mar, 2018 1 commit
- Minor changes. · 8e1182b2
  Daniel Scheffler authored Mar 08, 2018
  
  8e1182b2
07 Mar, 2018 1 commit
- Disabed Socket and FileHandler for job logfile. · 68d65ad4
  Daniel Scheffler authored Mar 07, 2018 and Mathias Peters committed Mar 07, 2018
  
  68d65ad4
02 Mar, 2018 1 commit
- Further developed TCPSocketServer. · 709747cc
  Daniel Scheffler authored Mar 02, 2018 and Mathias Peters committed Mar 02, 2018
  
  709747cc
01 Mar, 2018 1 commit
- Revised GMS_obj.GMS_identifier. · da02b2c1
  Daniel Scheffler authored Mar 01, 2018 and Mathias Peters committed Mar 01, 2018
  
  da02b2c1
28 Feb, 2018 1 commit
- Added (not yet working) TCPSocketServer for logging in multiprocessing. · d9dfe64c
  Daniel Scheffler authored Feb 28, 2018 and Mathias Peters committed Feb 28, 2018
  
  d9dfe64c
26 Feb, 2018 2 commits
- Added version of gms_preprocessing to written header files and job log (fixes feature request #67 ). · 643398f3
  Daniel Scheffler authored Feb 26, 2018
  
  643398f3
- Merged branch 'fix_l2c_holes' in branch 'master'. · 03f6a463
  Daniel Scheffler authored Feb 26, 2018
```
Job status is now again set to 'finished_with_errors' if scenes fail.
Updated version info.
```
  03f6a463
25 Feb, 2018 1 commit
- Job status is now set to 'finished_with_warnings' if scenes failed. · a6eb6fdc
  Daniel Scheffler authored Feb 25, 2018
  
  a6eb6fdc
23 Feb, 2018 1 commit
- Fixed issue #69 (Spatial homogenization leaves resampling artifacs at the image edges). · 9e7bd1f6
  Daniel Scheffler authored Feb 23, 2018
```
Converted GMS_object.from_sensor_subsystems, GMS_object.from_tiles and GMS_object.from_disk to class methods.
```
  9e7bd1f6
21 Feb, 2018 1 commit
- Revised logging to job logfile (now contains full log output of the job). · a6a6ecbb
  Daniel Scheffler authored Feb 21, 2018
  
  a6a6ecbb
20 Feb, 2018 2 commits
- Implemented accuracy layer for geometric homogenization. · 5f0ebea3
  Daniel Scheffler authored Feb 20, 2018
  
  5f0ebea3
- Implemented process locks to avoid CPU/RAM overload on case multiple GMS jobs... · 8c6f55bd
  Daniel Scheffler authored Feb 20, 2018
```
Implemented process locks to avoid CPU/RAM overload on case multiple GMS jobs are running on the same host.
```
  8c6f55bd
19 Feb, 2018 1 commit
- Increased database timeout for job statistics update (might fix issue #61 ). · ad0849e5
  Daniel Scheffler authored Feb 19, 2018
  
  ad0849e5
15 Feb, 2018 1 commit
- Second version of accuracy layers + writer. Accuracy layers are now only written during L2C_P. · 726e5b1a
  Daniel Scheffler authored Feb 15, 2018
```
Added L2C_P.AccuracyCube().
Added logging to DEM_Creator.
```
  726e5b1a
08 Feb, 2018 3 commits

Added ECMWF credentials check to environment module. · 2b0e10ca

Daniel Scheffler authored Feb 08, 2018 and

Mathias Peters committed Feb 08, 2018

Added timeout to ECMWF download.
Bugfix process_controller.shutdown().
Added dependency timeout_decorator.
Commented tests out that fail due to missing ECMWF data.

2b0e10ca

Added shutdown method to process controller. Fixed test_cli.py. · a28caef0
Daniel Scheffler authored Feb 08, 2018

a28caef0

Added config options 'spatial_index_server_host' and... · 880f9ef6

Daniel Scheffler authored Feb 08, 2018

Added config options 'spatial_index_server_host' and 'spatial_index_server_port'. Catched ConnectionRefusedError during connection to index server. Bugfix SpatialIndexMediatorServer.status. Added tempdir deletion to controller shutdown.

880f9ef6

05 Feb, 2018 1 commit
- Added test Test_ProcessContinuing_CompletePipeline. · b15bca5a
  Daniel Scheffler authored Feb 05, 2018
```
Former-commit-id: 949deeab
Former-commit-id: 2b3c5df9
```
  b15bca5a
03 Feb, 2018 2 commits
- Changed logging message. Bugfix. · a3a08ef3
  Daniel Scheffler authored Feb 03, 2018
```
Former-commit-id: ec294aad
Former-commit-id: 9d51e9f3
```
  a3a08ef3
- Changed logging message. · 89902f1a
  Daniel Scheffler authored Feb 03, 2018
```
Former-commit-id: f4ed2da2
Former-commit-id: 03daf57f
```
  89902f1a