Skip to content
GitLab
Projects Groups Snippets
  • /
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Sign in
  • L Land-Water Discretizer
  • Project information
    • Project information
    • Activity
    • Labels
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
  • Issues 2
    • Issues 2
    • List
    • Boards
    • Service Desk
    • Milestones
  • Merge requests 4
    • Merge requests 4
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
  • Deployments
    • Deployments
    • Environments
    • Releases
  • Packages and registries
    • Packages and registries
    • Package Registry
    • Infrastructure Registry
  • Monitor
    • Monitor
    • Incidents
  • Analytics
    • Analytics
    • Value stream
    • CI/CD
    • Repository
  • Wiki
    • Wiki
  • Snippets
    • Snippets
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • Dynamic ExposureDynamic Exposure
  • Completeness
  • Land-Water Discretizer
  • Merge requests
  • !42

Per process shared memory

  • Review changes

  • Download
  • Email patches
  • Plain diff
Open Karsten Prehn requested to merge fix/per-process-shared-mem into main Sep 21, 2022
  • Overview 0
  • Commits 1
  • Pipelines 3
  • Changes 2

Currently import data is stored in shared memory with the keys being the hash value of the respective file paths. This leads to the problem, that when running more than one Discretizer (or executing more than one Discretizer docker container) at the same time, whichever Discretizer process finishes first closes the shared memory causing the remaining Discretizer to lose access to it.

This MR changes the hashed key to include the processed quadkeys, so each shared memory instance is unique to the file path and the processed quadkeys.

\approve @ds @laurens

Edited Sep 21, 2022 by Karsten Prehn
Assignee
Assign to
Reviewers
Request review from
Time tracking
Source branch: fix/per-process-shared-mem