Skip to content

watch_job_rules: true is causing huge memory consumption #16840

@bgruening

Description

@bgruening

Describe the bug

If we run with watch_job_rules: true we see a memory usage of up to 30GB per handler.

More information including a py-syp trace is here: https://gist.github.com/bgruening/7be19830e254b4bca99a3ae2e3844041

Disabling the watchdog, as done here, usegalaxy-eu/infrastructure-playbook#937 is solving the problem for us.

grafik

Feel free to close this issue, if this seems to be a EU-specific thing. We are also using TPV, so ping also @nuwang and @cat-bro.

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions