Skip to content

Overhaul Galaxy job config handling.#1506

Merged
mvdbeek merged 1 commit intogalaxyproject:masterfrom
jmchilton:job_conf
Jun 4, 2025
Merged

Overhaul Galaxy job config handling.#1506
mvdbeek merged 1 commit intogalaxyproject:masterfrom
jmchilton:job_conf

Conversation

@jmchilton
Copy link
Member

  • More options from the command-line - multiple runners, TPV shared database, singularity, etc...
  • Switch from job conf via XML to job conf via YAML.
  • Bring in dependency on galaxy-job-config-init to handle a lot of that logic.
  • Commands to assign binding a job config to a created Planemo profile.

- More options from the command-line - multiple runners, TPV shared database, singularity, etc...
- Switch from job conf via XML to job conf via YAML.
- Bring in dependency on galaxy-job-config-init to handle a lot of that logic.
- Commands to assign binding a job config to a created Planemo profile.
@mvdbeek
Copy link
Member

mvdbeek commented Apr 4, 2025

Could we also default to tmp_dir: true on the destination (i.e tmpdir in work dir) ? I think that's the easiest way to get something that will most likely work ?

@Smeds
Copy link
Contributor

Smeds commented Apr 18, 2025

Could we also default to tmp_dir: true on the destination (i.e tmpdir in work dir) ? I think that's the easiest way to get something that will most likely work ?

@mvdbeek you want to resulting job_config to look like this by default?

...

execution:
  ...
  environments:
    local:
      runner: local
      tmp_dir: true
...

@mvdbeek
Copy link
Member

mvdbeek commented Apr 19, 2025

yes

@Smeds
Copy link
Contributor

Smeds commented Apr 21, 2025

yes

I have made a pull-request against galaxy-job-config-init that will add tmp_dir option (#1). Will update the code here when the updates are merged.

@Smeds
Copy link
Contributor

Smeds commented May 7, 2025

It would be great if someone could upload a new release of galaxy-job-config-init to PyPI. After that, we could look into merging, which would enable me to start updating my instructions for running Planemo with a SLURM cluster

@mvdbeek
Copy link
Member

mvdbeek commented May 28, 2025

@jmchilton just published a new release

@Smeds
Copy link
Contributor

Smeds commented Jun 2, 2025

@mvdbeek could we trigger the test again? I guess we should be able to merge this pull-request now when @jmchilton has published a new version of galaxy-job-config-init?

@mvdbeek mvdbeek closed this Jun 2, 2025
@mvdbeek mvdbeek reopened this Jun 2, 2025
@mvdbeek mvdbeek merged commit 17f2ca9 into galaxyproject:master Jun 4, 2025
15 of 28 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

3 participants