Skip to content

workflow_template for remote workflow execution #1319

@BoPeng

Description

@BoPeng

Right now all our task templates look something like

  job_template: |
            #!/bin/bash
            #PBS -N {task}
            #PBS -l nodes={nodes}:ppn={cores}
            #PBS -l walltime={walltime}
            #PBS -l mem={mem//10**9}GB
            #PBS -o ~/.sos/tasks/{task}.out
            #PBS -e ~/.sos/tasks/{task}.err
            sos execute {task} -v {verbosity} -s {sig_mode} -m {run_mode} 

but this makes it difficult to specify environments for sos execute. For example, if I would like to do

module load R/3.3

and

module load R/3.4

I would need to create two tasks queues, or change ~/.sos/hosts between the runs.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions