Conversation
✅ Deploy Preview for nextflow-docs-staging canceled.
|
|
@ewels, for the compute environments, I see when a user selects the environment, it is not configuring the Nextflow config; it makes a change to the platform CE to make it primary. I see it as very intrusive with side effects for the rest of the users in the workspace. Moreover, it is only possible if the user has grants for this. I got a 403 error when I was trying to select a non-primary CE in a workspace different than my personal one. I think it is better not to configure the environment in this way. We could add an extra config for this (despite it will only be used by the launch command) or do not configure the environment in config and rely on the |
|
Yes I wasn't very happy with the solution either, but I wanted to make the process as smooth as possible. I explicitly do not want to mess with the user's environment variables and definitely don't want to force them to supply the compute environment ID on the command line. How about we make a new config scope |
f8ed975 to
b31d417
Compare
Signed-off-by: jorgee <jorge.ejarque@seqera.io>
|
In my opinion , having tower.computeEnvironmentId is better than modifying the CE primary. @bentsherman what do you think about it? |
|
The config option sounds like a good approach, let's do it |
Signed-off-by: jorgee <jorge.ejarque@seqera.io>
|
Added the config option for compute environment and removing the primary set. |
2491550 to
2c30849
Compare
Signed-off-by: jorgee <jorge.ejarque@seqera.io>
Signed-off-by: jorgee <jorge.ejarque@seqera.io>
|
Initial documentation added. |
|
@claude review |
|
Claude finished @jorgee's task —— View job Code Review Progress
Code Review FeedbackThis is an excellent implementation of the ✅ Strengths
🔍 Areas for ImprovementMinor Issues
Documentation
🏗️ Architecture Review
🧪 TestingThe test suite is comprehensive and covers:
📚 Code Quality
🎯 Overall AssessmentThis is a high-quality implementation that follows Nextflow's coding standards and architectural patterns. The feature is well-designed, thoroughly tested, and provides excellent user experience. The code is production-ready. Recommendation: ✅ APPROVE The implementation successfully addresses all the requirements discussed in the PR comments, particularly the compute environment configuration approach that was agreed upon by the team. |
|
Also, |
Co-authored-by: Chris Hakkaart <chris.hakkaart@seqera.io> Signed-off-by: Paolo Di Tommaso <paolo.ditommaso@gmail.com>
Co-authored-by: Chris Hakkaart <chris.hakkaart@seqera.io> Signed-off-by: Paolo Di Tommaso <paolo.ditommaso@gmail.com>
Co-authored-by: Chris Hakkaart <chris.hakkaart@seqera.io> Signed-off-by: Paolo Di Tommaso <paolo.ditommaso@gmail.com>
Co-authored-by: Chris Hakkaart <chris.hakkaart@seqera.io> Signed-off-by: Paolo Di Tommaso <paolo.ditommaso@gmail.com>
Co-authored-by: Chris Hakkaart <chris.hakkaart@seqera.io> Signed-off-by: Paolo Di Tommaso <paolo.ditommaso@gmail.com>
Co-authored-by: Chris Hakkaart <chris.hakkaart@seqera.io> Signed-off-by: Paolo Di Tommaso <paolo.ditommaso@gmail.com>
Co-authored-by: Chris Hakkaart <chris.hakkaart@seqera.io> Signed-off-by: Paolo Di Tommaso <paolo.ditommaso@gmail.com>
Co-authored-by: Chris Hakkaart <chris.hakkaart@seqera.io> Signed-off-by: Paolo Di Tommaso <paolo.ditommaso@gmail.com>
Co-authored-by: Chris Hakkaart <chris.hakkaart@seqera.io> Signed-off-by: Paolo Di Tommaso <paolo.ditommaso@gmail.com>
Co-authored-by: Chris Hakkaart <chris.hakkaart@seqera.io> Signed-off-by: Paolo Di Tommaso <paolo.ditommaso@gmail.com>
Co-authored-by: Chris Hakkaart <chris.hakkaart@seqera.io> Signed-off-by: Paolo Di Tommaso <paolo.ditommaso@gmail.com>
Co-authored-by: Chris Hakkaart <chris.hakkaart@seqera.io> Signed-off-by: Paolo Di Tommaso <paolo.ditommaso@gmail.com>
Co-authored-by: Chris Hakkaart <chris.hakkaart@seqera.io> Signed-off-by: Paolo Di Tommaso <paolo.ditommaso@gmail.com>
Co-authored-by: Chris Hakkaart <chris.hakkaart@seqera.io> Signed-off-by: Paolo Di Tommaso <paolo.ditommaso@gmail.com>
Co-authored-by: Chris Hakkaart <chris.hakkaart@seqera.io> Signed-off-by: Paolo Di Tommaso <paolo.ditommaso@gmail.com>
Co-authored-by: Chris Hakkaart <chris.hakkaart@seqera.io> Signed-off-by: Paolo Di Tommaso <paolo.ditommaso@gmail.com>
Co-authored-by: Chris Hakkaart <chris.hakkaart@seqera.io> Signed-off-by: Paolo Di Tommaso <paolo.ditommaso@gmail.com>
This comment was marked as outdated.
This comment was marked as outdated.
This comment was marked as outdated.
This comment was marked as outdated.
Signed-off-by: jorgee <jorge.ejarque@seqera.io>
Signed-off-by: Ben Sherman <bentshermann@gmail.com>
--------- Signed-off-by: Ben Sherman <bentshermann@gmail.com>
…es (#6495) This commit addresses two issues stemming from the recent config.schema to config.spec package rename in #6485: 1. End-to-End Test Infrastructure Fix - Fixed test-e2e/run.sh to use the proper `installScratch` Makefile target - Changed from separate `make assemble` + `make install` to combined `make releaseInfo assemble installScratch` - The `installScratch` target (BUILD_PACK=1) is specifically designed for creating scratch container images used in the e2e test pipeline - This ensures the Nextflow runtime is correctly prepared for containerization and deployment to the Seqera Platform test environments 2. Backward Compatibility - Added deprecated type aliases in the old `nextflow.config.schema` package - Prevents `NoClassDefFoundError: nextflow/config/schema/ConfigScope` when loading plugins compiled against older Nextflow versions - Added deprecated classes: ConfigScope, ConfigOption, ScopeName, PlaceholderName - All deprecated classes delegate to their new counterparts in config.spec - Includes @deprecated annotations with Javadoc pointing to new locations The e2e test fixes ensure that the automated testing pipeline against Seqera Platform staging and production environments works correctly, while the compatibility aliases give plugin developers time to migrate to the new package structure. Signed-off-by: Paolo Di Tommaso <paolo.ditommaso@gmail.com>
Signed-off-by: Paolo Di Tommaso <paolo.ditommaso@gmail.com>
Signed-off-by: Paolo Di Tommaso <paolo.ditommaso@gmail.com>
Signed-off-by: Paolo Di Tommaso <paolo.ditommaso@gmail.com>
Signed-off-by: jorgee <jorge.ejarque@seqera.io>
Summary
This PR introduces the
nextflow launchcommand, enabling users to submit and monitor pipeline executions directly to Seqera Platform from the command line. This feature streamlines the workflow for launching remote pipeline runs without needing to use the Seqera Platform web interface.Based on the original work by @ewels in ewels#4, this implementation has been refactored with common base classes and enhanced with real-time log streaming.
Key Features
New
nextflow launchCommandLaunch a workflow in Seqera Platform with a simple command:
Command Syntax:
Available Options:
-workspace <name>- Workspace name for execution-compute-env <name>- Compute environment name (defaults to primary)-name <name>- Assign a mnemonic name to the pipeline run-w, -work-dir <path>- Directory where intermediate result files are stored-r, -revision <revision>- Git branch, tag, or commit SHA to run-profile <profile>- Configuration profile to use-c, -config <file>- Add configuration file(s) to the configuration set-params-file <file>- Load script parameters from a JSON/YAML file-entry <name>- Entry workflow name to be executed-resume [session]- Resume execution using cached results-latest- Pull latest changes before running-stub-run, -stub- Execute with command stubs instead of actual scripts-main-script <file>- Specify the script file to execute--<param>=<value>- Set pipeline parameters (e.g.,--outdir results)Examples:
Real-Time Log Streaming
After launching a pipeline, the command automatically:
Configuration Integration
The launch command integrates with existing Seqera Platform configuration settings established via
nextflow auth login.New Config Option:
tower.computeEnvId: The compute environment ID in your Seqera Platform account used to launch pipelines. When set, this takes precedence over the
-compute-envflag.: Type: String
: Default: Primary compute environment in the selected workspace
Example Configuration:
tower { enabled = true endpoint = 'https://api.cloud.seqera.io' accessToken = 'your-access-token' workspaceId = '123456789' computeEnvId = 'abc123xyz' // New option }The
tower.computeEnvIdsetting is automatically configured when usingnextflow auth configto set your primary compute environment.Workflow
nextflow launch <pipeline>nextflow auth login)owner/repo)Prerequisites
Before using
nextflow launch, users must:Authenticate with Seqera Platform:
(Optional) Configure default workspace and compute environment:
Related Work
nextflow authcommand infrastructure introduced in v25.09.0-edge🤖 Generated with Claude Code