Skip to content

Drop expressions in repository URLs and manage version of Maven Install Plugin#85

Merged
ivargrimstad merged 2 commits intoeclipse-ee4j:mainfrom
mthmulders:prepare-maven-4
May 10, 2025
Merged

Drop expressions in repository URLs and manage version of Maven Install Plugin#85
ivargrimstad merged 2 commits intoeclipse-ee4j:mainfrom
mthmulders:prepare-maven-4

Conversation

@mthmulders
Copy link
Copy Markdown
Contributor

Following the conversation in #84, here's a pull request that does the trivial changes:

  • Replace expressions in URLs with their actual values.
  • Pin versions of plugins

There's one more thing that must be done. If you would attempt to make a release, it would fail with

The maven-gpg-plugin is not supported by Maven 4. Verify if there is a compatible signing solution, add -Dmaven.experimental.buildconsumer=false or use Maven 3.

The Sign Maven Plugin looks like a candidate replacement. Its website says it works on Maven 3.6 and is ready for Maven 4 with Consumer POM.

Since the Sign Maven Plugin does not look like a drop-in replacement to me, and since it is not part of the ASF Maven project, I chose not to include it (yet) in this PR. If the Eclipse EE4J project decides to adopt that plugin, it could be part of this PR.

@ivargrimstad
Copy link
Copy Markdown
Member

Thanks, @mthmulders!

Copy link
Copy Markdown

@chkal chkal left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Although, I wonder if any project customizes sonatypeOssDistMgmtNexusUrl by changing the value via the command line for some reason.

@mthmulders
Copy link
Copy Markdown
Contributor Author

Although, I wonder if any project customizes sonatypeOssDistMgmtNexusUrl by changing the value via the command line for some reason.

Interesting point. If they do, I think their path forward would be to add the corresponding <repository>, <pluginRepository>, or <snapshotRepository> elements to their project POM. But how can we make them aware of it?

@pzygielo
Copy link
Copy Markdown
Contributor

pzygielo commented Jan 8, 2023

Although, I wonder if any project customizes sonatypeOssDistMgmtNexusUrl by changing the value via the command line for some reason.

Interesting point. If they do, I think their path forward would be to add the corresponding <repository>, <pluginRepository>, or <snapshotRepository> elements to their project POM.

IMO - the actual definitions of repositories that are EF infrastructure dependent are the only reason to inherit from this parent... Why would one change sonatypeOssDistMgmtNexusUrl in such case?

But how can we make them aware of it?

Bump the version to 2?

@chkal
Copy link
Copy Markdown

chkal commented Jan 8, 2023

IMO - the actual definitions of repositories that are EF infrastructure dependent are the only reason to inherit from this parent... Why would one change sonatypeOssDistMgmtNexusUrl in such case?

I'm not sure if anybody is actually changing the repository URL this way. I was just always wondering why the URL was a maven property and not simply inlined into the corresponding <repository> section. And my guess back then was that it would allow changing the repository URL via the command line. But any way: I'm not sure if anybody is doing this.

@pzygielo
Copy link
Copy Markdown
Contributor

pzygielo commented Jan 8, 2023

I was just always wondering why the URL was a maven property and not simply inlined into the corresponding <repository> section. And my guess back then was that it would allow changing the repository URL via the command line.

@pzygielo
Copy link
Copy Markdown
Contributor

pzygielo commented Jan 8, 2023

Now - with maven 4 helpfully rejecting expressions in url - if sonatype changes host name or EF migrates to different service - update in 6 places will be needed. Good.

@ivargrimstad
Copy link
Copy Markdown
Member

If no-one objects, I'll bump the version number to 2.0.0 and prepare a release after merging this.

@mthmulders
Copy link
Copy Markdown
Contributor Author

We haven't yet addressed the issue of signing artifacts. I guess we should consider solving that before bumping to 2.0.0 and releasing.

@pzygielo
Copy link
Copy Markdown
Contributor

pzygielo commented Jan 9, 2023

We haven't yet addressed the issue of signing artifacts. I guess we should consider solving that before bumping to 2.0.0 and releasing.

There is also NEXUS-36533/MNG-7627.

It might take few more days before final maven 4 is published. Until then child projects can still use maven 3, and do some staging and releasing to confirm that removed property does not hurt them.

Signing and deploying issues can be solved separately and can result with new release(s).

However - the subject of this PR could be changed a bit as this is not complete maven 4 preparation we see.

@mthmulders
Copy link
Copy Markdown
Contributor Author

However - the subject of this PR could be changed a bit as this is not complete maven 4 preparation we see.

How about "Drop expressions in repository URLs to prepare for Maven 4"?

@pzygielo
Copy link
Copy Markdown
Contributor

pzygielo commented Jan 9, 2023

How about "Drop expressions in repository URL and manage m-install-p"?

This Maven 4 part is not important IMO.

@mthmulders mthmulders changed the title Prepare for Maven 4 Drop expressions in repository URLs and manage version of Maven Install Plugin Jan 9, 2023
@lukasj
Copy link
Copy Markdown
Member

lukasj commented Jan 9, 2023

Although, I wonder if any project customizes sonatypeOssDistMgmtNexusUrl by changing the value via the command line for some reason.

Interesting point. If they do, I think their path forward would be to add the corresponding <repository>, <pluginRepository>, or <snapshotRepository> elements to their project POM.

It's unlikely being about projects themselves but rather about organizations rebuilding projects from scratch and republishing them on their own infra to their own internal repository for whatever reason behind that (I can imagine security, various regulations etc). Being able to override the default repo through the simple command line property makes this easy to do. I doubt security policies of such organizations allows exposing names/ips of internal servers on the internet/public places.

@pzygielo
Copy link
Copy Markdown
Contributor

pzygielo commented Jan 9, 2023

It's unlikely being about projects themselves but rather about organizations rebuilding projects from scratch and republishing them on their own infra to their own internal repository for whatever reason behind that (I can imagine security, various regulations etc). Being able to override the default repo through the simple command line property makes this easy to do. I doubt security policies of such organizations allows exposing names/ips of internal servers on the internet/public places.

Nothing like that was mentioned when property was introduced. Such organizations will need to adapt for this. Switch to using different profile with custom repositories defined.

And - to allow to use property in repository definition again - to raise MNG for maven to do so. It's not up to this project.

@lukasj
Copy link
Copy Markdown
Member

lukasj commented Jan 10, 2023

Nothing like that was mentioned when property was introduced. Such organizations will need to adapt for this. Switch to using different profile with custom repositories defined.

Probably nobody explicitly asked or it was obvious that the pattern used in various oss-parents used by Sonatype is being followed. JBBUILD-567 (behind this commit) may have some info too, but who knows, the issue is not public.

And - to allow to use property in repository definition again - to raise MNG for maven to do so. It's not up to this project.

Assuming the author of this PR is a maven committer, he can do it should he see the need for it.

This was referenced Aug 30, 2024
@pzygielo
Copy link
Copy Markdown
Contributor

There's one more thing that must be done. If you would attempt to make a release, it would fail with

The maven-gpg-plugin is not supported by Maven 4. Verify if there is a compatible signing solution, add -Dmaven.experimental.buildconsumer=false or use Maven 3.

I suppose it's no longer the case, as with currently managed plugin and with maven 4.0.0-beta-3 they seem to cooperate:

[INFO] --- gpg:3.1.0:sign (default-cli) @ project ---
[INFO] Signing 2 files with default secret key.

@mthmulders
Copy link
Copy Markdown
Contributor Author

I suppose it's no longer the case, as with currently managed plugin and with maven 4.0.0-beta-3 they seem to cooperate:

[INFO] --- gpg:3.1.0:sign (default-cli) @ project ---
[INFO] Signing 2 files with default secret key.

Correct. That statement is roughly two years old. At the time of writing, there was no plan to make the Maven GPG Plugin work with Maven 4, but a lot has changed since.

@mthmulders
Copy link
Copy Markdown
Contributor Author

Recent snapshots of Maven 4 (post RC3) can no longer build Jakarta 10 based projects, due to these expressions in the ee4j pom.

I am using Apache Maven 4.0.0-rc-4-SNAPSHOT (4ac3b14be2668ea70740dd94e486dc877b83d38a).

My project includes this:

<dependency>
  <groupId>jakarta.platform</groupId>
  <artifactId>jakarta.jakartaee-bom</artifactId>
  <version>10.0.0</version>
  <type>pom</type>
  <scope>import</scope>
 </dependency>

Invoking mvn verify gives:

[ERROR] Failed to execute goal on project jpa: Could not collect dependencies for project xxxxx:xxxxx:jar:0.1-SNAPSHOT
[ERROR] java.lang.IllegalArgumentException: Invalid Version Range Request: org.eclipse.ee4j:project:pom:1.0.9 < [central (https://repo.maven.apache.org/maven2, default, releases), sonatype-nexus-staging (${sonatypeOssDistMgmtStagingUrl}, default, releases)]
[ERROR] 	Caused by: Invalid Version Range Request: org.eclipse.ee4j:project:pom:1.0.9 < [central (https://repo.maven.apache.org/maven2, default, releases), sonatype-nexus-staging (${sonatypeOssDistMgmtStagingUrl}, default, releases)]
[ERROR] : Failed to collect dependencies at org.eclipse.persistence:org.eclipse.persistence.jpa:jar:4.0.5

Adding -e reveals:

    Suppressed: java.lang.IllegalArgumentException: Not fully interpolated remote repository sonatype-nexus-staging (${sonatypeOssDistMgmtStagingUrl}, default, releases)
        at org.apache.maven.impl.resolver.validator.MavenValidator.validateRemoteRepository(MavenValidator.java:90)
        at org.eclipse.aether.internal.impl.DefaultRepositorySystemValidator.validateVersionRangeRequest(DefaultRepositorySystemValidator.java:101)
        at org.eclipse.aether.internal.impl.DefaultRepositorySystem.resolveVersionRange(DefaultRepositorySystem.java:197)
        at org.apache.maven.impl.DefaultVersionRangeResolver.doResolve(DefaultVersionRangeResolver.java:68)

Maven 4 will prevent any uninterpolated value from entering its Resolver, as the Resolver will take it for granted. The Resolver has no idea about interpolation nor placeholders. To the Resolver, all these strings (gav, urls, etc) are opaque.


Thinking out loud: I think this means that if Maven 4 comes out, existing projects using Jakarta EE 10 (and probably older) will not be able to migrate to Maven 4. Would it be possible to create a patch release of the EE4J pom, and subsequently create patch releases of the Jakarta EE Platform BOM, so the jakarta.platform:jakarta.jakartaee-bom would refer to a version of the org.eclipse.ee4j:project:pom with these expressions in repository URLs removed?

@ivargrimstad ivargrimstad merged commit 3f28506 into eclipse-ee4j:main May 10, 2025
@pzygielo
Copy link
Copy Markdown
Contributor

@lprimak
Copy link
Copy Markdown
Contributor

lprimak commented May 21, 2025

Hi,

I just noticed this PR. Can this be reverted?
I routinely deploy Jakarta EE projects into my own instance of nexus repository.
This PR breaks this behavior and "ties" deploys to only Eclipse infrastructure.

Furthermore, this PR doesn't fix the maven 4 issue. The issue is in EclipseLink, not here.
Here, all the variables are defined with their default values, which maven 4-SNAPSHOT handles correctly

@lprimak
Copy link
Copy Markdown
Contributor

lprimak commented May 21, 2025

The pluginManagement bit is obviously fine and can be left there

@pzygielo
Copy link
Copy Markdown
Contributor

I just noticed this PR.

Oh, you did?

I just noticed this PR. Can this be reverted? I routinely deploy Jakarta EE projects into my own instance of nexus repository. This PR breaks this behavior and "ties" deploys to only Eclipse infrastructure.

Can't https://maven.apache.org/plugins/maven-deploy-plugin/deploy-mojo.html#altDeploymentRepository be used in such case?

@lprimak
Copy link
Copy Markdown
Contributor

lprimak commented May 21, 2025

Can't https://maven.apache.org/plugins/maven-deploy-plugin/deploy-mojo.html#altDeploymentRepository be used in such case?

It's supposed to work but doesn't

@pzygielo
Copy link
Copy Markdown
Contributor

Can't https://maven.apache.org/plugins/maven-deploy-plugin/deploy-mojo.html#altDeploymentRepository be used in such case?

It's supposed to work but doesn't

Do you know the way to share that with the deploy plugin project you are using? Or is it already known issue?

@lprimak
Copy link
Copy Markdown
Contributor

lprimak commented May 21, 2025

@mthmulders @ivargrimstad
Please revert this PR. It breaks compatibility with deployment infrastructure
The issue is in EclipseLink, not here and the hardcoding of paths breaks compatibility.
Jakarta EE projects work fine with Maven 4-SNAPSHOT, and only EclipseLink causes issues, as their POM is incomplete, not this one

@lprimak
Copy link
Copy Markdown
Contributor

lprimak commented May 21, 2025

Do you know the way to share that with the deploy plugin project you are using? Or is it already known issue?

This one is hard to debug, issues are integrated with the release plugin, deploy plugin, interactions, etc.,
and really wasn't an issue until this PR got merged.
Easiest path without wasting everyone's time is to revert this and fix EclipseLink, where the issue actually lies.

@pzygielo
Copy link
Copy Markdown
Contributor

This one is hard to debug, and really wasn't an issue until this PR got merged. Easiest path without wasting everyone's time is to revert this and fix EclipseLink, where the issue actually lies.

EL is not the only child. It just happened that something is observed with EL. And - to make sure - with Maven 4, right? Maven 3 works fine, doesn't it?

@lprimak
Copy link
Copy Markdown
Contributor

lprimak commented May 21, 2025

EclipseLink issue created: eclipse-ee4j/eclipselink#2416

@lprimak
Copy link
Copy Markdown
Contributor

lprimak commented May 21, 2025

EL is not the only child. It just happened that something is observed with EL. And - to make sure - with Maven 4, right? Maven 3 works fine, doesn't it?

EclipseLink is the only one that I know of that uses ${sonatypeOssDistMgmtStagingUrl} without defining it, that's why it breaks. This works "by coincidence" in maven 3 and breaks (correctly) with maven 4 SNAPSHOT release (past rc-3)

@pzygielo
Copy link
Copy Markdown
Contributor

EL is not the only child. It just happened that something is observed with EL.

@lprimak
Copy link
Copy Markdown
Contributor

lprimak commented May 21, 2025

Exactly. The only issue is with EclipseLink. It only "looks like" it's with EE4j POM, which is why @mthmulders mis-diagnosed the issue in the first place, just like I did initially until @cstamas correctly diagnosed the problem with EclipseLink while we were troubleshooting it together - thank you!

@lprimak
Copy link
Copy Markdown
Contributor

lprimak commented May 21, 2025

This PR also breaks work done in #57

@pzygielo
Copy link
Copy Markdown
Contributor

Up to this moment I believed expressions won't be supported for repositories in Maven 4 at all. I'm glad to unlearn that.

@lprimak lprimak mentioned this pull request May 21, 2025
@pzygielo
Copy link
Copy Markdown
Contributor

@cstamas
Copy link
Copy Markdown

cstamas commented May 21, 2025

Up to this moment I believed expressions won't be supported for repositories in Maven 4 at all. I'm glad to unlearn that.

You are right. In built projects they are limited.
But this is a dependency, in fact transitive one.

</mailingLists>

<properties>
<sonatypeOssDistMgmtNexusUrl>https://jakarta.oss.sonatype.org/</sonatypeOssDistMgmtNexusUrl>
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Only now I see that in

<nexusUrl>${sonatypeOssDistMgmtNexusUrl}</nexusUrl>
sonatypeOssDistMgmtNexusUrl is undefined.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Indeed. This PR really needs to be reverted ASAP @ivargrimstad
Thank you

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

7 participants