Skip to content

Conversation

@elbamit
Copy link
Contributor

@elbamit elbamit commented Oct 22, 2025

📝 Description

When the experiment name of a pipeline doesn't start with the project name as a prefix {project}-{experiment}, then list_pipelines doesn't show the workflow (also in UI). This is handled in the SDK side when doing project.run().
However a user-provided experiment name is accepted in:

  • httpdb.submit_pipeline()
  • mlrun._run_pipeline which is widely used in kfp tests

To keep BC, this PR moves that code logic from project.run() to _create_pipeline which is used in the endpoint.

Changing this from project.run() to the API shouldn't have any effect because the name parameter (the experiment name) is not used anywhere along the flow after being prefixed with the project name


🛠️ Changes Made

  • Remove the experiment name normalization from project.run()
  • Add an experiment name normalization in _create_pipeline()

✅ Checklist

  • I updated the documentation (if applicable)
  • I have tested the changes in this PR
  • I confirmed whether my changes are covered by system tests
    • If yes, I ran all relevant system tests and ensured they passed before submitting this PR
    • I updated existing system tests and/or added new ones if needed to cover my changes
  • If I introduced a deprecation:

🧪 Testing

Manual + added assertion in existing unit test


🔗 References


🚨 Breaking Changes?

  • Yes (explain below)
  • No

🔍️ Additional Notes

@elbamit elbamit marked this pull request as ready for review October 22, 2025 16:02
@elbamit elbamit requested review from a team and yaelgen as code owners October 22, 2025 16:02
)
response_body = response.json()
assert response_body["id"] == "some-run-id"
assert response_body["name"].startswith("getting-started-tutorial-iguazio")
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Add a costume experiment to the post request, that does not start with the project name, will make the test more accurate

@liranbg liranbg changed the title [Pipelines] - Experiment name normalization [Pipelines] Experiment name normalization Oct 22, 2025
@liranbg liranbg merged commit b792aac into mlrun:development Oct 23, 2025
18 checks passed
@elbamit elbamit mentioned this pull request Oct 23, 2025
10 tasks
yaelgen pushed a commit that referenced this pull request Oct 23, 2025
### 📝 Description
<!-- A short summary of what this PR does. -->
<!-- Include any relevant context or background information. -->

Follow up PR of #8758 on @yaelgen
comment

---

### 🛠️ Changes Made
<!-- - Key changes (e.g., added feature X, refactored Y, fixed Z) -->
- Added experiment name to `test_create_pipeline`

---

### ✅ Checklist
- [ ] I updated the documentation (if applicable)
- [x] I have tested the changes in this PR
- [ ] I confirmed whether my changes are covered by system tests
- [ ] If yes, I ran all relevant system tests and ensured they passed
before submitting this PR
- [ ] I updated existing system tests and/or added new ones if needed to
cover my changes
- [ ] If I introduced a deprecation:
  - [ ] I followed the [Deprecation Guidelines](./DEPRECATION.md)
  - [ ] I updated the relevant Jira ticket for documentation

---

### 🧪 Testing
<!-- - How it was tested (unit tests, manual, integration) -->  
<!-- - Any special cases covered. -->  

---

### 🔗 References
- Ticket link: https://iguazio.atlassian.net/browse/ML-11260
- Design docs links:
- External links:
- Initial PR - #8758
---

### 🚨 Breaking Changes?

- [ ] Yes (explain below)
- [ ] No

<!-- If yes, describe what needs to be changed downstream: -->

---

### 🔍️ Additional Notes
<!-- Anything else reviewers should know (follow-up tasks, known issues,
affected areas etc.). -->
<!-- ### 📸 Screenshots / Logs -->
liranbg pushed a commit that referenced this pull request Jan 4, 2026
### 📝 Description

Deprecate the `experiment` parameter in `submit_pipeline` as part of the
gradual deprecation plan.

This PR emits a warning when `experiment` is explicitly passed, while
keeping backward compatibility and existing behavior intact. The
parameter remains functional in versions 1.11–1.12 and will be removed
in 1.13.

---

### 🛠️ Changes Made

- Added a `FutureWarning` when the `experiment` parameter is passed to
`submit_pipeline`
- Marked the `experiment` parameter as deprecated in the function
docstring
- No behavioral or API changes beyond the warning

---

### ✅ Checklist

- [ ] I updated the documentation (if applicable)
- [x] I have tested the changes in this PR
- [ ] I confirmed whether my changes are covered by system tests
- [ ] If yes, I ran all relevant system tests and ensured they passed
before submitting this PR
- [ ] I updated existing system tests and/or added new ones if needed to
cover my changes
- [x] If I introduced a deprecation:
  - [x] I followed the Deprecation Guidelines
  - [x] I updated the relevant Jira ticket for documentation

---

### 🧪 Testing

- Manually verified that calling `submit_pipeline` with the `experiment`
parameter emits a `FutureWarning`
- Verified that pipeline submission behavior remains unchanged

---

### 🔗 References

- Ticket link: [<ADD JIRA
TICKET>](https://iguazio.atlassian.net/browse/ML-11454)
- Design docs links: N/A
- External links:
- Previous phase (normalization):
#8758

---

### 🚨 Breaking Changes?

- [ ] Yes (explain below)
- [x] No

---
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants