Skip to content

[ML-62973] Clean up custom code scorer example in empty state#21345

Merged
daniellok-db merged 1 commit intomlflow:masterfrom
smoorjani:smoorjani/ML-62973
Mar 4, 2026
Merged

[ML-62973] Clean up custom code scorer example in empty state#21345
daniellok-db merged 1 commit intomlflow:masterfrom
smoorjani:smoorjani/ML-62973

Conversation

@smoorjani
Copy link
Collaborator

@smoorjani smoorjani commented Mar 3, 2026

Related Issues/PRs

Relates to https://databricks.atlassian.net/browse/ML-62973

What changes are proposed in this pull request?

Cleans up the custom code judge example shown in the empty state UI:

  • Remove redundant "Install MLflow" step (users are already in the MLflow UI)
  • Remove unused ScorerSamplingConfig import and mixed/redundant imports
  • Replace skeleton template (return 1.0 with TODO) with a working example that checks output non-emptiness and returns a Feedback object
  • Use "judge" terminology consistently in user-facing text
  • Add guidance that scorer function parameters (inputs, outputs, expectations, trace) are all optional

How is this PR tested?

  • Existing unit/integration tests
  • Manual tests

Verified lint, prettier, type-check, and i18n checks all pass.

Does this PR require documentation update?

  • No. You can skip the rest of this section.

Does this PR require updating the MLflow Skills repository?

  • No. You can skip the rest of this section.

Release Notes

Is this a user-facing change?

  • No. You can skip the rest of this section.

What component(s), interfaces, languages, and integrations does this PR affect?

Components

  • area/uiux: Front-end, user experience, plotting, JavaScript, JavaScript dev server

How should the PR be classified in the release notes? Choose one:

  • rn/none - No description will be included. The PR will be mentioned only by the PR number in the "Small Bugfixes and Documentation Updates" section

Should this PR be included in the next patch release?

  • Yes (this PR will be cherry-picked and included in the next patch release)
  • No (this PR will be included in the next minor release)

@github-actions github-actions bot added area/uiux Front-end, user experience, plotting, JavaScript, JavaScript dev server size/M rn/none List under Small Changes in Changelogs. labels Mar 3, 2026
@github-actions
Copy link
Contributor

github-actions bot commented Mar 3, 2026

🛠 DevTools 🛠

Install mlflow from this PR

# mlflow
pip install git+https://github.com/mlflow/mlflow.git@refs/pull/21345/merge
# mlflow-skinny
pip install git+https://github.com/mlflow/mlflow.git@refs/pull/21345/merge#subdirectory=libs/skinny

For Databricks, use the following command:

%sh curl -LsSf https://raw.githubusercontent.com/mlflow/mlflow/HEAD/dev/install-skinny.sh | sh -s pull/21345/merge

@github-actions
Copy link
Contributor

github-actions bot commented Mar 3, 2026

Documentation preview for 1c84b7e is available at:

More info
  • Ignore this comment if this PR does not change the documentation.
  • The preview is updated when a new commit is pushed to this PR.
  • This comment was created by this workflow run.
  • The documentation was built by this workflow run.

Co-Authored-By: Claude <noreply@anthropic.com>
Signed-off-by: Samraj Moorjani <samraj.moorjani@databricks.com>
@smoorjani smoorjani force-pushed the smoorjani/ML-62973 branch from 6364fbd to 1c84b7e Compare March 3, 2026 23:12
@smoorjani smoorjani requested a review from B-Step62 March 3, 2026 23:13
Copy link
Collaborator

@daniellok-db daniellok-db left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lg

@daniellok-db daniellok-db added this pull request to the merge queue Mar 4, 2026
Merged via the queue into mlflow:master with commit cca15a7 Mar 4, 2026
25 of 27 checks passed
daniellok-db pushed a commit to daniellok-db/mlflow that referenced this pull request Mar 5, 2026
…#21345)

Signed-off-by: Samraj Moorjani <samraj.moorjani@databricks.com>
Co-authored-by: Claude <noreply@anthropic.com>
daniellok-db pushed a commit to daniellok-db/mlflow that referenced this pull request Mar 5, 2026
…#21345)

Signed-off-by: Samraj Moorjani <samraj.moorjani@databricks.com>
Co-authored-by: Claude <noreply@anthropic.com>
daniellok-db pushed a commit that referenced this pull request Mar 5, 2026
Signed-off-by: Samraj Moorjani <samraj.moorjani@databricks.com>
Co-authored-by: Claude <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area/uiux Front-end, user experience, plotting, JavaScript, JavaScript dev server mlflow-fix-it-q1fy27 rn/none List under Small Changes in Changelogs. size/M v3.10.1

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants