[ MLflow Demo ] UI updates for MLflow Demo interfaces by BenWilson2 · Pull Request #20162 · mlflow/mlflow

BenWilson2 · 2026-01-20T22:46:12Z

🥞 Stacked PR

Use this link to review incremental changes.

stack/demo/home [Files changed]
- stack/demo/docs [Files changed]
  - stack/demo/scorers [Files changed]
    - stack/demo/handling [Files changed]

Related Issues/PRs

#xxx

What changes are proposed in this pull request?

Adds the UI navigation elements to go to the demo content. Adds the ability to clear demo data from an existing server if desired (without soft deletion of an experiment and the requirement to use gc commands).

How is this PR tested?

Existing unit/integration tests
New unit/integration tests
Manual tests

Does this PR require documentation update?

Release Notes

Is this a user-facing change?

No. You can skip the rest of this section.
Yes. Give a description of this change to be included in the release notes for MLflow users.

What component(s), interfaces, languages, and integrations does this PR affect?

Components

How should the PR be classified in the release notes? Choose one:

rn/none - No description will be included. The PR will be mentioned only by the PR number in the "Small Bugfixes and Documentation Updates" section
rn/breaking-change - The PR will be mentioned in the "Breaking Changes" section
rn/feature - A new user-facing feature worth mentioning in the release notes
rn/bug-fix - A user-facing bug fix worth mentioning in the release notes
rn/documentation - A user-facing documentation change worth mentioning in the release notes

Should this PR be included in the next patch release?

Yes should be selected for bug fixes, documentation updates, and other small changes. No should be selected for new features and larger changes. If you're unsure about the release classification of this PR, leave this unchecked to let the maintainers decide.

What is a minor/patch release?

Minor release: a release that increments the second part of the version number (e.g., 1.2.0 -> 1.3.0).
Bug fixes, doc updates and new features usually go into minor releases.
Patch release: a release that increments the third part of the version number (e.g., 1.2.0 -> 1.2.1).
Bug fixes and doc updates usually go into patch releases.

Yes (this PR will be cherry-picked and included in the next patch release)
No (this PR will be included in the next minor release)

github-actions · 2026-01-20T22:49:19Z

🛠 DevTools 🛠

Install mlflow from this PR

# mlflow
pip install git+https://github.com/mlflow/mlflow.git@refs/pull/20162/merge
# mlflow-skinny
pip install git+https://github.com/mlflow/mlflow.git@refs/pull/20162/merge#subdirectory=libs/skinny

For Databricks, use the following command:

%sh curl -LsSf https://raw.githubusercontent.com/mlflow/mlflow/HEAD/dev/install-skinny.sh | sh -s pull/20162/merge

Copilot

Pull request overview

This PR introduces a comprehensive demo data framework for MLflow, featuring UI enhancements, backend API endpoints, CLI commands, and a complete demo data generation system. The changes enable users to explore MLflow's GenAI features through pre-populated sample data.

Changes:

Added demo data generation framework with support for traces, prompts, and evaluation datasets
Implemented new home page UI with feature cards and demo banner for easy onboarding
Created mlflow demo CLI command for launching demo servers
Added demo management API endpoints for generating and deleting demo data
Enhanced logging configuration to reduce noise from alembic and huey

Reviewed changes

Copilot reviewed 35 out of 36 changed files in this pull request and generated 6 comments.

Show a summary per file

File	Description
`mlflow/demo/`	Core demo framework with base classes, registry, and generators for traces/prompts/evaluation
`mlflow/cli/demo.py`	New CLI command for launching demo servers with interactive setup
`mlflow/server/handlers.py`	API endpoints for demo generation and deletion
`mlflow/server/js/src/home/`	React components for demo banner and feature cards on home page
`mlflow/server/js/src/settings/SettingsPage.tsx`	UI for clearing demo data from settings
`mlflow/utils/`	Port availability checking and logging improvements
`tests/demo/`	Comprehensive test suite for demo functionality

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

mlflow/demo/__init__.py

mlflow/demo/generators/traces.py

mlflow/demo/generators/evaluation.py

mlflow/server/handlers.py

mlflow/demo/generators/traces.py

github-actions · 2026-01-21T19:07:46Z

Documentation preview for 1c72aff is available at:

https://pr-20162--mlflow-docs-preview.netlify.app/docs/latest/

More info

Ignore this comment if this PR does not change the documentation.
The preview is updated when a new commit is pushed to this PR.
This comment was created by this workflow run.
The documentation was built by this workflow run.

B-Step62 · 2026-01-29T13:54:25Z

@BenWilson2 The generation flow looks so smooth! Very easy to access each feature.

Before reviewing the implementation closely, a few minor thoughts:

Can we rename "Experiments" to "Model Training" or something? Since we use Experiment as a container of tracing, evals, etc, it might be a bit misleading to have it as a stand-alone concept in a set of cards.
"Explore demo data" <- I think we can simplify "Explore demo"?
Maybe we can rename the "Experiments" section to "Recent Experiments".

BenWilson2 · 2026-01-30T03:39:21Z

@BenWilson2 The generation flow looks so smooth! Very easy to access each feature.

Before reviewing the implementation closely, a few minor thoughts:

Can we rename "Experiments" to "Model Training" or something? Since we use Experiment as a container of tracing, evals, etc, it might be a bit misleading to have it as a stand-alone concept in a set of cards.

"Explore demo data" <- I think we can simplify "Explore demo"?

Maybe we can rename the "Experiments" section to "Recent Experiments".

Updated!

B-Step62 · 2026-02-04T13:47:26Z

mlflow/server/js/src/home/components/features/feature-definitions.tsx

+export const featureDefinitions: FeatureDefinition[] = [
+  {
+    id: 'tracing',
+    icon: WorkflowsIcon,


nit: Is it possible to use the consistent icon as the experiment sidebar?

B-Step62 · 2026-02-04T13:48:37Z

mlflow/server/js/src/settings/SettingsPage.tsx

+        <Button
+          componentId="mlflow.settings.demo.clear-all-button"
+          onClick={handleClearAllDemoData}
+          disabled={isCleaningDemo}


Can we have a confirmation pop up before deleting the demo data?

B-Step62 · 2026-02-04T13:52:07Z

mlflow/server/js/src/home/HomePage.tsx

        onExperimentCreated={handleExperimentCreated}
      />
-      <LogTracesDrawerLoader />
+      <LogTracesDrawer />


Are we showing this drawer somewhere?

B-Step62 · 2026-02-04T13:54:22Z

mlflow/demo/generators/__init__.py

 from mlflow.demo.generators.traces import TracesDemoGenerator
 from mlflow.demo.registry import demo_registry

+# NB: Order matters here. Prompts must be created before traces (for linking),


Nice catch!

B-Step62 · 2026-02-04T15:19:04Z

mlflow/server/js/src/home/components/DemoBanner.tsx

+      navigate(data.navigation_url || '/experiments');
+    } catch (error) {
+      console.error('Failed to generate demo:', error);
+      navigate('/experiments');


I wonder if re-directing to experiment page on failure is confusing to users, they will see the default experiment with no data. Shall we we show a notice "Failed to generate demo" (a similar popup to the one shown when clicking copy button) and keep users on the current page?

B-Step62 · 2026-02-04T15:19:30Z

mlflow/server/js/src/home/components/features/FeatureCard.tsx

+      console.error('Failed to generate demo:', error);
+      navigate(feature.navigationPath);
+    } finally {


Same comment as the DemoBanner error handling.

B-Step62 · 2026-02-04T15:21:16Z

mlflow/server/js/src/home/components/features/FeatureCard.tsx

+    navigate(feature.navigationPath);
+  }, [feature.navigationPath, navigate]);
+
+  const cardStyles = {


I'm not sure if this is the common pattern in the repo. Shall we inline to avoid regenerating these on render or have a separate css file?

B-Step62 · 2026-02-04T15:23:48Z

mlflow/server/js/src/home/components/DemoBanner.tsx

Can we add some test coverage to these new components?

Signed-off-by: Ben Wilson <benjamin.wilson@databricks.com>

…plates - Add timestamp distribution across 7 days (v1 in days 0-3.5, v2 in days 3.5-7) - Add token count estimation as span attributes (SpanAttributeKey.CHAT_USAGE) - Add prompt-based traces with template rendering and variables - Restructure sessions to have 2-4 turns each across 3 sessions - Fix trace metadata by using InMemoryTraceManager directly - Update test expectations for new trace counts (34 total: 4 RAG, 4 agent, 12 prompt, 14 session) Co-Authored-By: Claude <noreply@anthropic.com> Signed-off-by: Ben Wilson <benjamin.wilson@databricks.com>

Signed-off-by: Ben Wilson <benjamin.wilson@databricks.com>

Signed-off-by: B-Step62 <yuki.watanabe@databricks.com>

BenWilson2 marked this pull request as ready for review January 20, 2026 22:49

Copilot AI review requested due to automatic review settings January 20, 2026 22:49

Copilot started reviewing on behalf of BenWilson2 January 20, 2026 22:49 View session

Copilot AI reviewed Jan 20, 2026

View reviewed changes

BenWilson2 changed the title ~~UI changes~~ [ MLflow Demo ] UI updates for MLflow Demo interfaces Jan 21, 2026

BenWilson2 force-pushed the stack/demo/home branch from bd6c186 to a7d99d3 Compare January 21, 2026 18:58

BenWilson2 force-pushed the stack/demo/home branch 4 times, most recently from beaa393 to c2dc6ed Compare January 22, 2026 18:56

github-actions bot added area/uiux Front-end, user experience, plotting, JavaScript, JavaScript dev server rn/feature Mention under Features in Changelogs. labels Jan 22, 2026

BenWilson2 force-pushed the stack/demo/home branch from c2dc6ed to d8ca42e Compare January 23, 2026 02:43

This was referenced Jan 23, 2026

[MLflow Demo] Docs for GenAI Demo #20240

Merged

[MLflow Demo] Add scorers demo #20287

Merged

BenWilson2 force-pushed the stack/demo/home branch 3 times, most recently from 4582c9b to 79d71ad Compare January 26, 2026 15:00

BenWilson2 mentioned this pull request Jan 26, 2026

[MLflow Demo] Add server availability handling checks #20349

Merged

29 tasks

BenWilson2 force-pushed the stack/demo/home branch 3 times, most recently from 86d8908 to 17cde10 Compare January 28, 2026 19:16

github-actions bot assigned B-Step62 Jan 29, 2026

BenWilson2 force-pushed the stack/demo/home branch 5 times, most recently from 66ea277 to 3ceb48c Compare January 30, 2026 03:26

BenWilson2 force-pushed the stack/demo/home branch 3 times, most recently from c050bd3 to 7de585e Compare February 2, 2026 16:07

B-Step62 reviewed Feb 4, 2026

View reviewed changes

UI changes

5fedc56

Signed-off-by: Ben Wilson <benjamin.wilson@databricks.com>

BenWilson2 force-pushed the stack/demo/home branch from b870f6d to 5fedc56 Compare February 5, 2026 21:49

BenWilson2 and others added 9 commits February 9, 2026 17:41

add eval generation

3228a0e

Signed-off-by: Ben Wilson <benjamin.wilson@databricks.com>

add prompt generation

94ac927

Signed-off-by: Ben Wilson <benjamin.wilson@databricks.com>

add cli for demo

668c75c

Signed-off-by: Ben Wilson <benjamin.wilson@databricks.com>

UI changes

b380601

Signed-off-by: Ben Wilson <benjamin.wilson@databricks.com>

adjust

156af0f

Signed-off-by: B-Step62 <yuki.watanabe@databricks.com>

i18n

5c6ae86

Signed-off-by: B-Step62 <yuki.watanabe@databricks.com>

remove unused

291f6e2

Signed-off-by: B-Step62 <yuki.watanabe@databricks.com>

B-Step62 approved these changes Feb 9, 2026

View reviewed changes

i18n

1c72aff

Signed-off-by: B-Step62 <yuki.watanabe@databricks.com>

B-Step62 added this pull request to the merge queue Feb 9, 2026

Merged via the queue into mlflow:master with commit 4fc42f6 Feb 9, 2026
50 checks passed

Conversation

BenWilson2 commented Jan 20, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

🥞 Stacked PR

Related Issues/PRs

What changes are proposed in this pull request?

How is this PR tested?

Does this PR require documentation update?

Release Notes

Is this a user-facing change?

What component(s), interfaces, languages, and integrations does this PR affect?

How should the PR be classified in the release notes? Choose one:

Should this PR be included in the next patch release?

Uh oh!

github-actions bot commented Jan 20, 2026

Install mlflow from this PR

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

github-actions bot commented Jan 21, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

B-Step62 commented Jan 29, 2026

Uh oh!

BenWilson2 commented Jan 30, 2026

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

BenWilson2 commented Jan 20, 2026 •

edited

Loading

github-actions bot commented Jan 21, 2026 •

edited

Loading