Skip to content

[Endpoints] [14/x] Models management UI#19074

Closed
BenWilson2 wants to merge 15 commits intomlflow:masterfrom
BenWilson2:stack/endpoints/models
Closed

[Endpoints] [14/x] Models management UI#19074
BenWilson2 wants to merge 15 commits intomlflow:masterfrom
BenWilson2:stack/endpoints/models

Conversation

@BenWilson2
Copy link
Member

@BenWilson2 BenWilson2 commented Nov 27, 2025

🥞 Stacked PR

Use this link to review incremental changes.


Related Issues/PRs

#xxx

What changes are proposed in this pull request?

Adds the models management UI for cleanup of orphaned models / management of reusable model definitions and configurations for endpoints.

How is this PR tested?

  • Existing unit/integration tests
  • New unit/integration tests
  • Manual tests

Does this PR require documentation update?

  • No. You can skip the rest of this section.
  • Yes. I've updated:
    • Examples
    • API references
    • Instructions

Release Notes

Is this a user-facing change?

  • No. You can skip the rest of this section.
  • Yes. Give a description of this change to be included in the release notes for MLflow users.

What component(s), interfaces, languages, and integrations does this PR affect?

Components

  • area/tracking: Tracking Service, tracking client APIs, autologging
  • area/models: MLmodel format, model serialization/deserialization, flavors
  • area/model-registry: Model Registry service, APIs, and the fluent client calls for Model Registry
  • area/scoring: MLflow Model server, model deployment tools, Spark UDFs
  • area/evaluation: MLflow model evaluation features, evaluation metrics, and evaluation workflows
  • area/gateway: MLflow AI Gateway client APIs, server, and third-party integrations
  • area/prompts: MLflow prompt engineering features, prompt templates, and prompt management
  • area/tracing: MLflow Tracing features, tracing APIs, and LLM tracing functionality
  • area/projects: MLproject format, project running backends
  • area/uiux: Front-end, user experience, plotting, JavaScript, JavaScript dev server
  • area/build: Build and test infrastructure for MLflow
  • area/docs: MLflow documentation pages

How should the PR be classified in the release notes? Choose one:

  • rn/none - No description will be included. The PR will be mentioned only by the PR number in the "Small Bugfixes and Documentation Updates" section
  • rn/breaking-change - The PR will be mentioned in the "Breaking Changes" section
  • rn/feature - A new user-facing feature worth mentioning in the release notes
  • rn/bug-fix - A user-facing bug fix worth mentioning in the release notes
  • rn/documentation - A user-facing documentation change worth mentioning in the release notes

Should this PR be included in the next patch release?

Yes should be selected for bug fixes, documentation updates, and other small changes. No should be selected for new features and larger changes. If you're unsure about the release classification of this PR, leave this unchecked to let the maintainers decide.

What is a minor/patch release?
  • Minor release: a release that increments the second part of the version number (e.g., 1.2.0 -> 1.3.0).
    Bug fixes, doc updates and new features usually go into minor releases.
  • Patch release: a release that increments the third part of the version number (e.g., 1.2.0 -> 1.2.1).
    Bug fixes and doc updates usually go into patch releases.
  • Yes (this PR will be cherry-picked and included in the next patch release)
  • No (this PR will be included in the next minor release)

@BenWilson2 BenWilson2 changed the title Add models management page [Endpoints] [14/14] Models management UI Nov 27, 2025
@BenWilson2 BenWilson2 marked this pull request as ready for review November 27, 2025 06:34
@github-actions github-actions bot added area/uiux Front-end, user experience, plotting, JavaScript, JavaScript dev server rn/feature Mention under Features in Changelogs. labels Nov 27, 2025
@BenWilson2 BenWilson2 force-pushed the stack/endpoints/models branch 2 times, most recently from a7ab697 to df382b8 Compare December 2, 2025 02:14
@BenWilson2 BenWilson2 changed the title [Endpoints] [14/14] Models management UI [Endpoints] [14/x] Models management UI Dec 2, 2025
@BenWilson2 BenWilson2 force-pushed the stack/endpoints/models branch 2 times, most recently from f5495fd to 9aedf56 Compare December 2, 2025 22:49
@github-actions
Copy link
Contributor

github-actions bot commented Dec 2, 2025

Documentation preview for 03e2118 is available at:

More info
  • Ignore this comment if this PR does not change the documentation.
  • The preview is updated when a new commit is pushed to this PR.
  • This comment was created by this workflow run.
  • The documentation was built by this workflow run.

@BenWilson2 BenWilson2 force-pushed the stack/endpoints/models branch 4 times, most recently from 71a60e7 to e106976 Compare December 4, 2025 00:27
Signed-off-by: Ben Wilson <benjamin.wilson@databricks.com>
Signed-off-by: Ben Wilson <benjamin.wilson@databricks.com>
Signed-off-by: Ben Wilson <benjamin.wilson@databricks.com>
Signed-off-by: Ben Wilson <benjamin.wilson@databricks.com>
Signed-off-by: Ben Wilson <benjamin.wilson@databricks.com>
Signed-off-by: Ben Wilson <benjamin.wilson@databricks.com>
Signed-off-by: Ben Wilson <benjamin.wilson@databricks.com>
Signed-off-by: Ben Wilson <benjamin.wilson@databricks.com>
Signed-off-by: Ben Wilson <benjamin.wilson@databricks.com>
Signed-off-by: Ben Wilson <benjamin.wilson@databricks.com>
Signed-off-by: Ben Wilson <benjamin.wilson@databricks.com>
Signed-off-by: Ben Wilson <benjamin.wilson@databricks.com>
Signed-off-by: Ben Wilson <benjamin.wilson@databricks.com>
Signed-off-by: Ben Wilson <benjamin.wilson@databricks.com>
Signed-off-by: Ben Wilson <benjamin.wilson@databricks.com>
@BenWilson2 BenWilson2 force-pushed the stack/endpoints/models branch from e106976 to be33e7b Compare December 4, 2025 01:54
Copilot AI review requested due to automatic review settings December 4, 2025 01:54
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR adds a models management UI for the Gateway feature, enabling users to view, create, edit, and delete model definitions through the web interface. Model definitions represent reusable configurations that connect API keys (secrets) to specific provider models (e.g., OpenAI's GPT-4), which can then be attached to endpoints.

Key changes:

  • Adds comprehensive model definitions CRUD UI with list, detail, create, edit, and delete views
  • Implements frontend components for model management with provider/model selection and filtering
  • Adds utility functions for provider grouping, date formatting, and model configuration display
  • Extends Gateway API integration with hooks for model definition operations

Reviewed changes

Copilot reviewed 109 out of 116 changed files in this pull request and generated no comments.

Show a summary per file
File Description
tests/store/tracking/test_secret_cache.py Adds comprehensive tests for the secret cache encryption functionality
tests/store/tracking/test_rest_store.py Adds REST API tests for secrets, endpoints, and model definitions
tests/server/test_handlers.py Adds handler tests for LiteLLM provider integration endpoints
tests/entities/test_gateway_secrets.py Adds entity tests for Gateway secret objects
tests/entities/test_gateway_endpoint.py Adds entity tests for Gateway endpoint and model definition objects
tests/cli/test_cryptography.py Adds CLI tests for KEK rotation functionality
requirements/genai-requirements.yaml Adds LiteLLM as a GenAI dependency
pyproject.toml Adds LiteLLM version constraint to GenAI extras
pyproject.release.toml Mirrors LiteLLM dependency addition for releases
mlflow/utils/providers.py Adds provider configuration and model metadata from LiteLLM
mlflow/utils/cryptography.py Implements AES-GCM encryption for secrets with KEK/DEK envelope encryption
mlflow/store/tracking/sqlalchemy_store.py Adds database operations for secrets, model definitions, and endpoints
mlflow/store/tracking/rest_store.py Adds REST client methods for Gateway API endpoints
mlflow/store/tracking/dbmodels/models.py Adds database entity conversion methods
mlflow/store/tracking/abstract_store.py Defines abstract interface for Gateway operations
mlflow/store/tracking/_secret_cache.py Implements ephemeral encryption cache for secrets
mlflow/server/js/src/lang/default/en.json Adds internationalization strings for Gateway UI
mlflow/server/js/src/gateway/utils/providerUtils.ts Adds provider grouping and formatting utilities
mlflow/server/js/src/gateway/utils/dateUtils.ts Adds timestamp conversion utilities
mlflow/server/js/src/gateway/utils/dateUtils.test.ts Adds tests for date utilities
mlflow/server/js/src/gateway/types.ts Defines TypeScript types for Gateway entities
mlflow/server/js/src/gateway/routes.ts Defines routing paths for Gateway pages
mlflow/server/js/src/gateway/route-defs.ts Configures route definitions with lazy loading
mlflow/server/js/src/gateway/pages/ModelDefinitionsPage.tsx Implements main models management page
mlflow/server/js/src/gateway/hooks/useUpdateSecretMutation.ts Adds hook for updating secrets
mlflow/server/js/src/gateway/hooks/useSecretQuery.ts Adds hook for fetching secret details

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

@BenWilson2 BenWilson2 closed this Dec 7, 2025
@BenWilson2 BenWilson2 deleted the stack/endpoints/models branch December 7, 2025 04:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area/uiux Front-end, user experience, plotting, JavaScript, JavaScript dev server rn/feature Mention under Features in Changelogs.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants