Replace MinIO with RustFS in docker-compose setup by jmaggesi · Pull Request #21099 · mlflow/mlflow

jmaggesi · 2026-02-24T12:59:00Z

Related Issues/PRs

Resolve #20775

What changes are proposed in this pull request?

This PR removes the old Minio example in the docker-compose folder and add the RustFS as an alternative S3-compatible storage for artifacts.

The folder contains a .env example file and the docker compose required and updates also the doc

How is this PR tested?

Existing unit/integration tests
New unit/integration tests
Manual tests

Does this PR require documentation update?

Does this PR require updating the MLflow Skills repository?

No. You can skip the rest of this section.
Yes. Please link the corresponding PR or explain how you plan to update it.

Release Notes

Is this a user-facing change?

No. You can skip the rest of this section.
Yes. Give a description of this change to be included in the release notes for MLflow users.

What component(s), interfaces, languages, and integrations does this PR affect?

Components

How should the PR be classified in the release notes? Choose one:

rn/none - No description will be included. The PR will be mentioned only by the PR number in the "Small Bugfixes and Documentation Updates" section
rn/breaking-change - The PR will be mentioned in the "Breaking Changes" section
rn/feature - A new user-facing feature worth mentioning in the release notes
rn/bug-fix - A user-facing bug fix worth mentioning in the release notes
rn/documentation - A user-facing documentation change worth mentioning in the release notes

Should this PR be included in the next patch release?

Yes should be selected for bug fixes, documentation updates, and other small changes. No should be selected for new features and larger changes. If you're unsure about the release classification of this PR, leave this unchecked to let the maintainers decide.

What is a minor/patch release?

Minor release: a release that increments the second part of the version number (e.g., 1.2.0 -> 1.3.0).
Bug fixes, doc updates and new features usually go into minor releases.
Patch release: a release that increments the third part of the version number (e.g., 1.2.0 -> 1.2.1).
Bug fixes and doc updates usually go into patch releases.

Yes (this PR will be cherry-picked and included in the next patch release)
No (this PR will be included in the next minor release)

github-actions · 2026-02-24T12:59:17Z

🛠 DevTools 🛠

Install mlflow from this PR

# mlflow
pip install git+https://github.com/mlflow/mlflow.git@refs/pull/21099/merge
# mlflow-skinny
pip install git+https://github.com/mlflow/mlflow.git@refs/pull/21099/merge#subdirectory=libs/skinny

For Databricks, use the following command:

%sh curl -LsSf https://raw.githubusercontent.com/mlflow/mlflow/HEAD/dev/install-skinny.sh | sh -s pull/21099/merge

github-actions · 2026-02-24T12:59:18Z

@jmaggesi Thank you for the contribution! Could you fix the following issue(s)?

⚠ DCO check

The DCO check failed. Please sign off your commit(s) by following the instructions here. See https://github.com/mlflow/mlflow/blob/master/CONTRIBUTING.md#sign-your-work for more details.

Signed-off-by: Jonatan Maggesi <jmaggesi@gmail.com>

docker-compose/README.md

harupy · 2026-02-24T13:45:11Z

/title

… doc Signed-off-by: Jonatan Maggesi <jmaggesi@gmail.com>

harupy · 2026-02-24T14:37:11Z

/title

harupy · 2026-02-24T14:37:32Z

Let's update the PR description

harupy · 2026-02-24T14:42:01Z

Let's fix the lint check failure

Copilot

Pull request overview

This PR aims to replace MinIO with RustFS as the default S3-compatible storage in the MLflow docker-compose setup. However, the implementation does not match the PR description's promise to provide multiple S3-compatible storage examples.

Changes:

Replaced MinIO with RustFS in the docker-compose.yml
Updated documentation to reflect RustFS as the default storage backend
Modified environment variable configuration to support generic S3-compatible storage

Reviewed changes

Copilot reviewed 4 out of 4 changed files in this pull request and generated 14 comments.

File	Description
docker-compose/docker-compose.yml	Replaces MinIO service with RustFS, updates bucket creation logic to use AWS CLI
docker-compose/README.md	Updates documentation claiming multiple backends available, but only RustFS is implemented
docker-compose/.env.dev.example	Converts MinIO-specific variables to generic S3 variables, adds RustFS-specific config
docs/docs/self-hosting/index.mdx	Updates the quick reference to mention RustFS instead of MinIO

docker-compose/.env.dev.example

docker-compose/docker-compose.yml

docker-compose/README.md

docker-compose/.env.dev.example

docker-compose/README.md

docker-compose/docker-compose.yml

docs/docs/self-hosting/index.mdx

docker-compose/README.md

harupy · 2026-02-24T14:42:52Z

/title

harupy · 2026-02-24T14:43:28Z

Let's address copilot comments that are legit.

github-actions · 2026-02-24T14:44:41Z

Documentation preview for cfe4222 is available at:

https://pr-21099--mlflow-docs-preview.netlify.app/docs/latest/

Changed Pages (1)

self-hosting (modified)

More info

Ignore this comment if this PR does not change the documentation.
The preview is updated when a new commit is pushed to this PR.
This comment was created by this workflow run.
The documentation was built by this workflow run.

Signed-off-by: Jonatan Maggesi <jmaggesi@gmail.com>

jmaggesi · 2026-02-24T16:06:12Z

Ok, i've fixed the remarks from Copilot

Signed-off-by: Jonatan Maggesi <jmaggesi@gmail.com>

harupy · 2026-02-25T01:18:45Z

docker-compose/README.md

 ---

-## How It Works (at a Glance)
+### Bucket Bootstrap (idempotent)


Do we really need to add this in this PR? Let's focus on replacing minio, not extending the existing contents.

I've added here some comments just to let know the user what is the behaviour of the compose, but it's easy enough to check it directly in the compose file.

I can remove from line 183 to line 200 and leave the other comments about troubleshooting so from line 201 it should be ok

Copilot

Pull request overview

Copilot reviewed 4 out of 4 changed files in this pull request and generated 5 comments.

Comments suppressed due to low confidence (1)

docs/docs/self-hosting/index.mdx:72

🟡 MODERATE: The self-hosting quickstart commands use cd docker-compose, but in the MLflow repo the directory is mlflow/docker-compose after cloning. Update the snippet so it works when copied/pasted.

The MLflow repository includes a ready-to-run Compose project under `docker-compose/` that provisions MLflow, PostgreSQL, and [RustFS](https://github.com/rustfs/rustfs).

```bash
git clone https://github.com/mlflow/mlflow.git
cd docker-compose

docker-compose/README.md

docker-compose/docker-compose.yml

docker-compose/README.md

harupy · 2026-02-25T09:06:27Z

docker-compose/README.md

- **MLflow Tracking Server** — exposed on your host (default `http://localhost:5000`).
- **PostgreSQL** — persists MLflow's metadata (experiments, runs, params, metrics).
- **MinIO** — stores run artifacts via an S3-compatible API.
+All variants share the same architecture:


What does variants refer to?

It was a comment referring to the other examples that i've put there before with SeaweedFS and Garage.

I've already removed in my local this one, i will check the other comments and remove the section in the readme

harupy · 2026-02-25T09:11:30Z

@jmaggesi Left some comments. Can you address them?

…le, fixed some typo in README Signed-off-by: Jonatan Maggesi <jmaggesi@gmail.com>

jmaggesi · 2026-02-25T09:53:56Z

Done, i can remove more in the README about the troubleshooting if it's not the case and fixed some typo that were still referring to the other examples that i've removed from the folder

harupy · 2026-02-25T11:56:01Z

docker-compose/docker-compose.yml

@@ -1,6 +1,8 @@
+version: "3.9"


version is deprecated in Docker Compose v2+ and emits a warning. The original file correctly omitted it — let's remove this line.

docker-compose/docker-compose.yml

docker-compose/.env.dev.example

docker-compose/README.md

docker-compose/docker-compose.yml

…rage, variables alignment, removed typos in README.md Signed-off-by: Jonatan Maggesi <jmaggesi@gmail.com>

Signed-off-by: Jonatan Maggesi <jmaggesi@gmail.com>

docker-compose/docker-compose.yml

Signed-off-by: Jonatan Maggesi <jmaggesi@gmail.com>

- Remove unnecessary historical note about MinIO - Fix awkward phrasing and typos in README - Rename rustfs-data volume to storage-data for generality Co-Authored-By: Claude <noreply@anthropic.com> Signed-off-by: harupy <17039389+harupy@users.noreply.github.com>

Co-Authored-By: Claude <noreply@anthropic.com> Signed-off-by: harupy <17039389+harupy@users.noreply.github.com>

harupy

Tested e2e: all services (PostgreSQL, RustFS, create-bucket, MLflow) come up healthy, and logging params/metrics/artifacts works correctly. LGTM.

Signed-off-by: Jonatan Maggesi <jmaggesi@gmail.com> Signed-off-by: harupy <17039389+harupy@users.noreply.github.com> Co-authored-by: Jonatan Maggesi <jmaggesi@gmail.com> Co-authored-by: harupy <17039389+harupy@users.noreply.github.com> Co-authored-by: Claude <noreply@anthropic.com>

github-actions bot added community Community/external contribution size/XL Extra-large PR (500+ LoC) v3.10.1 labels Feb 24, 2026

github-actions bot added the rn/documentation Mention under Documentation Changes in Changelogs. label Feb 24, 2026

jmaggesi added 4 commits February 24, 2026 14:08

fix: added new structure of the folder and new README

61d1503

Signed-off-by: Jonatan Maggesi <jmaggesi@gmail.com>

fix: added Garagehq docker compose example

e796c48

Signed-off-by: Jonatan Maggesi <jmaggesi@gmail.com>

fix: added RustFS docker-compose example

3c94206

Signed-off-by: Jonatan Maggesi <jmaggesi@gmail.com>

fix: added SeaweedFs docker-compose example

2be1563

Signed-off-by: Jonatan Maggesi <jmaggesi@gmail.com>

jmaggesi force-pushed the docker-compose/examples branch from aec8940 to 2be1563 Compare February 24, 2026 13:08

Added documentation info for the docker-compose new folder structure

0b68fef

Signed-off-by: Jonatan Maggesi <jmaggesi@gmail.com>

github-actions bot added the area/docs Documentation issues label Feb 24, 2026

harupy reviewed Feb 24, 2026

View reviewed changes

docker-compose/README.md Show resolved Hide resolved

github-actions bot changed the title ~~Docker compose/examples~~ Add alternative S3-compatible storage examples (SeaweedFS, RustFS, Garage) to docker-compose setup Feb 24, 2026

harupy changed the title ~~Add alternative S3-compatible storage examples (SeaweedFS, RustFS, Garage) to docker-compose setup~~ Add alternative S3-compatible storage examples to docker-compose setup Feb 24, 2026

removed unused s3-compatible examples and left only RustFS, fixed the…

58a3891

… doc Signed-off-by: Jonatan Maggesi <jmaggesi@gmail.com>

harupy requested a review from Copilot February 24, 2026 14:37

Copilot started reviewing on behalf of harupy February 24, 2026 14:37 View session

github-actions bot changed the title ~~Add alternative S3-compatible storage examples to docker-compose setup~~ Add S3-compatible storage alternatives (SeaweedFS, RustFS, Garage) to docker-compose setup Feb 24, 2026

Copilot AI reviewed Feb 24, 2026

View reviewed changes

github-actions bot changed the title ~~Add S3-compatible storage alternatives (SeaweedFS, RustFS, Garage) to docker-compose setup~~ Replace MinIO with RustFS in docker-compose setup Feb 24, 2026

github-actions bot assigned harupy Feb 24, 2026

Jonatan Maggesi added 2 commits February 24, 2026 17:01

Fixed Copilot remarks and improvements in the healthcheck of RustFS

d100ad4

Signed-off-by: Jonatan Maggesi <jmaggesi@gmail.com>

Fixed doc

7963f61

Signed-off-by: Jonatan Maggesi <jmaggesi@gmail.com>

chore: normalize chars (pre-commit)

89b81ea

Signed-off-by: Jonatan Maggesi <jmaggesi@gmail.com>

harupy reviewed Feb 25, 2026

View reviewed changes

harupy requested a review from Copilot February 25, 2026 08:39

Copilot started reviewing on behalf of harupy February 25, 2026 08:39 View session

Copilot AI reviewed Feb 25, 2026

View reviewed changes

harupy reviewed Feb 25, 2026

View reviewed changes

fixed: removed unuseful section in README, changed RustFS to path sty…

7ae6f21

…le, fixed some typo in README Signed-off-by: Jonatan Maggesi <jmaggesi@gmail.com>

harupy reviewed Feb 25, 2026

View reviewed changes

docker-compose/docker-compose.yml Outdated Show resolved Hide resolved

Jonatan Maggesi added 2 commits February 25, 2026 14:14

fixed: readded healthcheck in MLflow, more robust healthcheck for sto…

a7645a6

…rage, variables alignment, removed typos in README.md Signed-off-by: Jonatan Maggesi <jmaggesi@gmail.com>

fixed: readded some comments in docker-compose from old example

bfe6684

Signed-off-by: Jonatan Maggesi <jmaggesi@gmail.com>

harupy reviewed Feb 25, 2026

View reviewed changes

docker-compose/docker-compose.yml Outdated Show resolved Hide resolved

Jonatan Maggesi and others added 3 commits February 25, 2026 14:55

fixed: changed back the name of the network

bf6c0f4

Signed-off-by: Jonatan Maggesi <jmaggesi@gmail.com>

Clean up .env.dev.example comments

cfe4222

Co-Authored-By: Claude <noreply@anthropic.com> Signed-off-by: harupy <17039389+harupy@users.noreply.github.com>

harupy approved these changes Feb 25, 2026

View reviewed changes

harupy added this pull request to the merge queue Feb 26, 2026

Merged via the queue into mlflow:master with commit ef95c70 Feb 26, 2026
50 of 53 checks passed

github-actions bot added size/L Large PR (200-499 LoC) and removed size/XL Extra-large PR (500+ LoC) labels Feb 26, 2026

Conversation

jmaggesi commented Feb 24, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Related Issues/PRs

What changes are proposed in this pull request?

How is this PR tested?

Does this PR require documentation update?

Does this PR require updating the MLflow Skills repository?

Release Notes

Is this a user-facing change?

What component(s), interfaces, languages, and integrations does this PR affect?

How should the PR be classified in the release notes? Choose one:

Should this PR be included in the next patch release?

Uh oh!

github-actions bot commented Feb 24, 2026

Install mlflow from this PR

Uh oh!

github-actions bot commented Feb 24, 2026

⚠ DCO check

Uh oh!

Uh oh!

harupy commented Feb 24, 2026

Uh oh!

harupy commented Feb 24, 2026

Uh oh!

harupy commented Feb 24, 2026

Uh oh!

harupy commented Feb 24, 2026

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

harupy commented Feb 24, 2026

Uh oh!

harupy commented Feb 24, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Feb 24, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

jmaggesi commented Feb 24, 2026

Uh oh!

harupy Feb 25, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

jmaggesi Feb 25, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

harupy Feb 25, 2026

Choose a reason for hiding this comment

Uh oh!

jmaggesi Feb 25, 2026

Choose a reason for hiding this comment

Uh oh!

harupy commented Feb 25, 2026

Uh oh!

jmaggesi commented Feb 25, 2026

Uh oh!

jmaggesi commented Feb 24, 2026 •

edited

Loading

harupy commented Feb 24, 2026 •

edited

Loading

github-actions bot commented Feb 24, 2026 •

edited

Loading

harupy Feb 25, 2026 •

edited

Loading