Auto-negotiate Docker API Version by felixbuenemann · Pull Request #12256 · traefik/traefik

felixbuenemann · 2025-11-11T08:41:47Z

What does this PR do?

This PR fixes #12253 by removing the hardcoded docker api version and relying on auto-negotiation between the docker client (sdk) and server using WithAPIVersionNegotiation().

Motivation

Traefik currently fails to work with Docker v29 with the following errors:

2025-11-10T23:03:43Z ERR Failed to retrieve information of the docker client and server host error="Error response from daemon: client version 1.24 is too old. Minimum supported API version is 1.44, please upgrade your client to a newer version" providerName=docker
2025-11-10T23:03:43Z ERR Provider error, retrying in 2.356192979s error="Error response from daemon: client version 1.24 is too old. Minimum supported API version is 1.44, please upgrade your client to a newer version" providerName=docker

Fixes #12253

Additional Notes

Tested on production servers with Docker 29.0.0.
Test docker image available with tag felixbuenemann/traefik:v3.6 on docker hub (created with make build-image)

thaJeztah

thanks! A colleague actually noticed the hard-coded value in Traefik, and we were planning to open a PR, but looks like that dropped off our list 🙈

Changes SGTM (with my limited knowledge of this codebase); I left some suggestions / thoughts (but those definitely could be handled separately).

pkg/provider/docker/shared.go

MarkenJaden · 2025-11-11T12:30:21Z

Tested the build on our system and can confirm it works.

thaJeztah

FWIW, changes in this LGTM (assuming CI is happy)

thaJeztah · 2025-11-12T09:13:01Z

w.r.t. updating to the new (moby.moby/client, moby/moby/api) modules; #12255 (comment)

It would probably be better to update this PR so the project no longer uses the deprecated API, and replace it with the recommended current one, since the old one is probably no longer supported.

I don't think there's an immediate urgency, and the changes in this PR look good to fix the problem at hand, unless traefik must support features only available in API v1.52 or up.

While the project should transition at some point, the client module is still a v0.x release, and there will be breaking changes in future in the client signatures (we plan to migrate it to functional options, and improve usability of streaming endpoints).

If would be good to update the dependency to the lastest v28.x version (currently at v28.3.3, which is an older minor release), and it won't hurt to explore what changes are needed to transition, but it's fine to keep that for a future exercise.

thaJeztah · 2025-11-12T09:13:44Z

@rtribotte looks like CI needs a kick / approval to run 😅

goppinath · 2025-11-12T12:09:37Z

Does anyone have an estimate for when this update will be available? I have several instances down because of this issue, and I prefer not to use workarounds.

sbusch · 2025-11-12T12:19:40Z

Until this lands on Docker Hub, you can use the image the PR author @felixbuenemann kindly published instead:

docker.io/felixbuenemann/traefik:v3.6.1

Works for us.

thaJeztah · 2025-11-12T13:49:22Z

Interesting; was letsencrypt/pebble and existing image?

2025/11/12 10:55:28 🔔 Container is ready: 902ec3d34995
    integration_test.go:261: 
        	Error Trace:	/home/runner/work/traefik/traefik/integration/integration_test.go:261
        	            				/home/runner/work/traefik/traefik/integration/acme_test.go:100
        	            				/home/runner/go/pkg/mod/github.com/stretchr/testify@v1.11.1/suite/suite.go:211
        	            				/home/runner/work/traefik/traefik/integration/acme_test.go:34
        	Error:      	Received unexpected error:
        	            	Error response from daemon: pull access denied for letsencrypt/pebble, repository does not exist or may require 'docker login': denied: requested access to the resource is denied: failed to create container
        	Test:       	TestAcmeSuite

Looks like it's gone from Docker Hub; https://hub.docker.com/r/letsencrypt/pebble

I do see a reference to ghcr.io/letsencrypt/pebble:2.8.0 elsewhere;

traefik/integration/resources/compose/pebble.yml

Line 3 in 2ad42cd

image: ghcr.io/letsencrypt/pebble:2.8.0

marcopaggioro · 2025-11-12T14:44:19Z

Interesting; was letsencrypt/pebble and existing image?

2025/11/12 10:55:28 🔔 Container is ready: 902ec3d34995
    integration_test.go:261: 
        	Error Trace:	/home/runner/work/traefik/traefik/integration/integration_test.go:261
        	            				/home/runner/work/traefik/traefik/integration/acme_test.go:100
        	            				/home/runner/go/pkg/mod/github.com/stretchr/testify@v1.11.1/suite/suite.go:211
        	            				/home/runner/work/traefik/traefik/integration/acme_test.go:34
        	Error:      	Received unexpected error:
        	            	Error response from daemon: pull access denied for letsencrypt/pebble, repository does not exist or may require 'docker login': denied: requested access to the resource is denied: failed to create container
        	Test:       	TestAcmeSuite

Looks like it's gone from Docker Hub; https://hub.docker.com/r/letsencrypt/pebble

I do see a reference to ghcr.io/letsencrypt/pebble:2.8.0 elsewhere;

traefik/integration/resources/compose/pebble.yml

Line 3 in 2ad42cd

image: ghcr.io/letsencrypt/pebble:2.8.0

letsencrypt/pebble#451

saltydk · 2025-11-12T17:39:16Z

Pulling 3.6 but still getting error="Error response from daemon: client version 1.24 is too old. Minimum supported API version is 1.44

I would guess, it's just merged into the VCS, but there is no new release yet?!?

So have to wait for a new release, or can they rebuild 3.6?

https://github.com/traefik/traefik/tags until 3.6.1 appears there nothing will happen.

MrTengil · 2025-11-12T19:46:50Z

Pulling 3.6 but still getting error="Error response from daemon: client version 1.24 is too old. Minimum supported API version is 1.44

I would guess, it's just merged into the VCS, but there is no new release yet?!?

So have to wait for a new release, or can they rebuild 3.6?

https://github.com/traefik/traefik/tags until 3.6.1 appears there nothing will happen.

Great fix! Do we know when it will be released? @felixbuenemann

iBros · 2025-11-12T20:02:01Z

Stuck with this as well - pulled v3.6 image, same issue. I'd argue that the severity and impact of this issue should be enough to create a new release

ChaosExAnima · 2025-11-12T20:03:53Z

as a workaround i switched to felixbuenemann/traefik:v3.6.1 as per the description and it works great.

iBros · 2025-11-12T20:15:02Z

Until this lands on Docker Hub, you can use the image the PR author @felixbuenemann kindly published instead:

docker.io/felixbuenemann/traefik:v3.6.1

Works for us.

as a workaround i switched to felixbuenemann/traefik:v3.6.1 as per the description and it works great.

I missed it in the thread. great and thx to @felixbuenemann !

now that traefik/traefik#12256 is merged

Relevant upstream commit is here: * traefik/traefik#12256

Suite à breaking change docker API traefik/traefik#12256

traefik:v3.0 ships Docker client API v1.24, but GitHub Actions runners now require minimum API v1.44. This caused Traefik's Docker provider to fail silently -- no containers discovered, no routers created, all HTTP requests returned 404. traefik:v3.6 includes auto-negotiate Docker API version (traefik/traefik#12256, shipped in v3.6.1).

* Upgrade Traefik from v3.0 to v3.6 traefik:v3.0 ships Docker client API v1.24, but GitHub Actions runners now require minimum API v1.44. This caused Traefik's Docker provider to fail silently -- no containers discovered, no routers created, all HTTP requests returned 404. traefik:v3.6 includes auto-negotiate Docker API version (traefik/traefik#12256, shipped in v3.6.1). * Fix network isolation and Traefik restart behavior - Preserve default project network alongside traefik-network in override so inter-service DNS (e.g. app -> postgres) stays project-scoped and avoids cross-project alias collisions on the shared external network - Use 'docker compose up -d' instead of 'restart' in restartTraefik() so container is recreated when compose file changes (new port mappings) * Harden integration tests with try/finally cleanup and fetch timeouts - Wrap all integration tests in try/finally to ensure services are cleaned up even when assertions fail (prevents leaked containers from poisoning subsequent tests) - Add fetchWithTimeout helper with AbortController to prevent hung requests from consuming the entire poll window - Increase timeouts for CI runners where Docker startup is slower - Replace setInterval-based polling with while-loop polling for cleaner control flow * Improve sample image reproducibility for CI - Add image tags so pre-built images are reused across worktrees instead of rebuilding from scratch each time - Switch to npm ci with lockfile for deterministic installs - Add .dockerignore files to exclude .git, .port, and node_modules from build context * Add CI pre-pull/build step and failure-only Traefik diagnostics - Pre-pull and build Docker images before tests run so integration tests don't spend time on cold image pulls - Add failure-only diagnostics step that dumps Traefik logs, config, routers, and entrypoints when tests fail (makes future CI failures much faster to triage) * Deduplicate fetchWithTimeout into test utils * Cap vitest workers to half of available cores Leave headroom for Docker containers, Traefik, and other child processes spawned by integration tests.

traefiker added area/provider/docker size/S status/0-needs-triage labels Nov 11, 2025

felixbuenemann mentioned this pull request Nov 11, 2025

Updates Docker Client API version 1.24 -> 1.44 #12255

Closed

2 tasks

felixbuenemann force-pushed the remove-hardcoded-docker-api-version branch from f72a9af to 67dae4a Compare November 11, 2025 09:43

felixbuenemann changed the title ~~Remove hardcoded docker api version~~ Auto-negotiate Docker API Version Nov 11, 2025

thaJeztah reviewed Nov 11, 2025

View reviewed changes

pkg/provider/docker/shared.go Show resolved Hide resolved

pkg/provider/docker/shared.go Show resolved Hide resolved

vincentbernat mentioned this pull request Nov 11, 2025

conntrackfixer: upgrade to github.com/moby/moby v29 akvorado/akvorado#2091

Merged

derhagen mentioned this pull request Nov 11, 2025

Issues with Docker CE v29 spantaleev/matrix-docker-ansible-deploy#4725

Closed

This was referenced Nov 11, 2025

[Bug]: Coolify Traefik Proxy No Longer Working After Recent Update coollabsio/coolify#7193

Closed

[Bug]: Traefik version hard-coded to v3.1 instead of tracking latest (v3.6) coollabsio/coolify#7204

Closed

lusu007 mentioned this pull request Nov 12, 2025

Upgrade Docker CLI to v29 and Docker API version to v1.44 #12260

Closed

2 tasks

rtribotte added status/2-needs-review kind/bug/fix a bug fix and removed status/0-needs-triage labels Nov 12, 2025

thaJeztah reviewed Nov 12, 2025

View reviewed changes

martinberg mentioned this pull request Nov 12, 2025

Akvorado will break with Docker 29.0 akvorado/akvorado#2095

Closed

2 tasks

MartinAbadie mentioned this pull request Nov 12, 2025

Error response from daemon: client version 1.24 is too old #12253

Closed

2 tasks

kevinpollet mentioned this pull request Nov 12, 2025

Auto-negotiate Docker API version #12262

Merged

2 tasks

chetan mentioned this pull request Nov 12, 2025

[BUG] Error response from daemon: client version 1.24 is too old | Docker CE 29.0.0 (min API 1.44 required) jittering/traefik-kop#78

Closed

kevinpollet added this to the 3.6 milestone Nov 12, 2025

Auto-negotiate docker api version

5663508

kevinpollet force-pushed the remove-hardcoded-docker-api-version branch from 67dae4a to 5663508 Compare November 12, 2025 15:39

Delta1977 mentioned this pull request Nov 12, 2025

Docker API version is too old crazy-max/diun#1539

Closed

3 tasks

brysondev mentioned this pull request Nov 13, 2025

Update traefik Docker tag to v3.6.1 mother-of-all-self-hosting/ansible-role-traefik#25

Merged

gaswirth added a commit to roundhousedesigns/rhdwp-traefik-server that referenced this pull request Nov 13, 2025

docker java hotfix: traefik/traefik#12256 (comment)

ac38fcc

gonzaloaune added a commit to stakwork/sphinx-swarm that referenced this pull request Nov 13, 2025

using tempfix traefik/traefik#12256

9875d74

gonzaloaune mentioned this pull request Nov 13, 2025

Traefik docker issue stakwork/sphinx-swarm#593

Merged

rtribotte mentioned this pull request Nov 13, 2025

wrong docker API request with docker-ce version 29.0.0.1 installed #12272

Closed

2 tasks

Bima42 mentioned this pull request Nov 13, 2025

chore: bump traefik to 3.6.1 Dokploy/dokploy#3000

Merged

dmouse mentioned this pull request Nov 13, 2025

Traefik incompatible with new Docker API version: client version 1.24 is too old lando/core#401

Closed

derhuerst added a commit to mobidata-bw/ipl-orchestration that referenced this pull request Nov 13, 2025

chore: upgrade traefik image to 3.6.1

f219063

now that traefik/traefik#12256 is merged

derhuerst added a commit to mobidata-bw/ipl-orchestration that referenced this pull request Nov 13, 2025

chore: upgrade traefik image to 3.6.1

920e1a3

now that traefik/traefik#12256 is merged

dachrisch mentioned this pull request Nov 14, 2025

Portainer and Docker 29 portainer/portainer#12934

Open

ansgaross mentioned this pull request Nov 14, 2025

Traefik can't connect to dockersocket after upgrade to traefik V3.6.0 Tecnativa/docker-socket-proxy#167

Open

jaal2001 mentioned this pull request Nov 14, 2025

Docker 29 failed to fetch metrics prometheus/node_exporter#3480

Closed

abellion mentioned this pull request Nov 16, 2025

API Version problem with Docker 29.0.0 swarmpit/swarmpit#714

Open

derhuerst added a commit to mobidata-bw/ipl-orchestration that referenced this pull request Nov 17, 2025

chore: upgrade traefik image to 3.6.1

6592de8

now that traefik/traefik#12256 is merged

v1rusnl mentioned this pull request Nov 18, 2025

Bump Traefik to v3.6 due to Docker 29.X.X compatibility fosrl/pangolin#1884

Merged

joelguittet mentioned this pull request Nov 19, 2025

Update traefik version mendersoftware/mender-server#1099

Merged

mtracz mentioned this pull request Nov 24, 2025

support Docker v29 blumilksoftware/environment#13

Merged

josephradford mentioned this pull request Nov 25, 2025

Fix infrastructure compatibility issues: Traefik Docker API + Homepage API service josephradford/home-server-stack#90

Merged

7 tasks

EngTurtle mentioned this pull request Nov 29, 2025

3.6.1 fails with docker client version is too new #12279

Open

2 tasks

bmah888 pushed a commit to esnet/esnet-smartnic-fw that referenced this pull request Dec 19, 2025

stack: upgrade traefik from 3.5.2 -> 3.6.5: fix docker 29.x API compat

18c249c

Relevant upstream commit is here: * traefik/traefik#12256

lcottereau added a commit to ARCEP-dev/geocodage_ban that referenced this pull request Feb 5, 2026

Montée de version traefik

0ffe89b

Suite à breaking change docker API traefik/traefik#12256

jaymecd mentioned this pull request Feb 23, 2026

upgrade traefik to auto-resolve docker version jaymecd/localtest#2

Merged

Uh oh!

Conversation

felixbuenemann commented Nov 11, 2025 • edited by kevinpollet Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What does this PR do?

Motivation

Additional Notes

Uh oh!

thaJeztah left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

MarkenJaden commented Nov 11, 2025

Uh oh!

thaJeztah left a comment

Choose a reason for hiding this comment

Uh oh!

thaJeztah commented Nov 12, 2025

Uh oh!

thaJeztah commented Nov 12, 2025

Uh oh!

goppinath commented Nov 12, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

sbusch commented Nov 12, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

thaJeztah commented Nov 12, 2025

Uh oh!

marcopaggioro commented Nov 12, 2025

Uh oh!

saltydk commented Nov 12, 2025

Uh oh!

MrTengil commented Nov 12, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

iBros commented Nov 12, 2025

Uh oh!

ChaosExAnima commented Nov 12, 2025

Uh oh!

iBros commented Nov 12, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

16 participants

felixbuenemann commented Nov 11, 2025 •

edited by kevinpollet

Loading

goppinath commented Nov 12, 2025 •

edited

Loading

sbusch commented Nov 12, 2025 •

edited

Loading

MrTengil commented Nov 12, 2025 •

edited

Loading