Skip to content

Getting intermittent "Canceled desc = context canceled" errors #369

@rolandjitsu

Description

@rolandjitsu

I keep getting the following error every now and then when using the docker buildx bake cmd to build multiple targets:

#46 [my-binary] exporting cache
#46 writing layer sha256:9edb701023749d7bcd61f2d75d92466fc76357c68c5140aa6c3c413216443467 14.3s done
#46 writing config sha256:cba07732898365dd336ac069251020e9a2812d00b186b69b7c5255d259699e23 0.1s done
#46 writing manifest sha256:448022b5f3415d4f1e0dce9930d5c6a5601b3adb2ee585688c1d9b8ed466b8b4
ERRO[0012] (*service).Write failed                       error="rpc error: code = Canceled desc = context canceled" expected="sha256:f0bd1e2da3dd1a52d9757d570387f5dd707d0921537f5e119b7161e39ba2b911" ref="sha256:f0bd1e2da3dd1a52d9757d570387f5dd707d0921537f5e119b7161e39ba2b911" total=1928

The issue is that it doesn't exit, it keeps building and it's difficult to spot.

I've also seen some other errors from http2 about connection with the server that also don't make the build fail.

Running in the following env:
Buildx builder driver: kubernetes (running on GCP):
OS: macOS Catalina 10.15.4
Buildx Version: v0.4.1
Docker:

❯ docker info
Client:
 Debug Mode: false
 Plugins:
  app: Docker Application (Docker Inc., v0.8.0)
  mutagen: Synchronize files with Docker Desktop (Docker Inc., testing)
  buildx: Build with BuildKit (Docker Inc.)

Server:
 Containers: 54
  Running: 1
  Paused: 0
  Stopped: 53
 Images: 92
 Server Version: 19.03.12
 Storage Driver: overlay2
  Backing Filesystem: extfs
  Supports d_type: true
  Native Overlay Diff: true
 Logging Driver: json-file
 Cgroup Driver: cgroupfs
 Plugins:
  Volume: local
  Network: bridge host ipvlan macvlan null overlay
  Log: awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog
 Swarm: inactive
 Runtimes: runc
 Default Runtime: runc
 Init Binary: docker-init
 containerd version: 7ad184331fa3e55e52b890ea95e65ba581ae3429
 runc version: dc9208a3303feef5b3839f4323d9beb36df0a9dd
 init version: fec3683
 Security Options:
  seccomp
   Profile: default
 Kernel Version: 4.19.76-linuxkit
 Operating System: Docker Desktop
 OSType: linux
 Architecture: x86_64
 CPUs: 6
 Total Memory: 5.811GiB
 Name: docker-desktop
 ID: RVJ5:CWE4:NLJT:FFJY:S5MA:V5HC:AAPU:2ZOM:BREP:MGTM:M5EZ:47WX
 Docker Root Dir: /var/lib/docker
 Debug Mode: true
  File Descriptors: 40
  Goroutines: 52
  System Time: 2020-08-28T06:07:49.0860386Z
  EventsListeners: 3
 HTTP Proxy: gateway.docker.internal:3128
 HTTPS Proxy: gateway.docker.internal:3129
 Registry: https://index.docker.io/v1/
 Labels:
 Experimental: true
 Insecure Registries:
  127.0.0.0/8
 Live Restore Enabled: false
 Product License: Community Engine

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions