[WIP] Buildkit integration by ktock · Pull Request #53 · containerd/stargz-snapshotter

ktock · 2020-03-04T08:40:03Z

The re-opened version of #52.
Thread on buildkit is moby/buildkit#1396.

This is an experimental integration with buildkit for speeding up fetching base image.

Our patched version of buildkit is here.

This commit includes benchmark scripts to measure the time for buliding sample images.
See this doc for manual testing.

Though it seems good for the lazy distribution of the base images, we currently have two problems for exporting output image.

Archiving layers takes a long time. It is because of the low READ performance including fetching contents from the registry.
We only support exporting type tar. It is because when we use remote snapshotters, containerd doesn't store the image contents in the content store but buildkit needs to use these contents for exporting images.

cc @AkihiroSuda @tonistiigi

ktock · 2020-03-04T08:54:18Z

Please see the current benchmarking result at #52 (comment)

ktock · 2020-03-05T02:14:12Z

Benchmarking result from https://github.com/containerd/stargz-snapshotter/actions/runs/49823625.

Buildkit integration performance(without exporting)

OCI Worker

With original baseimage

Arguments for buildkitd: --oci-worker-snapshotter=overlayfs
Context for buildctl: ./script/buildkit/sample_org

real	0m13.372s
user	0m0.022s
sys	0m0.007s

With stargz baseimage

Arguments for buildkitd: --oci-worker-snapshotter=stargz --oci-worker-proxy-snapshotter-address=/run/containerd-stargz-grpc/containerd-stargz-grpc.sock
Context for buildctl: ./script/buildkit/sample_sgz

real	0m2.626s
user	0m0.006s
sys	0m0.012s

containerd Worker

With original baseimage

Arguments for buildkitd: --oci-worker=false --containerd-worker=true
Context for buildctl: ./script/buildkit/sample_org

real	0m14.121s
user	0m0.034s
sys	0m0.000s

With stargz baseimage

Arguments for buildkitd: --oci-worker=false --containerd-worker=true --containerd-worker-snapshotter=stargz
Context for buildctl: ./script/buildkit/sample_sgz

real	0m2.750s
user	0m0.007s
sys	0m0.010s

Buildkit integration performance(with exporting: `--output type=tar`)

OCI Worker

With original baseimage

Arguments for buildkitd: --oci-worker-snapshotter=overlayfs
Context for buildctl: ./script/buildkit/sample_org

real	0m19.333s
user	0m3.462s
sys	0m1.340s

With stargz baseimage

Arguments for buildkitd: --oci-worker-snapshotter=stargz --oci-worker-proxy-snapshotter-address=/run/containerd-stargz-grpc/containerd-stargz-grpc.sock
Context for buildctl: ./script/buildkit/sample_sgz

real	1m22.486s
user	0m8.465s
sys	0m5.946s

containerd Worker

With original baseimage

Arguments for buildkitd: --oci-worker=false --containerd-worker=true
Context for buildctl: ./script/buildkit/sample_org

real	0m29.448s
user	0m3.520s
sys	0m1.846s

With stargz baseimage

Arguments for buildkitd: --oci-worker=false --containerd-worker=true --containerd-worker-snapshotter=stargz
Context for buildctl: ./script/buildkit/sample_sgz

real	1m32.592s
user	0m8.957s
sys	0m5.745s

ktock · 2020-03-05T08:20:14Z

Benchmarking result from: https://github.com/containerd/stargz-snapshotter/actions/runs/49967985

Buildkit integration performance(without exporting)

OCI Worker

With original baseimage

Arguments for buildkitd: --oci-worker-snapshotter=overlayfs
Context for buildctl: ./script/buildkit/sample_org

real	0m16.144s
user	0m0.022s
sys	0m0.018s

With stargz baseimage

Arguments for buildkitd: --oci-worker-snapshotter=stargz --oci-worker-proxy-snapshotter-address=/run/containerd-stargz-grpc/containerd-stargz-grpc.sock
Context for buildctl: ./script/buildkit/sample_sgz

real	0m3.124s
user	0m0.012s
sys	0m0.008s

containerd Worker

With original baseimage

Arguments for buildkitd: --oci-worker=false --containerd-worker=true
Context for buildctl: ./script/buildkit/sample_org

real	0m16.880s
user	0m0.014s
sys	0m0.031s

With stargz baseimage

Arguments for buildkitd: --oci-worker=false --containerd-worker=true --containerd-worker-snapshotter=stargz
Context for buildctl: ./script/buildkit/sample_sgz

real	0m3.577s
user	0m0.000s
sys	0m0.022s

Buildkit integration performance(with exporting: `--output type=tar`)

OCI Worker

With original baseimage

Arguments for buildkitd: --oci-worker-snapshotter=overlayfs
Context for buildctl: ./script/buildkit/sample_org

real	0m23.157s
user	0m4.366s
sys	0m1.861s

With stargz baseimage

Arguments for buildkitd: --oci-worker-snapshotter=stargz --oci-worker-proxy-snapshotter-address=/run/containerd-stargz-grpc/containerd-stargz-grpc.sock
Context for buildctl: ./script/buildkit/sample_sgz

real	1m22.889s
user	0m9.855s
sys	0m6.953s

containerd Worker

With original baseimage

Arguments for buildkitd: --oci-worker=false --containerd-worker=true
Context for buildctl: ./script/buildkit/sample_org

real	0m34.430s
user	0m4.724s
sys	0m1.984s

With stargz baseimage

Arguments for buildkitd: --oci-worker=false --containerd-worker=true --containerd-worker-snapshotter=stargz
Context for buildctl: ./script/buildkit/sample_sgz

real	1m28.076s
user	0m9.971s
sys	0m7.287s

ktock · 2020-03-05T08:39:16Z

Opened moby/buildkit#1396.

ktock · 2020-03-09T07:10:33Z

Benchmarking result from https://github.com/containerd/stargz-snapshotter/actions/runs/52085114
Bulidkit version: ktock/buildkit@d4cb5c9

Buildkit integration performance(without exporting)

OCI Worker

With original baseimage

Arguments for buildkitd: --oci-worker-snapshotter=overlayfs
Arguments for buildctl: --progress=plain --frontend=dockerfile.v0 --local context="./script/buildkit/sample_org" --local dockerfile="./script/buildkit/sample_org" 

real	0m17.868s
user	0m0.035s
sys	0m0.009s

With stargz baseimage

Arguments for buildkitd: --oci-worker-snapshotter=stargz --oci-worker-proxy-snapshotter-address=/run/containerd-stargz-grpc/containerd-stargz-grpc.sock
Arguments for buildctl: --progress=plain --frontend=dockerfile.v0 --local context="./script/buildkit/sample_sgz" --local dockerfile="./script/buildkit/sample_sgz" 

real	0m7.200s
user	0m0.019s
sys	0m0.010s

containerd Worker

With original baseimage

Arguments for buildkitd: --oci-worker=false --containerd-worker=true
Arguments for buildctl: --progress=plain --frontend=dockerfile.v0 --local context="./script/buildkit/sample_org" --local dockerfile="./script/buildkit/sample_org" 

real	0m16.851s
user	0m0.022s
sys	0m0.022s

With stargz baseimage

Arguments for buildkitd: --oci-worker=false --containerd-worker=true --containerd-worker-snapshotter=stargz
Arguments for buildctl: --progress=plain --frontend=dockerfile.v0 --local context="./script/buildkit/sample_sgz" --local dockerfile="./script/buildkit/sample_sgz" 

real	0m7.357s
user	0m0.012s
sys	0m0.020s

Buildkit integration performance(with exporting: `type=tar,dest=/opt/buildkit/tmp.tar`)

OCI Worker

With original baseimage

Arguments for buildkitd: --oci-worker-snapshotter=overlayfs
Arguments for buildctl: --progress=plain --frontend=dockerfile.v0 --local context="./script/buildkit/sample_org" --local dockerfile="./script/buildkit/sample_org" --output=type=tar,dest=/opt/buildkit/tmp.tar

real	0m17.117s
user	0m0.043s
sys	0m0.016s

With stargz baseimage

Arguments for buildkitd: --oci-worker-snapshotter=stargz --oci-worker-proxy-snapshotter-address=/run/containerd-stargz-grpc/containerd-stargz-grpc.sock
Arguments for buildctl: --progress=plain --frontend=dockerfile.v0 --local context="./script/buildkit/sample_sgz" --local dockerfile="./script/buildkit/sample_sgz" --output=type=tar,dest=/opt/buildkit/tmp.tar

real	0m7.658s
user	0m0.029s
sys	0m0.022s

containerd Worker

With original baseimage

Arguments for buildkitd: --oci-worker=false --containerd-worker=true
Arguments for buildctl: --progress=plain --frontend=dockerfile.v0 --local context="./script/buildkit/sample_org" --local dockerfile="./script/buildkit/sample_org" --output=type=tar,dest=/opt/buildkit/tmp.tar

real	0m16.966s
user	0m0.024s
sys	0m0.053s

With stargz baseimage

Arguments for buildkitd: --oci-worker=false --containerd-worker=true --containerd-worker-snapshotter=stargz
Arguments for buildctl: --progress=plain --frontend=dockerfile.v0 --local context="./script/buildkit/sample_sgz" --local dockerfile="./script/buildkit/sample_sgz" --output=type=tar,dest=/opt/buildkit/tmp.tar

real	0m7.463s
user	0m0.031s
sys	0m0.014s

Buildkit integration performance(with exporting: `type=docker,name=sample,dest=/opt/buildkit/tmp.tar`)

OCI Worker

With original baseimage

Arguments for buildkitd: --oci-worker-snapshotter=overlayfs
Arguments for buildctl: --progress=plain --frontend=dockerfile.v0 --local context="./script/buildkit/sample_org" --local dockerfile="./script/buildkit/sample_org" --output=type=docker,name=sample,dest=/opt/buildkit/tmp.tar

real	0m17.159s
user	0m0.028s
sys	0m0.027s

With stargz baseimage

Arguments for buildkitd: --oci-worker-snapshotter=stargz --oci-worker-proxy-snapshotter-address=/run/containerd-stargz-grpc/containerd-stargz-grpc.sock
Arguments for buildctl: --progress=plain --frontend=dockerfile.v0 --local context="./script/buildkit/sample_sgz" --local dockerfile="./script/buildkit/sample_sgz" --output=type=docker,name=sample,dest=/opt/buildkit/tmp.tar

real	0m7.617s
user	0m0.019s
sys	0m0.019s

containerd Worker

With original baseimage

Arguments for buildkitd: --oci-worker=false --containerd-worker=true
Arguments for buildctl: --progress=plain --frontend=dockerfile.v0 --local context="./script/buildkit/sample_org" --local dockerfile="./script/buildkit/sample_org" --output=type=docker,name=sample,dest=/opt/buildkit/tmp.tar

real	0m17.726s
user	0m0.037s
sys	0m0.022s

With stargz baseimage

Arguments for buildkitd: --oci-worker=false --containerd-worker=true --containerd-worker-snapshotter=stargz
Arguments for buildctl: --progress=plain --frontend=dockerfile.v0 --local context="./script/buildkit/sample_sgz" --local dockerfile="./script/buildkit/sample_sgz" --output=type=docker,name=sample,dest=/opt/buildkit/tmp.tar

real	0m7.506s
user	0m0.033s
sys	0m0.009s

Buildkit integration performance(with exporting: `type=oci,name=sample,dest=/opt/buildkit/tmp.tar`)

OCI Worker

With original baseimage

Arguments for buildkitd: --oci-worker-snapshotter=overlayfs
Arguments for buildctl: --progress=plain --frontend=dockerfile.v0 --local context="./script/buildkit/sample_org" --local dockerfile="./script/buildkit/sample_org" --output=type=oci,name=sample,dest=/opt/buildkit/tmp.tar

real	0m17.405s
user	0m0.029s
sys	0m0.023s

With stargz baseimage

Arguments for buildkitd: --oci-worker-snapshotter=stargz --oci-worker-proxy-snapshotter-address=/run/containerd-stargz-grpc/containerd-stargz-grpc.sock
Arguments for buildctl: --progress=plain --frontend=dockerfile.v0 --local context="./script/buildkit/sample_sgz" --local dockerfile="./script/buildkit/sample_sgz" --output=type=oci,name=sample,dest=/opt/buildkit/tmp.tar

real	0m7.432s
user	0m0.030s
sys	0m0.010s

containerd Worker

With original baseimage

Arguments for buildkitd: --oci-worker=false --containerd-worker=true
Arguments for buildctl: --progress=plain --frontend=dockerfile.v0 --local context="./script/buildkit/sample_org" --local dockerfile="./script/buildkit/sample_org" --output=type=oci,name=sample,dest=/opt/buildkit/tmp.tar

real	0m17.794s
user	0m0.025s
sys	0m0.040s

With stargz baseimage

Arguments for buildkitd: --oci-worker=false --containerd-worker=true --containerd-worker-snapshotter=stargz
Arguments for buildctl: --progress=plain --frontend=dockerfile.v0 --local context="./script/buildkit/sample_sgz" --local dockerfile="./script/buildkit/sample_sgz" --output=type=oci,name=sample,dest=/opt/buildkit/tmp.tar

real	0m7.819s
user	0m0.019s
sys	0m0.024s

Buildkit integration performance(with exporting: `type=image,name=sample`)

OCI Worker

With original baseimage

Arguments for buildkitd: --oci-worker-snapshotter=overlayfs
Arguments for buildctl: --progress=plain --frontend=dockerfile.v0 --local context="./script/buildkit/sample_org" --local dockerfile="./script/buildkit/sample_org" --output=type=image,name=sample

real	0m17.697s
user	0m0.028s
sys	0m0.014s

With stargz baseimage

Arguments for buildkitd: --oci-worker-snapshotter=stargz --oci-worker-proxy-snapshotter-address=/run/containerd-stargz-grpc/containerd-stargz-grpc.sock
Arguments for buildctl: --progress=plain --frontend=dockerfile.v0 --local context="./script/buildkit/sample_sgz" --local dockerfile="./script/buildkit/sample_sgz" --output=type=image,name=sample

real	0m7.396s
user	0m0.029s
sys	0m0.000s

containerd Worker

With original baseimage

Arguments for buildkitd: --oci-worker=false --containerd-worker=true
Arguments for buildctl: --progress=plain --frontend=dockerfile.v0 --local context="./script/buildkit/sample_org" --local dockerfile="./script/buildkit/sample_org" --output=type=image,name=sample

real	0m18.332s
user	0m0.027s
sys	0m0.020s

With stargz baseimage

Arguments for buildkitd: --oci-worker=false --containerd-worker=true --containerd-worker-snapshotter=stargz
Arguments for buildctl: --progress=plain --frontend=dockerfile.v0 --local context="./script/buildkit/sample_sgz" --local dockerfile="./script/buildkit/sample_sgz" --output=type=image,name=sample

real	0m7.565s
user	0m0.017s
sys	0m0.011s

ktock · 2020-03-10T09:47:25Z

Benchmarking result from https://github.com/containerd/stargz-snapshotter/actions/runs/52841345

Buildkit integration performance(without exporting)

OCI Worker

With original baseimage

Arguments for buildkitd: --oci-worker-snapshotter=overlayfs
Arguments for buildctl: --progress=plain --frontend=dockerfile.v0 --local context="./script/buildkit/sample_org" --local dockerfile="./script/buildkit/sample_org" 

real	0m16.492s
user	0m0.019s
sys	0m0.025s

With stargz baseimage

Arguments for buildkitd: --oci-worker-snapshotter=stargz --oci-worker-proxy-snapshotter-address=/run/containerd-stargz-grpc/containerd-stargz-grpc.sock
Arguments for buildctl: --progress=plain --frontend=dockerfile.v0 --local context="./script/buildkit/sample_sgz" --local dockerfile="./script/buildkit/sample_sgz" 

real	0m6.044s
user	0m0.017s
sys	0m0.006s

containerd Worker

With original baseimage

Arguments for buildkitd: --oci-worker=false --containerd-worker=true
Arguments for buildctl: --progress=plain --frontend=dockerfile.v0 --local context="./script/buildkit/sample_org" --local dockerfile="./script/buildkit/sample_org" 

real	0m15.613s
user	0m0.018s
sys	0m0.024s

With stargz baseimage

Arguments for buildkitd: --oci-worker=false --containerd-worker=true --containerd-worker-snapshotter=stargz
Arguments for buildctl: --progress=plain --frontend=dockerfile.v0 --local context="./script/buildkit/sample_sgz" --local dockerfile="./script/buildkit/sample_sgz" 

real	0m6.008s
user	0m0.008s
sys	0m0.019s

Buildkit integration performance(with exporting: `type=tar,dest=/opt/buildkit/tmp.tar`)

OCI Worker

With original baseimage

Arguments for buildkitd: --oci-worker-snapshotter=overlayfs
Arguments for buildctl: --progress=plain --frontend=dockerfile.v0 --local context="./script/buildkit/sample_org" --local dockerfile="./script/buildkit/sample_org" --output=type=tar,dest=/opt/buildkit/tmp.tar

real	0m14.462s
user	0m0.040s
sys	0m0.013s

With stargz baseimage

Arguments for buildkitd: --oci-worker-snapshotter=stargz --oci-worker-proxy-snapshotter-address=/run/containerd-stargz-grpc/containerd-stargz-grpc.sock
Arguments for buildctl: --progress=plain --frontend=dockerfile.v0 --local context="./script/buildkit/sample_sgz" --local dockerfile="./script/buildkit/sample_sgz" --output=type=tar,dest=/opt/buildkit/tmp.tar

real	0m6.091s
user	0m0.027s
sys	0m0.014s

containerd Worker

With original baseimage

Arguments for buildkitd: --oci-worker=false --containerd-worker=true
Arguments for buildctl: --progress=plain --frontend=dockerfile.v0 --local context="./script/buildkit/sample_org" --local dockerfile="./script/buildkit/sample_org" --output=type=tar,dest=/opt/buildkit/tmp.tar

real	0m15.512s
user	0m0.024s
sys	0m0.048s

With stargz baseimage

Arguments for buildkitd: --oci-worker=false --containerd-worker=true --containerd-worker-snapshotter=stargz
Arguments for buildctl: --progress=plain --frontend=dockerfile.v0 --local context="./script/buildkit/sample_sgz" --local dockerfile="./script/buildkit/sample_sgz" --output=type=tar,dest=/opt/buildkit/tmp.tar

real	0m6.495s
user	0m0.017s
sys	0m0.022s

Buildkit integration performance(with exporting: `type=docker,name=sample,dest=/opt/buildkit/tmp.tar`)

OCI Worker

With original baseimage

Arguments for buildkitd: --oci-worker-snapshotter=overlayfs
Arguments for buildctl: --progress=plain --frontend=dockerfile.v0 --local context="./script/buildkit/sample_org" --local dockerfile="./script/buildkit/sample_org" --output=type=docker,name=sample,dest=/opt/buildkit/tmp.tar

real	0m15.008s
user	0m0.035s
sys	0m0.013s

With stargz baseimage

Arguments for buildkitd: --oci-worker-snapshotter=stargz --oci-worker-proxy-snapshotter-address=/run/containerd-stargz-grpc/containerd-stargz-grpc.sock
Arguments for buildctl: --progress=plain --frontend=dockerfile.v0 --local context="./script/buildkit/sample_sgz" --local dockerfile="./script/buildkit/sample_sgz" --output=type=docker,name=sample,dest=/opt/buildkit/tmp.tar

real	0m6.056s
user	0m0.017s
sys	0m0.017s

containerd Worker

With original baseimage

Arguments for buildkitd: --oci-worker=false --containerd-worker=true
Arguments for buildctl: --progress=plain --frontend=dockerfile.v0 --local context="./script/buildkit/sample_org" --local dockerfile="./script/buildkit/sample_org" --output=type=docker,name=sample,dest=/opt/buildkit/tmp.tar

real	0m15.811s
user	0m0.036s
sys	0m0.020s

With stargz baseimage

Arguments for buildkitd: --oci-worker=false --containerd-worker=true --containerd-worker-snapshotter=stargz
Arguments for buildctl: --progress=plain --frontend=dockerfile.v0 --local context="./script/buildkit/sample_sgz" --local dockerfile="./script/buildkit/sample_sgz" --output=type=docker,name=sample,dest=/opt/buildkit/tmp.tar

real	0m6.509s
user	0m0.022s
sys	0m0.015s

Buildkit integration performance(with exporting: `type=oci,name=sample,dest=/opt/buildkit/tmp.tar`)

OCI Worker

With original baseimage

Arguments for buildkitd: --oci-worker-snapshotter=overlayfs
Arguments for buildctl: --progress=plain --frontend=dockerfile.v0 --local context="./script/buildkit/sample_org" --local dockerfile="./script/buildkit/sample_org" --output=type=oci,name=sample,dest=/opt/buildkit/tmp.tar

real	0m14.872s
user	0m0.018s
sys	0m0.031s

With stargz baseimage

Arguments for buildkitd: --oci-worker-snapshotter=stargz --oci-worker-proxy-snapshotter-address=/run/containerd-stargz-grpc/containerd-stargz-grpc.sock
Arguments for buildctl: --progress=plain --frontend=dockerfile.v0 --local context="./script/buildkit/sample_sgz" --local dockerfile="./script/buildkit/sample_sgz" --output=type=oci,name=sample,dest=/opt/buildkit/tmp.tar

real	0m6.181s
user	0m0.032s
sys	0m0.005s

containerd Worker

With original baseimage

Arguments for buildkitd: --oci-worker=false --containerd-worker=true
Arguments for buildctl: --progress=plain --frontend=dockerfile.v0 --local context="./script/buildkit/sample_org" --local dockerfile="./script/buildkit/sample_org" --output=type=oci,name=sample,dest=/opt/buildkit/tmp.tar

real	0m15.635s
user	0m0.032s
sys	0m0.022s

With stargz baseimage

Arguments for buildkitd: --oci-worker=false --containerd-worker=true --containerd-worker-snapshotter=stargz
Arguments for buildctl: --progress=plain --frontend=dockerfile.v0 --local context="./script/buildkit/sample_sgz" --local dockerfile="./script/buildkit/sample_sgz" --output=type=oci,name=sample,dest=/opt/buildkit/tmp.tar

real	0m5.976s
user	0m0.023s
sys	0m0.014s

Buildkit integration performance(with exporting: `type=image,name=sample`)

OCI Worker

With original baseimage

Arguments for buildkitd: --oci-worker-snapshotter=overlayfs
Arguments for buildctl: --progress=plain --frontend=dockerfile.v0 --local context="./script/buildkit/sample_org" --local dockerfile="./script/buildkit/sample_org" --output=type=image,name=sample

real	0m14.369s
user	0m0.019s
sys	0m0.019s

With stargz baseimage

Arguments for buildkitd: --oci-worker-snapshotter=stargz --oci-worker-proxy-snapshotter-address=/run/containerd-stargz-grpc/containerd-stargz-grpc.sock
Arguments for buildctl: --progress=plain --frontend=dockerfile.v0 --local context="./script/buildkit/sample_sgz" --local dockerfile="./script/buildkit/sample_sgz" --output=type=image,name=sample

real	0m6.076s
user	0m0.017s
sys	0m0.008s

containerd Worker

With original baseimage

Arguments for buildkitd: --oci-worker=false --containerd-worker=true
Arguments for buildctl: --progress=plain --frontend=dockerfile.v0 --local context="./script/buildkit/sample_org" --local dockerfile="./script/buildkit/sample_org" --output=type=image,name=sample

real	0m15.518s
user	0m0.032s
sys	0m0.011s

With stargz baseimage

Arguments for buildkitd: --oci-worker=false --containerd-worker=true --containerd-worker-snapshotter=stargz
Arguments for buildctl: --progress=plain --frontend=dockerfile.v0 --local context="./script/buildkit/sample_sgz" --local dockerfile="./script/buildkit/sample_sgz" --output=type=image,name=sample

real	0m6.114s
user	0m0.000s
sys	0m0.026s

AkihiroSuda · 2020-03-10T09:48:42Z

Better to use github artifact for benchmark results, maybe

Signed-off-by: Kohei Tokunaga <ktokunaga.mail@gmail.com>

ktock mentioned this pull request Mar 4, 2020

[WIP] buildkit integration #52

Closed

ktock mentioned this pull request Mar 5, 2020

Use Github Actions artifact for benchmarking output #54

Merged

ktock force-pushed the buildkit branch from aeaf298 to 18615ca Compare March 5, 2020 01:36

ktock force-pushed the buildkit branch from 18615ca to 79ce9cf Compare March 5, 2020 08:09

ktock mentioned this pull request Mar 5, 2020

Support stargz snapshotter for speeding up base image preparation moby/buildkit#1396

Open

ktock force-pushed the buildkit branch from b20828d to 367a439 Compare March 9, 2020 06:55

ktock force-pushed the buildkit branch 4 times, most recently from 87f10fe to a456842 Compare March 10, 2020 09:28

ktock mentioned this pull request Mar 10, 2020

Support stargz snapshotter for dev stages moby/buildkit#1402

Merged

ktock force-pushed the buildkit branch from a456842 to d74517c Compare March 13, 2020 10:55

[WIP] Buildkit integration

bc03674

Signed-off-by: Kohei Tokunaga <ktokunaga.mail@gmail.com>

ktock force-pushed the buildkit branch from d74517c to bc03674 Compare March 13, 2020 11:07

ktock closed this Nov 5, 2020

ktock deleted the buildkit branch October 7, 2022 13:44

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[WIP] Buildkit integration#53

[WIP] Buildkit integration#53
ktock wants to merge 1 commit intocontainerd:masterfrom
ktock:buildkit

ktock commented Mar 4, 2020 •

edited

Loading

Uh oh!

ktock commented Mar 4, 2020

Uh oh!

ktock commented Mar 5, 2020

Uh oh!

ktock commented Mar 5, 2020

Uh oh!

ktock commented Mar 5, 2020

Uh oh!

ktock commented Mar 9, 2020 •

edited

Loading

Uh oh!

ktock commented Mar 10, 2020

Uh oh!

AkihiroSuda commented Mar 10, 2020

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Conversation

ktock commented Mar 4, 2020 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

ktock commented Mar 4, 2020

Uh oh!

ktock commented Mar 5, 2020

Buildkit integration performance(without exporting)

OCI Worker

With original baseimage

With stargz baseimage

containerd Worker

With original baseimage

With stargz baseimage

Buildkit integration performance(with exporting: --output type=tar)

OCI Worker

With original baseimage

With stargz baseimage

containerd Worker

With original baseimage

With stargz baseimage

Uh oh!

ktock commented Mar 5, 2020

Buildkit integration performance(without exporting)

OCI Worker

With original baseimage

With stargz baseimage

containerd Worker

With original baseimage

With stargz baseimage

Buildkit integration performance(with exporting: --output type=tar)

OCI Worker

With original baseimage

With stargz baseimage

containerd Worker

With original baseimage

With stargz baseimage

Uh oh!

ktock commented Mar 5, 2020

Uh oh!

ktock commented Mar 9, 2020 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Buildkit integration performance(without exporting)

OCI Worker

With original baseimage

With stargz baseimage

containerd Worker

With original baseimage

With stargz baseimage

Buildkit integration performance(with exporting: type=tar,dest=/opt/buildkit/tmp.tar)

OCI Worker

With original baseimage

With stargz baseimage

containerd Worker

With original baseimage

With stargz baseimage

Buildkit integration performance(with exporting: type=docker,name=sample,dest=/opt/buildkit/tmp.tar)

OCI Worker

With original baseimage

With stargz baseimage

containerd Worker

With original baseimage

With stargz baseimage

Buildkit integration performance(with exporting: type=oci,name=sample,dest=/opt/buildkit/tmp.tar)

OCI Worker

With original baseimage

With stargz baseimage

containerd Worker

With original baseimage

With stargz baseimage

Buildkit integration performance(with exporting: type=image,name=sample)

OCI Worker

With original baseimage

With stargz baseimage

containerd Worker

With original baseimage

With stargz baseimage

Uh oh!

ktock commented Mar 10, 2020

Buildkit integration performance(without exporting)

ktock commented Mar 4, 2020 •

edited

Loading

Buildkit integration performance(with exporting: `--output type=tar`)

Buildkit integration performance(with exporting: `--output type=tar`)

ktock commented Mar 9, 2020 •

edited

Loading

Buildkit integration performance(with exporting: `type=tar,dest=/opt/buildkit/tmp.tar`)

Buildkit integration performance(with exporting: `type=docker,name=sample,dest=/opt/buildkit/tmp.tar`)

Buildkit integration performance(with exporting: `type=oci,name=sample,dest=/opt/buildkit/tmp.tar`)

Buildkit integration performance(with exporting: `type=image,name=sample`)

Buildkit integration performance(with exporting: `type=tar,dest=/opt/buildkit/tmp.tar`)

Buildkit integration performance(with exporting: `type=docker,name=sample,dest=/opt/buildkit/tmp.tar`)

Buildkit integration performance(with exporting: `type=oci,name=sample,dest=/opt/buildkit/tmp.tar`)

Buildkit integration performance(with exporting: `type=image,name=sample`)