Skip to content

try a disk cache using the restore_keys trick#16

Merged
xvandish merged 11 commits intomy_mainfrom
disk_cache_experiments
Mar 25, 2022
Merged

try a disk cache using the restore_keys trick#16
xvandish merged 11 commits intomy_mainfrom
disk_cache_experiments

Conversation

@xvandish
Copy link
Copy Markdown
Owner

@xvandish xvandish commented Mar 24, 2022

We just switched from BuildBuddy GRPC cache -> GCS HTTP cache, and now we're changing one more time to a "local" gh cache.

We use the actions/cache action provided by GitHub to store the Bazel cache, along with a restore_keys trick that allows us to write to the cache on every invocation. Bazel builds now take ~30s for repeat builds, and the thing that's slowish is downloading/uploading the cache, which takes ~80% of the CI run time. But combined, the now ~4-5min CI times are much faster than the average remote cache run.

@xvandish xvandish merged commit d62627a into my_main Mar 25, 2022
xvandish added a commit that referenced this pull request Jul 19, 2022
* try a disk cache using the restore_keys trick

* now add a blank line to test rebuild with cache

* print cache size

* update actions/cache to v3 for perf improvments

* remove useless ls

* remove space

* bump down to v2 until the max_length issue is resolved

actions/toolkit#1030

* Attempt to fix images building on pr's to my_main

* Add debugging step

* Add cron schedule so github doesn't pruge cache, and remove debug step

* Read-only cache on PR's again now that cache is seeded
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant