Skip to content

buildkite pipeline file limitation - error #1209

@chrislovecnm

Description

@chrislovecnm

I added a new example into CI and got the following error:

The number of tasks in one config file is limited to 80!

This is because of https://github.com/bazelbuild/continuous-integration/blob/master/buildkite/bazelci.py#L650

A few observations about our ci.

  1. We have a single file, I am not a buildkite expert, but I wonder if we can break it up into multiple files.
  2. We are testing across multiple Linux platforms: Debian and Ubuntu. I am wondering if we can drop one of those.
  3. We are running tests for both bzlmod and WORKSPACE files (not sure we can do anything here). Maybe combine those into a single run that happens in the same task?
  4. We have separate runs for each folder under "tests". Can we combine these at all?

The TLDR; is that we have a lot of tests in one file. I love tests, but we need to see if we can break them into different files or prune the number of tests. I assume that we are going to get more and more tests for both bzlmod and WORKSPACE files.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions