Skip to content

Add Cirrus-CI integration#1175

Merged
daviesrob merged 2 commits intosamtools:developfrom
jkbonfield:cirrus-ci
Nov 5, 2020
Merged

Add Cirrus-CI integration#1175
daviesrob merged 2 commits intosamtools:developfrom
jkbonfield:cirrus-ci

Conversation

@jkbonfield
Copy link
Copy Markdown
Contributor

This is a replacement for Travis, but it doesn't remove it (yet) so we can compare side by side for a while. Compared to Travis is lacks the s390x test.

However we have gcc:latest (Debian), clang (via ubuntu:devel) and MacOS X (clang only). The mix of maintainer-checks, with/without config, libdeflate, pedantic and address sanitizer are sprinkled across the various environments so we don't have a huge matrix. We also test libdeflate integration from local source (Debian, MacOS) and from OS installed package (Ubuntu).

Everything launches in parallel bar the 2nd MacOS X instance as it appears we're limited to just 1.

Other possibilities could include pretty much anything on docker-hub, so we could consider 32-bit builds if we feel it's worth it.
That also means we have the potential for custom containers with the prerequisites already installed so we have a leaner instance startup. The ubuntu ones spend maybe 25-30% of their time installing compilers and libraries.

Example builds can be seen here:

https://cirrus-ci.com/build/5071567057059840

@daviesrob
Copy link
Copy Markdown
Member

Looking at the CPU and memory graphs on the results, it looks like we rarely go above 2 cpus and only use a tiny amount of the available memory. Given that, it might be a good idea to use:

cpu: 2
memory: 1G

I don't think it will change the run time too much, but it might ensure our jobs get scheduled faster at times of high demand.

@jkbonfield
Copy link
Copy Markdown
Contributor Author

Agreed. I've already tweaked the Samtools version to do this and plan to go back and modify the htslib one.

I don't see how to tweak these for the Mac instances though. It may not be possible there.

@jkbonfield
Copy link
Copy Markdown
Contributor Author

A few minor tweaks squashed into one commit

  • MacOS X vs macOS
  • The typo Rob found above
  • CPU / mem limits
  • Centos build
  • Improved formatting

@daviesrob daviesrob merged commit 21b677e into samtools:develop Nov 5, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants