Skip to content
This repository was archived by the owner on Apr 1, 2026. It is now read-only.
This repository was archived by the owner on Apr 1, 2026. It is now read-only.

Split out system tests into separate Kokoro jobs #388

@tseaver

Description

@tseaver

Working to reduce CI latency. Here are timings on my local machine (note the pre-run with --install-only to avoid measuring virtualenv creation time):

$ for job in $(nox --list | grep "^\*" | cut -d " " -f 2); do     echo $job; nox -e $job --install-only; time nox -re $job; done
nox > Running session lint
...
nox > Session lint was successful.

real	0m2.864s
user	0m11.466s
sys	0m0.181s
blacken
nox > Running session blacken
...
nox > Session blacken was successful.

real	0m0.923s
user	0m0.854s
sys	0m0.073s
lint_setup_py
nox > Running session lint_setup_py
...
running check
nox > Session lint_setup_py was successful.

real	0m0.993s
user	0m0.906s
sys	0m0.091s
unit-3.6
nox > Running session unit-3.6
...
1303 passed, 12 skipped, 6 warnings in 25.51s
nox > Session unit-3.6 was successful.

real	0m29.599s
user	0m22.898s
sys	0m0.712s
unit-3.7
nox > Running session unit-3.7
...
1303 passed, 12 skipped in 25.07s
nox > Session unit-3.7 was successful.

real	0m28.773s
user	0m21.687s
sys	0m0.616s
unit-3.8
nox > Running session unit-3.8
...
1303 passed, 12 skipped in 21.92s
nox > Session unit-3.8 was successful.

real	0m25.517s
user	0m21.013s
sys	0m0.548s
unit-3.9
nox > Running session unit-3.9
...
1303 passed, 12 skipped in 22.78s
nox > Session unit-3.9 was successful.

real	0m26.286s
user	0m21.834s
sys	0m0.699s
system_emulated
...
nox > Session system_emulated skipped: gcloud not found but required for emulator support.

real	0m0.092s
user	0m0.073s
sys	0m0.020s
system-3.8
nox > Running session system-3.8
...
34 passed, 1 skipped, 47 warnings in 235.03s (0:03:55)
nox > Session system-3.8 was successful.

real	3m58.387s
user	0m4.865s
sys	0m0.691s
cover
nox > Running session cover
...
nox > Session cover was successful.

real	0m3.227s
user	0m3.080s
sys	0m0.149s
docs
nox > Running session docs
...
nox > Session docs was successful.

real	0m10.415s
user	0m9.903s
sys	0m0.363s

The four minutes for the system tests would usefully be split out from the rest.

Metadata

Metadata

Assignees

Labels

api: bigtableIssues related to the googleapis/python-bigtable API.type: processA process-related concern. May include testing, release, or the like.

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions