Run Artman smoke tests as part of CircleCI#2443
Run Artman smoke tests as part of CircleCI#2443andreamlin merged 9 commits intogoogleapis:masterfrom
Conversation
|
PTAL Check out https://circleci.com/gh/googleapis/gapic-generator/9989 for the artman smoke test run! |
alexander-fenster
left a comment
There was a problem hiding this comment.
Let's see how it works!
|
Oh wow it caught some actual failures that are locally reproducible, namely the containeranalysis_v1beta1 artman failures. |
|
This is blocked by #2454, which is a regression in gapic-generator that prevents some artman calls from succeeding. |
db0b153 to
2dd87d7
Compare
Codecov Report
@@ Coverage Diff @@
## master #2443 +/- ##
=========================================
Coverage ? 86.53%
Complexity ? 5289
=========================================
Files ? 458
Lines ? 21055
Branches ? 2298
=========================================
Hits ? 18219
Misses ? 2011
Partials ? 825Continue to review full report at Codecov.
|
|
https://github.com/circleci/circleci-images/issues/275 causes the Ruby failure |
Run the full suite of artman smoke tests. This does even more tightly couple gapic-generator to artman for now, but it will save us time down the road when we go to release artman and gapic-generator has broken artman.
Soon after this, I can put in a CircleCI job filter so these smoke tests only run on the master branch, given that they take a long time (~40 minutes).