[CI] fix 'no matches found within 10000'#21466
Conversation
💔 Tests FailedExpand to view the summary
Build stats
Test stats 🧪
Test errorsExpand to view the tests failures
Steps errorsExpand to view the steps failures
Log outputExpand to view the last 100 lines of log output
|
…-matches-found * upstream/master: (21 commits) Skip filestream flaky tests (elastic#21490) Ignore unsupported metrics in the azure module (elastic#21486) Do not run symlink tests on Windows (elastic#21472) Map `cloud.account.id` to azure sub id (elastic#21483) Add support for app_state metricset (elastic#20639) Include original error when metricbeat fails to connect with Kafka (elastic#21484) Prompt only when agent is already enrolled (elastic#21473) Fix leftover delpoyment example (elastic#21474) Bump version to ECS 1.6 in modules without ECS updates (elastic#21455) Clarify input type configuration options (elastic#19284) Increase index pattern size check to 10MiB (elastic#21487) Migrate S3 Input to Filebeat Input V2 (elastic#20005) [libbeat] Add configurable exponential backoff for disk queue write errors (elastic#21493) Revert "Revert "[JJBB] Set shallow cloning to 10 (elastic#21409)" (elastic#21447)" (elastic#21467) Fix format of debug messages in tlscommon (elastic#21482) [CI] Change x-pack/auditbeat build events (comments, labels) (elastic#21463) [CI] changeset from elastic#20603 was not added to CI2.0 (elastic#21464) Add new log file reader for filestream input (elastic#21450) [CI] Send slack message with build status (elastic#21428) Remove duplicated sources url in dependencies report (elastic#21462) ...
| if (isUnix()) { | ||
| cmd(label: 'Delete folders that are causing exceptions (See JENKINS-58421)', | ||
| returnStatus: true, | ||
| script: 'rm -rf ve || true; find . -type d -name vendor -exec rm -r {} \\;') | ||
| } else { log(level: 'INFO', text: 'Delete folders that are causing exceptions (See JENKINS-58421) is disabled for Windows.') } |
There was a problem hiding this comment.
Clean the build artifacts when the folder is too big!
| if (isUnix()) { | ||
| cmd(label: 'Delete folders that are causing exceptions (See JENKINS-58421)', | ||
| returnStatus: true, | ||
| script: 'rm -rf ve || true; find . -type d -name vendor -exec rm -r {} \\;') |
There was a problem hiding this comment.
I've no clue where the ve folder is defined, but it's there for the libbeat
[2020-10-05T11:59:25.997Z] + echo libbeat-build
[2020-10-05T11:59:25.998Z] libbeat-build
[2020-10-05T11:59:25.998Z] + ls -ltrah
[2020-10-05T11:59:25.998Z] total 20K
[2020-10-05T11:59:25.998Z] drwxr-xr-x 258 jenkins jenkins 4.0K Oct 5 11:51 docker-gocache
[2020-10-05T11:59:25.998Z] drwxr-xr-x 3 jenkins jenkins 4.0K Oct 5 11:56 ve
[2020-10-05T11:59:25.998Z] drwxr-xr-x 3 jenkins jenkins 4.0K Oct 5 11:59 libbeat
[2020-10-05T11:59:25.998Z] drwxr-xr-x 5 jenkins jenkins 4.0K Oct 5 11:59 .
[2020-10-05T11:59:25.998Z] drwxr-xr-x 26 jenkins jenkins 4.0K Oct 5 11:59 ..
[2020-10-05T11:59:25.998Z] + find . -name build -ls
[2020-10-05T11:59:25.998Z] 5167709 4 drwxr-xr-x 3 jenkins jenkins 4096 Oct 5 11:59 ./libbeat/build
[2020-10-05T11:59:25.998Z] 5430897 4 drwxr-xr-x 3 jenkins jenkins 4096 Oct 5 11:57 ./ve/docker/lib/python3.7/site-packages/pip/_internal/operations/build
``
There was a problem hiding this comment.
IIRC it's created for the integration tests and is created by a Makefile target. It's a Python virtual environment. Should be safe to delete.
| } else { log(level: 'INFO', text: 'Delete folders that are causing exceptions (See JENKINS-58421) is disabled for Windows.') } | ||
| junitAndStore(allowEmptyResults: true, keepLongStdio: true, testResults: args.testResults, stashedTestReports: stashedTestReports, id: args.id) | ||
| archiveArtifacts(allowEmptyArchive: true, artifacts: args.artifacts) | ||
| tar(file: "test-build-artifacts-${args.id}.tgz", dir: '.', archive: true, allowMissing: true) |
There was a problem hiding this comment.
This might help us to avoid the interruption error even when the cleanup defined above happened:
[2020-10-05T12:09:17.924Z] drwxr-xr-x 26 jenkins jenkins 4.0K Oct 5 12:09 ..
[2020-10-05T12:09:17.924Z] + find . -name build -ls
[2020-10-05T12:09:17.924Z] 5170689 4 drwxr-xr-x 4 jenkins jenkins 4096 Oct 5 12:09 ./metricbeat/build
[2020-10-05T12:09:17.924Z] 5168179 4 drwxr-xr-x 3 jenkins jenkins 4096 Oct 5 11:39 ./ve/docker/lib/python3.7/site-packages/pip/_internal/operations/build
[2020-10-05T12:09:17.934Z] [Pipeline] isUnix
[2020-10-05T12:09:17.937Z] [Pipeline] sh
[2020-10-05T12:09:18.224Z] + rm -rf ve
[2020-10-05T12:09:18.224Z] + find . -type d -name vendor -exec rm -r {} ;
[2020-10-05T12:09:18.239Z] [Pipeline] junit
[2020-10-05T12:09:18.239Z] WARNING: Unknown parameter(s) found for class type 'hudson.tasks.junit.pipeline.JUnitResultsStep': id,stashedTestReports
[2020-10-05T12:09:18.242Z] Recording test results
[2020-10-05T12:09:19.975Z] [Pipeline] stash
[2020-10-05T12:09:20.208Z] Stashed 1 file(s)
[2020-10-05T12:09:20.213Z] [Pipeline] archiveArtifacts
[2020-10-05T12:09:20.219Z] Archiving artifacts
[2020-10-05T12:09:20.450Z] java.lang.InterruptedException: no matches found within 10000
[2020-10-05T12:09:20.450Z] at hudson.FilePath$ValidateAntFileMask.hasMatch(FilePath.java:2865)
[2020-10-05T12:09:20.450Z] at hudson.FilePath$ValidateAntFileMask.invoke(FilePath.java:2744)
[2020-10-05T12:09:20.450Z] at hudson.FilePath$ValidateAntFileMask.invoke(FilePath.java:2725)
[2020-10-05T12:09:20.450Z] at hudson.FilePath$FileCallableWrapper.call(FilePath.java:3112)
[2020-10-05T12:09:20.450Z] Also: hudson.remoting.Channel$CallSiteStackTrace: Remote call to JNLP4-connect connection from beats-ci-immutable-ubuntu-1804-1601897573326600637.c.elastic-ci-prod.internal/10.224.1.213:57106
cachedout
left a comment
There was a problem hiding this comment.
This looks like a good fix. 👍
| if (isUnix()) { | ||
| cmd(label: 'Delete folders that are causing exceptions (See JENKINS-58421)', | ||
| returnStatus: true, | ||
| script: 'rm -rf ve || true; find . -type d -name vendor -exec rm -r {} \\;') |
There was a problem hiding this comment.
IIRC it's created for the integration tests and is created by a Makefile target. It's a Python virtual environment. Should be safe to delete.
* upstream/master: [CI] Setup git config globally (elastic#21562) docs: update generate_fields_docs.py (elastic#21359) Add support for additional fields from V2 ALB logs (elastic#21540) Move Prometheus query & remote_write to GA (elastic#21507) feat: add a new step to run the e2e tests for certain parts of Beats (elastic#21100) [Elastic Agent] Add elastic agent ID and version to events from filebeat and metricbeat. (elastic#21543) Release cloudfoundry input and processor as GA (elastic#21525) [Packetbeat] New SIP protocol (elastic#21221) [Filebeat][New Module] Add support for Microsoft MTP / 365 Defender (elastic#21446) [Beats][pytest] Asserting if filebeat logs include errors (elastic#20999) junipersrx-module initial release (elastic#20017) Add a persistent cache for cloudfoundry metadata based on badger (elastic#20775) Add missing changelog entry for cisco umbrella (elastic#21550) [Elastic Agent] Add upgrade CLI to initiate upgrade of Agent locally (elastic#21425) Enable filestream input (elastic#21533) Add filestream input reader (elastic#21481) [CI] fix 'no matches found within 10000' (elastic#21466) Fix billing.go aws.GetStartTimeEndTime (elastic#21531)
* cherry-pick aad07ad * Add stages to Jenkins pipeline (#14484) * ci: avoid to modify go.mod file (#16842) * Ensure install scripts only install if needed (#20349) * ci: fix warnings with wildcards and archive system-tests (#18695) * ci: run test on Windows (#15570) * [CI] fail if not possible to install python3 (#19164) * [CI] lint stage doesn't produce test reports (#21888) * [CI] Add stage name in the step (#21887) * [CI] kind setup fails sometimes (#21857) * [CI] refactor runbld post build action (#21256) * [CI] Archive build reasons (#21347) * [CI] Fix runbld when workspace does not exist (#21350) * [CI] Send slack message with build status (#21428) * [CI] Setup git config globally (#21562) * [CI] fix 'no matches found within 10000' (#21466) * [CI] Change notification channel (#21559) * [CI] Support skip-ci label (#21377) * [BUILD][CI] fetch dependencies with retry (#21614) * Disable x-pack/metricbeat in linux since build is broken #21962 * Disable tests for windows in auditbeat. See #21958 * Disable integration testing for libbeat. See #21959 * Disable integration testing for metricbeat. See #21961 * Disable windows build for auditbeat. See #21958 * Disable build for libbeat. See #21959 * Disable build for metricbeat. See #21961 * Disable windows build for metricbeat. See #22257 * Disable build for x-pack/metricbeat. See #21962 * Disable windows build for x-pack/winlogbeat. See #22263 * Disable windows build for x-pack/filebeat. See #21963 * integration-tests-environment is not available for winlogbeat. see #22265 * integration-tests-environment is not available for packetbeat. see #22266 * Build not available for x-pack/metricbeats in 6.8. See #22269 * Cherry-pick 96c60d0
What does this PR do?
Tar the
buildfolder rather than archiving the giving list of files.Delete cached folder that are causing the stacktrace reported in JENKINS-58421
Why is it important?
Avoid corruption in the builds.
Issues
#18695 was the initial approach to reduce those stacktrace errors, but there were 3 cases that were not fixed though!
Tests