Skip to content

Fix versions in requirements.txt for python 3.5 and 3.9#20507

Merged
jsoriano merged 5 commits intoelastic:masterfrom
jsoriano:fix-versions-requirements-3-9
Aug 10, 2020
Merged

Fix versions in requirements.txt for python 3.5 and 3.9#20507
jsoriano merged 5 commits intoelastic:masterfrom
jsoriano:fix-versions-requirements-3-9

Conversation

@jsoriano
Copy link
Copy Markdown
Member

@jsoriano jsoriano commented Aug 10, 2020

What does this PR do?

Fix versions of packages in requirements.txt file so they can be installed in all python versions from 3.5 to 3.9.

Added a cleaned-up version of a one-liner I was using to check the requirements.txt file with different versions.

Why is it important?

Packages listed in current requirements.txt file cannot be installed in python 3.5 and 3.9:

We still need to support python 3.5 because it is used in some CI workers.

@jsoriano jsoriano added bug review :Testing Team:Integrations Label for the Integrations team labels Aug 10, 2020
@jsoriano jsoriano self-assigned this Aug 10, 2020
@elasticmachine
Copy link
Copy Markdown
Contributor

Pinging @elastic/integrations (Team:Integrations)

@botelastic botelastic bot added needs_team Indicates that the issue/PR needs a Team:* label and removed needs_team Indicates that the issue/PR needs a Team:* label labels Aug 10, 2020
@elasticmachine
Copy link
Copy Markdown
Contributor

elasticmachine commented Aug 10, 2020

❕ Build Aborted

Either there was a build timeout or someone aborted the build.'}

Pipeline View Test View Changes Artifacts

Expand to view the summary

Build stats

  • Build Cause: [Pull request #20507 updated]

  • Start Time: 2020-08-10T12:16:50.306+0000

  • Duration: 122 min 23 sec

Test stats 🧪

Test Results
Failed 0
Passed 17679
Skipped 1929
Total 19608

Log output

Expand to view the last 100 lines of log output

[2020-08-10T14:18:42.160Z] + python .ci/scripts/search_system_tests.py
[2020-08-10T14:18:42.214Z] [INFO] system-tests=''. If no empty then let's create a tarball
[2020-08-10T14:18:43.737Z] Failed in branch Libbeat x-pack
[2020-08-10T14:18:43.865Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats
[2020-08-10T14:18:44.176Z] + find . -type f -name TEST*.xml -path */build/* -delete
[2020-08-10T14:18:44.189Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Lint
[2020-08-10T14:18:44.275Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Elastic-Agent-Mac-OS-X
[2020-08-10T14:18:44.356Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Elastic-Agent-x-pack
[2020-08-10T14:18:44.435Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Auditbeat-oss-Mac-OS-X
[2020-08-10T14:18:44.515Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Auditbeat-x-pack-Mac-OS-X
[2020-08-10T14:18:44.594Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Winlogbeat-oss
[2020-08-10T14:18:44.671Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Dockerlogbeat
[2020-08-10T14:18:44.759Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Auditbeat-crosscompile
[2020-08-10T14:18:44.836Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Journalbeat-oss
[2020-08-10T14:18:44.915Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Filebeat-x-pack-Mac-OS-X
[2020-08-10T14:18:44.994Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Functionbeat-x-pack
[2020-08-10T14:18:45.071Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Generators-Metricbeat-Linux
[2020-08-10T14:18:45.149Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Filebeat-Mac-OS-X
[2020-08-10T14:18:45.226Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Elastic-Agent-x-pack-Windows
[2020-08-10T14:18:45.307Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Metricbeat-Mac-OS-X
[2020-08-10T14:18:45.384Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Packetbeat-Linux
[2020-08-10T14:18:45.460Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Metricbeat-x-pack-Mac-OS-X
[2020-08-10T14:18:45.539Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Metricbeat-OSS-Unit-tests
[2020-08-10T14:18:45.617Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Heartbeat-oss
[2020-08-10T14:18:45.694Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Auditbeat-oss-Windows
[2020-08-10T14:18:45.773Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Auditbeat-x-pack
[2020-08-10T14:18:45.851Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Auditbeat-x-pack-Windows
[2020-08-10T14:18:45.929Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Winlogbeat-Windows-x-pack
[2020-08-10T14:18:46.007Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Functionbeat-Mac-OS-X-x-pack
[2020-08-10T14:18:46.086Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Auditbeat-oss-Linux
[2020-08-10T14:18:46.164Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Metricbeat-crosscompile
[2020-08-10T14:18:46.241Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Filebeat-x-pack-Windows
[2020-08-10T14:18:46.321Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Heartbeat-Mac-OS-X
[2020-08-10T14:18:46.397Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Packetbeat-Mac-OS-X
[2020-08-10T14:18:46.476Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Filebeat-Windows
[2020-08-10T14:18:46.555Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Metricbeat-Windows
[2020-08-10T14:18:46.635Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Winlogbeat-Windows
[2020-08-10T14:18:46.719Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Metricbeat-x-pack-Windows
[2020-08-10T14:18:46.795Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Heartbeat-Windows
[2020-08-10T14:18:46.871Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Generators-Beat-Linux
[2020-08-10T14:18:46.948Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Functionbeat-Windows
[2020-08-10T14:18:47.025Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Filebeat-oss
[2020-08-10T14:18:47.101Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Filebeat-x-pack
[2020-08-10T14:18:47.179Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Libbeat-oss
[2020-08-10T14:18:47.263Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Packetbeat-Windows
[2020-08-10T14:18:47.340Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Libbeat-crosscompile
[2020-08-10T14:18:47.421Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Libbeat-stress-tests
[2020-08-10T14:18:47.499Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Metricbeat-OSS-Go-Integration-tests
[2020-08-10T14:18:47.580Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Generators-Metricbeat-Mac-OS-X
[2020-08-10T14:18:47.657Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Metricbeat-OSS-Python-Integration-tests
[2020-08-10T14:18:47.734Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Metricbeat-x-pack
[2020-08-10T14:18:47.818Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Generators-Beat-Mac-OS-X
[2020-08-10T14:18:47.897Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Libbeat-x-pack
[2020-08-10T14:18:48.261Z] + cat
[2020-08-10T14:18:48.261Z] + /usr/local/bin/runbld ./runbld-script
[2020-08-10T14:18:48.261Z] Picked up JAVA_TOOL_OPTIONS: -Dfile.encoding=UTF8
[2020-08-10T14:18:56.409Z] runbld>>> runbld started
[2020-08-10T14:18:56.409Z] runbld>>> 1.6.12/f45d832f2ba0aa2722ab4ec1fda8ad140f027f8b
[2020-08-10T14:18:57.792Z] runbld>>> The following profiles matched the job 'Beats/beats/PR-20507' in order of occurrence in the config (last value wins).
[2020-08-10T14:18:59.173Z] runbld>>> Debug logging enabled.
[2020-08-10T14:18:59.173Z] runbld>>> Storing result
[2020-08-10T14:18:59.434Z] runbld>>> Store result: created {:total 2, :successful 2, :failed 0} 1
[2020-08-10T14:18:59.434Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1587637540455/t/20200810141859-80D9F51E
[2020-08-10T14:18:59.434Z] runbld>>> Adding system facts.
[2020-08-10T14:19:00.833Z] runbld>>> Adding vcs info for the latest commit:  f59c0f9085458f481e2abb5cf29817f366b4a8dc
[2020-08-10T14:19:00.833Z] runbld>>> >>>>>>>>>>>> SCRIPT EXECUTION BEGIN >>>>>>>>>>>>
[2020-08-10T14:19:00.833Z] runbld>>> Adding /usr/lib/jvm/java-8-openjdk-amd64/bin to the path.
[2020-08-10T14:19:00.833Z] Processing JUnit reports with runbld...
[2020-08-10T14:19:00.833Z] + echo 'Processing JUnit reports with runbld...'
[2020-08-10T14:19:01.100Z] runbld>>> <<<<<<<<<<<< SCRIPT EXECUTION END <<<<<<<<<<<<
[2020-08-10T14:19:01.100Z] runbld>>> DURATION: 30ms
[2020-08-10T14:19:01.100Z] runbld>>> STDOUT: 40 bytes
[2020-08-10T14:19:01.100Z] runbld>>> STDERR: 49 bytes
[2020-08-10T14:19:01.100Z] runbld>>> WRAPPED PROCESS: SUCCESS (0)
[2020-08-10T14:19:01.100Z] runbld>>> Searching for build metadata in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats
[2020-08-10T14:19:02.043Z] runbld>>> Storing build metadata: 
[2020-08-10T14:19:02.043Z] runbld>>> Adding test report.
[2020-08-10T14:19:02.043Z] runbld>>> Searching for junit test output files with the pattern: TEST-.*\.xml$ in: /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats
[2020-08-10T14:19:02.986Z] runbld>>> Found 135 test output files
[2020-08-10T14:19:04.370Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Metricbeat-x-pack/x-pack/metricbeat/build/TEST-go-integration-openmetrics.xml
[2020-08-10T14:19:04.370Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Metricbeat-x-pack/x-pack/metricbeat/build/TEST-go-integration-iis.xml
[2020-08-10T14:19:04.370Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Metricbeat-x-pack/x-pack/metricbeat/build/TEST-go-integration-istio.xml
[2020-08-10T14:19:04.370Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Metricbeat-x-pack/x-pack/metricbeat/build/TEST-go-integration-tomcat.xml
[2020-08-10T14:19:04.370Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Metricbeat-x-pack/x-pack/metricbeat/build/TEST-go-integration-activemq.xml
[2020-08-10T14:19:04.370Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Metricbeat-OSS-Go-Integration-tests/metricbeat/build/TEST-go-integration-graphite.xml
[2020-08-10T14:19:04.370Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Metricbeat-OSS-Go-Integration-tests/metricbeat/build/TEST-go-integration-windows.xml
[2020-08-10T14:19:06.282Z] runbld>>> Test output logs contained: Errors: 0 Failures: 0 Tests: 19458 Skipped: 1658
[2020-08-10T14:19:06.543Z] runbld>>> Storing result
[2020-08-10T14:19:06.543Z] runbld>>> FAILURES: 0
[2020-08-10T14:19:06.543Z] runbld>>> Store result: updated {:total 2, :successful 2, :failed 0} 2
[2020-08-10T14:19:06.543Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1587637540455/t/20200810141859-80D9F51E
[2020-08-10T14:19:06.804Z] runbld>>> Email notification disabled by environment variable.
[2020-08-10T14:19:06.804Z] runbld>>> Slack notification disabled by environment variable.
[2020-08-10T14:19:12.317Z] Running on Jenkins in /var/lib/jenkins/workspace/Beats_beats_PR-20507
[2020-08-10T14:19:12.421Z] [INFO] getVaultSecret: Getting secrets
[2020-08-10T14:19:12.506Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2020-08-10T14:19:13.283Z] + chmod 755 generate-build-data.sh
[2020-08-10T14:19:13.283Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-20507/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-20507/runs/5 ABORTED 7342716
[2020-08-10T14:19:13.283Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-20507/runs/5/steps/?limit=10000 -o steps-info.json
[2020-08-10T14:19:15.766Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-20507/runs/5/tests/?status=FAILED -o tests-errors.json

@jsoriano jsoriano added the needs_backport PR is waiting to be backported to other branches. label Aug 10, 2020
@jsoriano
Copy link
Copy Markdown
Member Author

Failing test is fixed in master, merging.

@jsoriano jsoriano merged commit 8593c85 into elastic:master Aug 10, 2020
@jsoriano jsoriano deleted the fix-versions-requirements-3-9 branch August 10, 2020 15:29
@jsoriano
Copy link
Copy Markdown
Member Author

Will apply the changes in 7.x branch on the backport PR for pytest #20478

@jsoriano jsoriano removed the needs_backport PR is waiting to be backported to other branches. label Aug 10, 2020
melchiormoulin pushed a commit to melchiormoulin/beats that referenced this pull request Oct 14, 2020
Packages listed in current requirements.txt file cannot be installed in
python 3.5 and 3.9:
* Pillow doesn't have a candidate for 3.9, it was already removed
  in elastic#20407, but added again by mistake in elastic#16883.
* zipp package needed by pytest works with different versions depending
  on the version of python, version that works with python 3.5 doesn't work
  with other versions.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bug review Team:Integrations Label for the Integrations team :Testing

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants