Skip to content
This repository was archived by the owner on Sep 17, 2024. It is now read-only.

fix: Upgrade pip on setup-env for CentOS#3048

Merged
pazone merged 10 commits intoelastic:mainfrom
pazone:fix/ansible-setuptools-rust
Sep 28, 2022
Merged

fix: Upgrade pip on setup-env for CentOS#3048
pazone merged 10 commits intoelastic:mainfrom
pazone:fix/ansible-setuptools-rust

Conversation

@pazone
Copy link
Copy Markdown

@pazone pazone commented Sep 27, 2022

What does this PR do?

added pip upgrade task centOS

Related issues

@mergify
Copy link
Copy Markdown
Contributor

mergify bot commented Sep 27, 2022

This pull request does not have a backport label. Could you fix it @pazone? 🙏
To fixup this pull request, you need to add the backport labels for the needed
branches, such as:

  • backport-v./d./d./d is the label to automatically backport to the 7./d branch. /d is the digit
    NOTE: backport-skip has been added to this pull request.

@mergify mergify bot added the backport-skip Skip notification from the automated backport with mergify label Sep 27, 2022
@elasticmachine
Copy link
Copy Markdown
Contributor

elasticmachine commented Sep 27, 2022

❕ Build Aborted

There is a new build on-going so the previous on-going builds have been aborted.

the below badges are clickable and redirect to their specific view in the CI or DOCS
Pipeline View Test View Changes Artifacts preview

Expand to view the summary

Build stats

  • Start Time: 2022-09-28T14:35:06.872+0000

  • Duration: 15 min 31 sec

Test stats 🧪

Test Results
Failed 0
Passed 181
Skipped 0
Total 181

🤖 GitHub comments

Expand to view the GitHub comments

To re-run your PR in the CI, just comment with:

  • /test : Re-trigger the build.

@kuisathaverat
Copy link
Copy Markdown
Contributor

The rust-extension is missing in the Ansible node configuration of Python, no in the host Python configuration

[2022-09-28T10:48:20.187Z] TASK [geerlingguy.docker_arm : Install Docker Compose using Pip.] **************

[2022-09-28T10:48:30.620Z] fatal: [18.222.128.132]: FAILED! => {"changed": false, "cmd": ["/bin/pip3", "install", "docker-compose"], "msg": "stdout: Collecting docker-compose\n  Using cached [https://files.pythonhosted.org/packages/f3/3e/ca05e486d44e38eb495ca60b8ca526b192071717387346ed1031ecf78966/docker_compose-1.29.2-py2.py3-none-any.whl\nRequirement](https://files.pythonhosted.org/packages/f3/3e/ca05e486d44e38eb495ca60b8ca526b192071717387346ed1031ecf78966/docker_compose-1.29.2-py2.py3-none-any.whl/nRequirement) already satisfied: requests<3,>=2.20.0 in /usr/lib/python3.6/site-packages (from docker-compose)\nRequirement already satisfied: distro<2,>=1.5.0 in /usr/local/lib/python3.6/site-packages (from docker-compose)\nCollecting python-dotenv<1,>=0.13.0 (from docker-compose)\n  Using cached [https://files.pythonhosted.org/packages/30/5f/2e5c564bd86349fe6b82ca840f46acf6f4bb76d79ba9057fce3d3e008864/python_dotenv-0.20.0-py3-none-any.whl\nCollecting](https://files.pythonhosted.org/packages/30/5f/2e5c564bd86349fe6b82ca840f46acf6f4bb76d79ba9057fce3d3e008864/python_dotenv-0.20.0-py3-none-any.whl/nCollecting) docopt<1,>=0.6.1 (from docker-compose)\n  Using cached [https://files.pythonhosted.org/packages/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz\nCollecting](https://files.pythonhosted.org/packages/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz/nCollecting) texttable<2,>=0.9.0 (from docker-compose)\n  Using cached [https://files.pythonhosted.org/packages/75/23/8170868d04b153b1b9ed1bb84348212bb4a08f31b292ef9d7f6ea648fd49/texttable-1.6.4-py2.py3-none-any.whl\nCollecting](https://files.pythonhosted.org/packages/75/23/8170868d04b153b1b9ed1bb84348212bb4a08f31b292ef9d7f6ea648fd49/texttable-1.6.4-py2.py3-none-any.whl/nCollecting) dockerpty<1,>=0.4.1 (from docker-compose)\n  Using cached [https://files.pythonhosted.org/packages/8d/ee/e9ecce4c32204a6738e0a5d5883d3413794d7498fe8b06f44becc028d3ba/dockerpty-0.4.1.tar.gz\nCollecting](https://files.pythonhosted.org/packages/8d/ee/e9ecce4c32204a6738e0a5d5883d3413794d7498fe8b06f44becc028d3ba/dockerpty-0.4.1.tar.gz/nCollecting) cached-property<2,>=1.2.0; python_version < \"3.8\" (from docker-compose)\n  Using cached [https://files.pythonhosted.org/packages/48/19/f2090f7dad41e225c7f2326e4cfe6fff49e57dedb5b53636c9551f86b069/cached_property-1.5.2-py2.py3-none-any.whl\nCollecting](https://files.pythonhosted.org/packages/48/19/f2090f7dad41e225c7f2326e4cfe6fff49e57dedb5b53636c9551f86b069/cached_property-1.5.2-py2.py3-none-any.whl/nCollecting) docker[ssh]>=5 (from docker-compose)\n  Using cached [https://files.pythonhosted.org/packages/54/f3/7af47ead249fbb798d64a0438bad5c26f17ef6ac5cd324d802038eb10d90/docker-5.0.3-py2.py3-none-any.whl\nRequirement](https://files.pythonhosted.org/packages/54/f3/7af47ead249fbb798d64a0438bad5c26f17ef6ac5cd324d802038eb10d90/docker-5.0.3-py2.py3-none-any.whl/nRequirement) already satisfied: PyYAML<6,>=3.10 in /usr/lib64/python3.6/site-packages (from docker-compose)\nRequirement already satisfied: jsonschema<4,>=2.5.1 in /usr/lib/python3.6/site-packages (from docker-compose)\nCollecting websocket-client<1,>=0.32.0 (from docker-compose)\n  Using cached [https://files.pythonhosted.org/packages/f7/0c/d52a2a63512a613817846d430d16a8fbe5ea56dd889e89c68facf6b91cb6/websocket_client-0.59.0-py2.py3-none-any.whl\nRequirement](https://files.pythonhosted.org/packages/f7/0c/d52a2a63512a613817846d430d16a8fbe5ea56dd889e89c68facf6b91cb6/websocket_client-0.59.0-py2.py3-none-any.whl/nRequirement) already satisfied: chardet<3.1.0,>=3.0.2 in /usr/lib/python3.6/site-packages (from requests<3,>=2.20.0->docker-compose)\nRequirement already satisfied: idna<2.8,>=2.5 in /usr/lib/python3.6/site-packages (from requests<3,>=2.20.0->docker-compose)\nRequirement already satisfied: urllib3<1.25,>=1.21.1 in /usr/lib/python3.6/site-packages (from requests<3,>=2.20.0->docker-compose)\nRequirement already satisfied: six>=1.3.0 in /usr/lib/python3.6/site-packages (from dockerpty<1,>=0.4.1->docker-compose)\nCollecting paramiko>=2.4.2; extra == \"ssh\" (from docker[ssh]>=5->docker-compose)\n  Using cached [https://files.pythonhosted.org/packages/04/e5/39ec73dd4a8769d6759b8d6c60a1b2c9337f585407c2ae8bfb8ccb734278/paramiko-2.11.0-py2.py3-none-any.whl\nRequirement](https://files.pythonhosted.org/packages/04/e5/39ec73dd4a8769d6759b8d6c60a1b2c9337f585407c2ae8bfb8ccb734278/paramiko-2.11.0-py2.py3-none-any.whl/nRequirement) already satisfied: cryptography>=2.5 in /usr/lib64/python3.6/site-packages (from paramiko>=2.4.2; extra == \"ssh\"->docker[ssh]>=5->docker-compose)\nCollecting pynacl>=1.0.1 (from paramiko>=2.4.2; extra == \"ssh\"->docker[ssh]>=5->docker-compose)\n  Downloading https://files.pythonhosted.org/packages/a7/22/27582568be639dfe22ddb3902225f91f2f17ceff88ce80e4db396c8986da/PyNaCl-1.5.0.tar.gz (3.4MB)\nCollecting bcrypt>=3.1.3 (from paramiko>=2.4.2; extra == \"ssh\"->docker[ssh]>=5->docker-compose)\n  Using cached [https://files.pythonhosted.org/packages/99/f2/b71b9b5b2400fffac7d42c560ac89f302c4d8e328337b2f05f0a4d9e590d/bcrypt-4.0.0.tar.gz\n](https://files.pythonhosted.org/packages/99/f2/b71b9b5b2400fffac7d42c560ac89f302c4d8e328337b2f05f0a4d9e590d/bcrypt-4.0.0.tar.gz/n)    Complete output from command python setup.py egg_info:\n    \n            =============================DEBUG ASSISTANCE==========================\n            If you are seeing an error here please try the following to\n            successfully install cryptography:\n    \n            Upgrade to the latest pip and try again. This will fix errors for most\n            users. See: https://pip.pypa.io/en/stable/installing/#upgrading-pip\n            =============================DEBUG ASSISTANCE==========================\n    \n    Traceback (most recent call last):\n      File \"<string>\", line 1, in <module>\n      File \"/tmp/pip-build-wqfpvt7a/bcrypt/setup.py\", line 11, in <module>\n        from setuptools_rust import RustExtension\n    ModuleNotFoundError: No module named 'setuptools_rust'\n    \n    ----------------------------------------\n\n:stderr: WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\nCommand \"python setup.py egg_info\" failed with error code 1 in /tmp/pip-build-wqfpvt7a/bcrypt/\n"}

@kuisathaverat
Copy link
Copy Markdown
Contributor

kuisathaverat commented Sep 28, 2022

it fails in a Role imported https://github.com/geerlingguy/ansible-role-docker_arm

https://github.com/elastic/e2e-testing/blob/main/.ci/ansible/playbook.yml#L124-L131

    - role: geerlingguy.docker_arm
      become: True
      docker_daemon_options:
        default-ulimit: ["nofile=1024000:1024000"]
      docker_users:
        - "{{ ansible_user }}"
      when:
        - '"arm64" in nodeLabel'

there is an open issue that looks similar geerlingguy/ansible-role-docker_arm#37

@pazone pazone merged commit 9c4c374 into elastic:main Sep 28, 2022
@pazone pazone added backport-v8.3.0 Automated backport with mergify backport-v8.1.0 Automated backport with mergify backport-v8.2.0 Automated backport with mergify backport-v8.4.0 Automated backport with mergify backport-v8.5.0 Automated backport with mergify labels Sep 28, 2022
mergify bot pushed a commit that referenced this pull request Sep 28, 2022
* fix: added setuptools-rust to requiremets.txt

* Added pip taks to install setuptools-rust before docer is installed

* Added venv activation to setup-node target

* fixed venv activation

* test: Added upgrade pip task, use geerlingguy.docker because of deprecation

* Added Debian and Ubutu for pip upgrade

* Left only pip upgrade

* Removed venv activation

* Returned vent activation

(cherry picked from commit 9c4c374)
mergify bot pushed a commit that referenced this pull request Sep 28, 2022
* fix: added setuptools-rust to requiremets.txt

* Added pip taks to install setuptools-rust before docer is installed

* Added venv activation to setup-node target

* fixed venv activation

* test: Added upgrade pip task, use geerlingguy.docker because of deprecation

* Added Debian and Ubutu for pip upgrade

* Left only pip upgrade

* Removed venv activation

* Returned vent activation

(cherry picked from commit 9c4c374)
@mergify mergify bot removed the backport-skip Skip notification from the automated backport with mergify label Sep 28, 2022
@pazone pazone changed the title fix: added setuptools-rust to requiremets.txt fix: Upgrade pip on setup-env for CentOS Sep 28, 2022
@elasticmachine
Copy link
Copy Markdown
Contributor

💔 Tests Failed

the below badges are clickable and redirect to their specific view in the CI or DOCS
Pipeline View Test View Changes Artifacts preview preview

Expand to view the summary

Build stats

  • Start Time: 2022-09-28T14:47:45.674+0000

  • Duration: 64 min 24 sec

Test stats 🧪

Test Results
Failed 12
Passed 407
Skipped 0
Total 419

Test errors 12

Expand to view the tests failures

> Show only the first 10 test failures

Initializing / End-To-End Tests / fleet_sles15_backend_processes / Removing Endpoint from Agent policy stops the connected Endpoint – Backend Processes
    Expand to view the error details

     Step the "elastic-endpoint" process is in the "stopped" state on the host 
    

  • no stacktrace
Initializing / End-To-End Tests / fleet_debian_10_amd64_backend_processes / Removing Endpoint from Agent policy stops the connected Endpoint – Backend Processes
    Expand to view the error details

     Step the "elastic-endpoint" process is in the "stopped" state on the host 
    

  • no stacktrace
Initializing / End-To-End Tests / fleet_debian_10_arm64_backend_processes / Removing Endpoint from Agent policy stops the connected Endpoint – Backend Processes
    Expand to view the error details

     Step the "elastic-endpoint" process is in the "stopped" state on the host 
    

  • no stacktrace
Initializing / End-To-End Tests / fleet_ubuntu_22_04_amd64_backend_processes / Removing Endpoint from Agent policy stops the connected Endpoint – Backend Processes
    Expand to view the error details

     Step the "elastic-endpoint" process is in the "stopped" state on the host 
    

  • no stacktrace
Initializing / End-To-End Tests / fleet_debian_11_amd64_backend_processes / Removing Endpoint from Agent policy stops the connected Endpoint – Backend Processes
    Expand to view the error details

     Step the "elastic-endpoint" process is in the "stopped" state on the host 
    

  • no stacktrace
Initializing / End-To-End Tests / fleet_debian_10_arm64_fleet_mode / Restarting the installed agent – Fleet Mode
    Expand to view the error details

     Step the "elastic-agent" process is "restarted" on the host 
    

  • no stacktrace
Initializing / End-To-End Tests / fleet_debian_10_amd64_stand_alone_mode / Deploying a default stand-alone agent – Stand-alone Mode
    Expand to view the error details

     Step there is new data in the index from agent: not enough hits in the logs-elastic_agent-default index yet. Current: 0, Desired: 20 
    

  • no stacktrace
Initializing / End-To-End Tests / fleet_debian_10_arm64_stand_alone_mode / Deploying a default stand-alone agent – Stand-alone Mode
    Expand to view the error details

     Step there is new data in the index from agent: not enough hits in the logs-elastic_agent-default index yet. Current: 0, Desired: 20 
    

  • no stacktrace
Initializing / End-To-End Tests / fleet_debian_11_amd64_system_integration / Adding core system/metrics Integration to a Policy – System Integration
    Expand to view the error details

     Step "system/metrics" with "core" metrics are present in the datastreams 
    

  • no stacktrace
Initializing / End-To-End Tests / fleet_sles15_system_integration / Adding core system/metrics Integration to a Policy – System Integration
    Expand to view the error details

     Step "system/metrics" with "core" metrics are present in the datastreams 
    

  • no stacktrace

Steps errors 14

Expand to view the steps failures

Show only the first 10 steps failures

Run tests in the node
  • Took 22 min 24 sec . View more details here
  • Description: make -C .ci run-tests
Run tests in the node
  • Took 25 min 51 sec . View more details here
  • Description: make -C .ci run-tests
Run tests in the node
  • Took 21 min 29 sec . View more details here
  • Description: make -C .ci run-tests
Run tests in the node
  • Took 21 min 35 sec . View more details here
  • Description: make -C .ci run-tests
Run tests in the node
  • Took 11 min 41 sec . View more details here
  • Description: make -C .ci run-tests
Run tests in the node
  • Took 11 min 23 sec . View more details here
  • Description: make -C .ci run-tests
Configure node for testing
  • Took 0 min 20 sec . View more details here
  • Description: make -C .ci setup-node
Run tests in the node
  • Took 9 min 17 sec . View more details here
  • Description: make -C .ci run-tests
Run tests in the node
  • Took 15 min 53 sec . View more details here
  • Description: make -C .ci run-tests
Run tests in the node
  • Took 15 min 22 sec . View more details here
  • Description: make -C .ci run-tests

🐛 Flaky test report

❕ There are test failures but not known flaky tests.

Expand to view the summary

Genuine test errors 12

💔 There are test failures but not known flaky tests, most likely a genuine test failure.

  • Name: Initializing / End-To-End Tests / fleet_sles15_backend_processes / Removing Endpoint from Agent policy stops the connected Endpoint – Backend Processes
  • Name: Initializing / End-To-End Tests / fleet_debian_10_amd64_backend_processes / Removing Endpoint from Agent policy stops the connected Endpoint – Backend Processes
  • Name: Initializing / End-To-End Tests / fleet_debian_10_arm64_backend_processes / Removing Endpoint from Agent policy stops the connected Endpoint – Backend Processes
  • Name: Initializing / End-To-End Tests / fleet_ubuntu_22_04_amd64_backend_processes / Removing Endpoint from Agent policy stops the connected Endpoint – Backend Processes
  • Name: Initializing / End-To-End Tests / fleet_debian_11_amd64_backend_processes / Removing Endpoint from Agent policy stops the connected Endpoint – Backend Processes
  • Name: Initializing / End-To-End Tests / fleet_debian_10_arm64_fleet_mode / Restarting the installed agent – Fleet Mode
  • Name: Initializing / End-To-End Tests / fleet_debian_10_amd64_stand_alone_mode / Deploying a default stand-alone agent – Stand-alone Mode
  • Name: Initializing / End-To-End Tests / fleet_debian_10_arm64_stand_alone_mode / Deploying a default stand-alone agent – Stand-alone Mode
  • Name: Initializing / End-To-End Tests / fleet_debian_11_amd64_system_integration / Adding core system/metrics Integration to a Policy – System Integration
  • Name: Initializing / End-To-End Tests / fleet_sles15_system_integration / Adding core system/metrics Integration to a Policy – System Integration
  • Name: Initializing / End-To-End Tests / fleet_ubuntu_22_04_amd64_system_integration / Adding cpu system/metrics Integration to a Policy – System Integration
  • Name: Initializing / End-To-End Tests / fleet_debian_10_arm64_system_integration / Adding core system/metrics Integration to a Policy – System Integration

🤖 GitHub comments

Expand to view the GitHub comments

To re-run your PR in the CI, just comment with:

  • /test : Re-trigger the build.

@pazone pazone added the backport-v7.17.0 Automated backport with mergify label Oct 5, 2022
mergify bot pushed a commit that referenced this pull request Oct 5, 2022
* fix: added setuptools-rust to requiremets.txt

* Added pip taks to install setuptools-rust before docer is installed

* Added venv activation to setup-node target

* fixed venv activation

* test: Added upgrade pip task, use geerlingguy.docker because of deprecation

* Added Debian and Ubutu for pip upgrade

* Left only pip upgrade

* Removed venv activation

* Returned vent activation

(cherry picked from commit 9c4c374)
mergify bot pushed a commit that referenced this pull request Oct 5, 2022
* fix: added setuptools-rust to requiremets.txt

* Added pip taks to install setuptools-rust before docer is installed

* Added venv activation to setup-node target

* fixed venv activation

* test: Added upgrade pip task, use geerlingguy.docker because of deprecation

* Added Debian and Ubutu for pip upgrade

* Left only pip upgrade

* Removed venv activation

* Returned vent activation

(cherry picked from commit 9c4c374)
pazone pushed a commit that referenced this pull request Oct 5, 2022
* fix: added setuptools-rust to requiremets.txt

* Added pip taks to install setuptools-rust before docer is installed

* Added venv activation to setup-node target

* fixed venv activation

* test: Added upgrade pip task, use geerlingguy.docker because of deprecation

* Added Debian and Ubutu for pip upgrade

* Left only pip upgrade

* Removed venv activation

* Returned vent activation

(cherry picked from commit 9c4c374)

Co-authored-by: Pavel Zorin <pavel.zorin@elastic.co>
pazone pushed a commit that referenced this pull request Oct 5, 2022
* fix: added setuptools-rust to requiremets.txt

* Added pip taks to install setuptools-rust before docer is installed

* Added venv activation to setup-node target

* fixed venv activation

* test: Added upgrade pip task, use geerlingguy.docker because of deprecation

* Added Debian and Ubutu for pip upgrade

* Left only pip upgrade

* Removed venv activation

* Returned vent activation

(cherry picked from commit 9c4c374)

Co-authored-by: Pavel Zorin <pavel.zorin@elastic.co>
pazone pushed a commit that referenced this pull request Oct 6, 2022
* fix: added setuptools-rust to requiremets.txt

* Added pip taks to install setuptools-rust before docer is installed

* Added venv activation to setup-node target

* fixed venv activation

* test: Added upgrade pip task, use geerlingguy.docker because of deprecation

* Added Debian and Ubutu for pip upgrade

* Left only pip upgrade

* Removed venv activation

* Returned vent activation

(cherry picked from commit 9c4c374)

Co-authored-by: Pavel Zorin <pavel.zorin@elastic.co>
pazone pushed a commit that referenced this pull request Oct 6, 2022
* fix: added setuptools-rust to requiremets.txt

* Added pip taks to install setuptools-rust before docer is installed

* Added venv activation to setup-node target

* fixed venv activation

* test: Added upgrade pip task, use geerlingguy.docker because of deprecation

* Added Debian and Ubutu for pip upgrade

* Left only pip upgrade

* Removed venv activation

* Returned vent activation

(cherry picked from commit 9c4c374)

Co-authored-by: Pavel Zorin <pavel.zorin@elastic.co>
v1v added a commit to v1v/e2e-testing that referenced this pull request Oct 19, 2022
* upstream/main: (35 commits)
  bump stack version 8.6.0-6545f2df (elastic#3135)
  bump stack version 8.6.0-cae815eb (elastic#3130)
  bump stack version 8.6.0-54a302f0 (elastic#3125)
  bump stack version 8.6.0-233dc5d4 (elastic#3122)
  bump stack version 8.6.0-40086bc7 (elastic#3115)
  bump stack version 8.6.0-5a8d757d (elastic#3111)
  bump stack version 8.6.0-c49fac70 (elastic#3106)
  bump stack version 8.6.0-7c9f25a9 (elastic#3105)
  bump stack version 8.6.0-d939cfde (elastic#3096)
  bump stack version 8.6.0-0fca2953 (elastic#3081)
  Turn off all tests but Fleet mode and upgrade for Beats and Agent pipelines (elastic#3077)
  backport: Add 8.5 branch (elastic#3029)
  Only run Fleet mode and upgrade tests on 2 platforms (elastic#3054)
  fix: added setuptools-rust to requiremets.txt (elastic#3048)
  Added support for bulk api update change (elastic#3043)
  Making Changes for Docs for E2E setup (elastic#2929)
  Update ingest notifications channel (elastic#3023)
  chore: stringify http responses (elastic#2772)
  Adding support for v1.25.0 k8s (elastic#2975)
  Fix testcases for fleet api (elastic#2999)
  ...
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

backport-v7.17.0 Automated backport with mergify backport-v8.1.0 Automated backport with mergify backport-v8.2.0 Automated backport with mergify backport-v8.3.0 Automated backport with mergify backport-v8.4.0 Automated backport with mergify backport-v8.5.0 Automated backport with mergify

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants