[7.17](backport #2454) docs: refactor docs to enable the local development by mergify[bot] · Pull Request #2480 · elastic/e2e-testing

mergify · 2022-05-05T13:39:27Z

This is an automatic backport of pull request #2454 done by Mergify.
Cherry-pick of 0995a83 has failed:

On branch mergify/bp/7.17/pr-2454
Your branch is up to date with 'origin/7.17'.

You are currently cherry-picking commit 0995a834.
  (fix conflicts and run "git cherry-pick --continue")
  (use "git cherry-pick --skip" to skip this patch)
  (use "git cherry-pick --abort" to cancel the cherry-pick operation)

Changes to be committed:
	modified:   .ci/.e2e-tests-for-elastic-agent.yaml
	modified:   .ci/.e2e-tests.yaml
	modified:   .ci/Jenkinsfile
	new file:   .ci/Makefile
	modified:   .ci/README.md
	modified:   .ci/ansible/playbook.yml
	modified:   .ci/ansible/tasks/runners.yml
	modified:   .ci/ansible/tasks/setup_test_script.yml
	modified:   .gitignore
	modified:   e2e/TROUBLESHOOTING.md
	modified:   e2e/_suites/fleet/README.md

Unmerged paths:
  (use "git add <file>..." to mark resolution)
	both modified:   e2e/_suites/fleet/fleet.go

To fix up this pull request, you can check it out locally. See documentation: https://docs.github.com/en/github/collaborating-with-pull-requests/reviewing-changes-in-pull-requests/checking-out-pull-requests-locally

Mergify commands and options

More conditions and actions can be found in the documentation.

You can also trigger Mergify actions by commenting on this pull request:

@Mergifyio refresh will re-evaluate the rules
@Mergifyio rebase will rebase this PR on its base branch
@Mergifyio update will merge the base branch into this PR
@Mergifyio backport <destination> will backport this PR on <destination> branch

Additionally, on Mergify dashboard you can:

look at your merge queues
generate the Mergify configuration with the config editor.

Finally, you can contact us on https://mergify.com

* docs: update stack creation * fix: add default value for gitSha * docs: nodeUser too * chore: always use .venv * docs: make snippets copiable * docs: do not hardcode path to repo, use current dir * chore: add nodeUser to test nodes * chore: update nodeLabel to debian AMD * chore: consistency provisioning node tags * chore: use current dir for workspace * fix: check that suite is defined * chore: automate the creation of cloud VMs * chore: add runID as a tag in the VMs * chore: make exporting variables explicit * chore: reference the sshhosts files to get the IP addresses * fix: remove variable name from runID file * chore: store IP addresses in file They will be used in the automation to locate the stack and node * chore: support configuring the suite * chore: support destroying the stack and nodes * chore: remove node files * chore: remove wait for strategy on fleet-server * chore: command to recreate the stack * chore: simplify creation of the nodes in one single command * chore: support running the tests remotely * chore: pass TAGS as a variable * chore: configure tags for running the tests * docs: document how to run the tests in the VMs * chore: add goals to SSH into the machines * chore: add a command to destroy the stack * fix: typo * fix: conflicts in goal name * docs: document how to recreate the stack * docs: refactor docs * fix: pass bootstrap tag to the stack creation * fix: set the tags in the ansible code * fix: pass bootstrap tag to the stack creation * chore: apply suggestions from code review Co-authored-by: Anderson Queiroz <me@andersonq.me> Co-authored-by: Mike Place <mike.place@elastic.co> * fix: use proper hidden file name * docs: explain how to locate the feature files and tags * chore: check for runID where needed * chore: adds commands to inspect the nodes * fix: proper goal name * fix: lookup env This will allow setting the agent version in lower ones: ELASTIC_AGENT_VERSION=8.1.3-SNAPSHOT make -C .ci create-node * fix: close double quote * fix: goal name was incorrect * fix: bootstrap elastic stack properly * docs: reference to the environment variables affecting the build * chore: support configuring the remote It will allow to run those scenarios that do not need a remote stack, such as dockerised ones See apm-server feature file * chore: use the stack VM to enroll the stand-alone agent Co-authored-by: Anderson Queiroz <me@andersonq.me> Co-authored-by: Mike Place <mike.place@elastic.co> (cherry picked from commit 0995a83) # Conflicts: # e2e/_suites/fleet/fleet.go

elasticmachine · 2022-05-05T13:42:59Z

💔 Tests Failed

the below badges are clickable and redirect to their specific view in the CI or DOCS

Expand to view the summary

Build stats

Start Time: 2022-05-05T13:41:09.208+0000
Duration: 83 min 23 sec

Test stats 🧪

Test	Results
Failed	1
Passed	309
Skipped	0
Total	310

Test errors

Expand to view the tests failures

`Initializing / End-To-End Tests / fleet_debian_arm64_system_integration / Adding diskio system/metrics Integration to a Policy – System Integration`

Expand to view the error details

 Step "system/metrics" with "diskio" metrics are present in the datastreams

no stacktrace

Steps errors

Expand to view the steps failures

Show only the first 10 steps failures

`Executing ansible-playbook`

Took 1 min 10 sec . View more details here
Description: /var/lib/jenkins/workspace/PR-2480-2-375d4dcb-342a-4a8b-8042-024614af27d2/.venv/bin/ansible-playbook --private-key="/var/lib/jenkins/workspace/PR-2480-2-375d4dcb-342a-4a8b-8042-024614af27d2/e2essh" --extra-vars="workspace=/var/lib/jenkins/workspace/PR-2480-2-375d4dcb-342a-4a8b-8042-024614af27d2/ runId=c433ad7e sshPublicKey=/var/lib/jenkins/workspace/PR-2480-2-375d4dcb-342a-4a8b-8042-024614af27d2/e2essh.pub" --ssh-common-args='-o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null' /var/lib/jenkins/workspace/PR-2480-2-375d4dcb-342a-4a8b-8042-024614af27d2/.ci/ansible/playbook.yml -i "13.59.161.101," -t setup-node --extra-vars="buildURL=https://beats-ci.elastic.co/job/e2e-tests/job/e2e-testing-mbp/job/PR-2480/2/ gitSha=7ed515f36be651fd6a93bc7d9fc45f5dd7e604a4 build=2 repo=e2e-testing branch=pr-2480 type=ci stackRunner=18.220.169.102 nodeUser=admin suite=helm nodeLabel=debian_amd64 nodeImage=ami-0d90bed76900e679a nodeInstanceType=c5.4xlarge"

`Sleep`

Took 0 min 5 sec . View more details here
Description: 5

`Executing ansible-playbook`

Took 0 min 27 sec . View more details here
Description: /var/lib/jenkins/workspace/PR-2480-2-375d4dcb-342a-4a8b-8042-024614af27d2/.venv/bin/ansible-playbook --private-key="/var/lib/jenkins/workspace/PR-2480-2-375d4dcb-342a-4a8b-8042-024614af27d2/e2essh" --extra-vars="workspace=/var/lib/jenkins/workspace/PR-2480-2-375d4dcb-342a-4a8b-8042-024614af27d2/ runId=c433ad7e sshPublicKey=/var/lib/jenkins/workspace/PR-2480-2-375d4dcb-342a-4a8b-8042-024614af27d2/e2essh.pub" --ssh-common-args='-o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null' /var/lib/jenkins/workspace/PR-2480-2-375d4dcb-342a-4a8b-8042-024614af27d2/.ci/ansible/playbook.yml -i "13.59.161.101," -t setup-node --extra-vars="buildURL=https://beats-ci.elastic.co/job/e2e-tests/job/e2e-testing-mbp/job/PR-2480/2/ gitSha=7ed515f36be651fd6a93bc7d9fc45f5dd7e604a4 build=2 repo=e2e-testing branch=pr-2480 type=ci stackRunner=18.220.169.102 nodeUser=admin suite=helm nodeLabel=debian_amd64 nodeImage=ami-0d90bed76900e679a nodeInstanceType=c5.4xlarge"

`Sleep`

Took 0 min 10 sec . View more details here
Description: 10

`Executing ansible-playbook`

Took 0 min 27 sec . View more details here
Description: /var/lib/jenkins/workspace/PR-2480-2-375d4dcb-342a-4a8b-8042-024614af27d2/.venv/bin/ansible-playbook --private-key="/var/lib/jenkins/workspace/PR-2480-2-375d4dcb-342a-4a8b-8042-024614af27d2/e2essh" --extra-vars="workspace=/var/lib/jenkins/workspace/PR-2480-2-375d4dcb-342a-4a8b-8042-024614af27d2/ runId=c433ad7e sshPublicKey=/var/lib/jenkins/workspace/PR-2480-2-375d4dcb-342a-4a8b-8042-024614af27d2/e2essh.pub" --ssh-common-args='-o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null' /var/lib/jenkins/workspace/PR-2480-2-375d4dcb-342a-4a8b-8042-024614af27d2/.ci/ansible/playbook.yml -i "13.59.161.101," -t setup-node --extra-vars="buildURL=https://beats-ci.elastic.co/job/e2e-tests/job/e2e-testing-mbp/job/PR-2480/2/ gitSha=7ed515f36be651fd6a93bc7d9fc45f5dd7e604a4 build=2 repo=e2e-testing branch=pr-2480 type=ci stackRunner=18.220.169.102 nodeUser=admin suite=helm nodeLabel=debian_amd64 nodeImage=ami-0d90bed76900e679a nodeInstanceType=c5.4xlarge"

`Sleep`

Took 0 min 16 sec . View more details here
Description: 15

`Shell Script`

Took 0 min 1 sec . View more details here
Description: ssh -tt -o TCPKeepAlive=yes -o ServerAliveInterval=60 -o ServerAliveCountMax=10 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -i /var/lib/jenkins/workspace/PR-2480-2-375d4dcb-342a-4a8b-8042-024614af27d2/e2essh admin@13.59.161.101 -- 'sudo chown admin -R /home/admin/e2e-testing/outputs '

`Shell Script`

Took 25 min 40 sec . View more details here
Description: ssh -tt -o TCPKeepAlive=yes -o ServerAliveInterval=60 -o ServerAliveCountMax=10 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -i /var/lib/jenkins/workspace/PR-2480-2-914fbcdb-92d6-4650-8cdb-fdd389c487ef/e2essh admin@3.144.210.102 -- 'sudo bash /home/admin/e2e-testing/.ci/scripts/functional-test.sh'

`Archive the artifacts`

Took 0 min 1 sec . View more details here
Description: [2022-05-05T14:56:12.018Z] Archiving artifacts script returned exit code 2

`Error signal`

Took 0 min 0 sec . View more details here
Description: githubApiCall: The REST API call https://api.github.com/orgs/elastic/members/mergify[bot] return the message : java.lang.Exception: httpRequest: Failure connecting to the service https://api.github.com/orgs/elastic/members/mergify[bot] : httpRequest: Failure connecting to the service https://api.github.com/orgs/elastic/members/mergify[bot] : Code: 404Error: {"message":"User does not exist or is not a member of the organization","documentation_url":"https://docs.github.com/rest/reference/orgs#check-organization-membership-for-a-user"}

🐛 Flaky test report

❕ There are test failures but not known flaky tests.

Expand to view the summary

Genuine test errors

💔 There are test failures but not known flaky tests, most likely a genuine test failure.

Name: Initializing / End-To-End Tests / fleet_debian_arm64_system_integration / Adding diskio system/metrics Integration to a Policy – System Integration

🤖 GitHub comments

To re-run your PR in the CI, just comment with:

/test : Re-trigger the build.

mergify bot added the conflicts There is a conflict in the backported pull request label May 5, 2022

mergify bot assigned mdelapenya May 5, 2022

fix: resolve conflicts

7ed515f

mdelapenya removed the conflicts There is a conflict in the backported pull request label May 5, 2022

mdelapenya merged commit d416de9 into 7.17 May 5, 2022

mergify bot deleted the mergify/bp/7.17/pr-2454 branch May 5, 2022 15:18

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[7.17](backport #2454) docs: refactor docs to enable the local development#2480

[7.17](backport #2454) docs: refactor docs to enable the local development#2480
mdelapenya merged 2 commits into7.17from
mergify/bp/7.17/pr-2454

mergify bot commented May 5, 2022

Uh oh!

elasticmachine commented May 5, 2022 •

edited

Loading

Build stats

Test stats 🧪

`Initializing / End-To-End Tests / fleet_debian_arm64_system_integration / Adding diskio system/metrics Integration to a Policy – System Integration`

`Executing ansible-playbook`

`Sleep`

`Executing ansible-playbook`

`Sleep`

`Executing ansible-playbook`

`Sleep`

`Shell Script`

`Shell Script`

`Archive the artifacts`

`Error signal`

Genuine test errors

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Conversation

mergify bot commented May 5, 2022

Uh oh!

elasticmachine commented May 5, 2022 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

💔 Tests Failed

Build stats

Test stats 🧪

Test errors

Initializing / End-To-End Tests / fleet_debian_arm64_system_integration / Adding diskio system/metrics Integration to a Policy – System Integration

Steps errors

Executing ansible-playbook

Sleep

Executing ansible-playbook

Sleep

Executing ansible-playbook

Sleep

Shell Script

Shell Script

Archive the artifacts

Error signal

🐛 Flaky test report

Genuine test errors

🤖 GitHub comments

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

elasticmachine commented May 5, 2022 •

edited

Loading

`Initializing / End-To-End Tests / fleet_debian_arm64_system_integration / Adding diskio system/metrics Integration to a Policy – System Integration`

`Executing ansible-playbook`

`Sleep`

`Executing ansible-playbook`

`Sleep`

`Executing ansible-playbook`

`Sleep`

`Shell Script`

`Shell Script`

`Archive the artifacts`

`Error signal`