Skip to content

Use travis_retry on PHPUnit for external-http tests#4298

Merged
westonruter merged 3 commits intodevelopfrom
4187-travis-retry-on-external-http-failures
Feb 15, 2020
Merged

Use travis_retry on PHPUnit for external-http tests#4298
westonruter merged 3 commits intodevelopfrom
4187-travis-retry-on-external-http-failures

Conversation

@schlessera
Copy link
Copy Markdown
Collaborator

@schlessera schlessera commented Feb 15, 2020

Summary

The test suite external-http can fail for occasional and random network issues.

This PR uses travis_retry to run PHPUnit for this test-suite, so that an occasional hiccup will be ignored in most cases because a subsequent retry will succeed.

Fixes #4187

Checklist

  • My pull request is addressing an open issue (please create one otherwise).
  • My code is tested and passes existing tests.
  • My code follows the Engineering Guidelines (updates are often made to the guidelines, check it out periodically).

@googlebot googlebot added the cla: yes Signed the Google CLA label Feb 15, 2020
@schlessera schlessera added the Infrastructure Changes impacting testing infrastructure or build tooling label Feb 15, 2020
Copy link
Copy Markdown
Member

@westonruter westonruter left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There is another external job this needs to be done for: "PHP unit tests w/ external-http (5.6, WordPress 4.9)"

@westonruter westonruter merged commit ec532ee into develop Feb 15, 2020
@westonruter westonruter deleted the 4187-travis-retry-on-external-http-failures branch February 15, 2020 18:14
westonruter pushed a commit that referenced this pull request Feb 15, 2020
* Use travis_retry on PHPUnit for external-http tests

* Add travis_retry to second external-http suite as well

* Refactor travis external-http setup
@westonruter westonruter added this to the v1.5 milestone Feb 15, 2020
westonruter added a commit that referenced this pull request Feb 16, 2020
…ued-dependency-sourcing

* 'develop' of github.com:ampproject/amp-wp: (124 commits)
  Copy patches folder when building
  Re-run amphtml-update.sh to remove duplicate
  Use travis_retry on PHPUnit for external-http tests (#4298)
  Improve display of anyof/oneof attributes in details
  Add error code for DUPLICATE_ONEOF_ATTRS; add error messages
  Sort the attributes from GetMandatoryOf()
  Simplify amphtml-update.py, using Weston's suggestiony
  Improve conversion of resizable iframes and those containing placeholder/overflow
  Add tests
  Update patch
  Bump CSS cache group
  Add patch from external PR that resolves the issue
  In amphtml-update.py, remove extra spaces inside function
  Rename method to get_unsatisfied_number_of_rule()
  Add more unit tests, including allowed mandatory_*of
  Update the PHP logic for the changed mandator_*of in the spec
  Move the mandatory_*of rule to the 'tag_spec'
  Bump stable tag to 1.4.3
  Update readme and screenshots for Stories removal (#4259)
  Update dependency @wordpress/core-data to v2.12.0 (#4265)
  ...
@westonruter
Copy link
Copy Markdown
Member

It doesn't seem like this is working. I see no retrying: https://travis-ci.org/ampproject/amp-wp/jobs/651618798#L1134

@westonruter westonruter modified the milestones: v1.5, v1.4.4 Feb 19, 2020
westonruter added a commit that referenced this pull request Feb 19, 2020
* tag '1.4.4':
  Bump 1.4.4
  Simplify notice text for Stories removal (#4314)
  Bump amp-custom style limit from 50000 to 75000 bytes (#4313)
  Use travis_retry on PHPUnit for external-http tests (#4298)
  Bump version to 1.4.4-alpha
  Bump 1.4.3
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

cla: yes Signed the Google CLA Infrastructure Changes impacting testing infrastructure or build tooling

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Implement retry on external-http tests

3 participants