Skip to content

chore(toolkit): integ tests moved to release pipeline#1632

Merged
eladb merged 1 commit intomasterfrom
benisrae/remove-toolkit-integ-tests
Jan 29, 2019
Merged

chore(toolkit): integ tests moved to release pipeline#1632
eladb merged 1 commit intomasterfrom
benisrae/remove-toolkit-integ-tests

Conversation

@eladb
Copy link
Contributor

@eladb eladb commented Jan 29, 2019

Integration tests are now executed automatically as part of our
release pipeline.

Fixes #294


Pull Request Checklist

  • Testing
    • Unit test added
    • CLI change?: manually run integration tests and paste output as a PR comment
    • cdk-init template change?: coordinated update of integration tests with team
  • Docs
    • jsdocs: All public APIs documented
    • README: README and/or documentation topic updated
  • Title and Description
    • Change type: title prefixed with fix, feat will appear in changelog
    • Title: use lower-case and doesn't end with a period
    • Breaking?: last paragraph: "BREAKING CHANGE: <describe what changed + link for details>"
    • Issues: Indicate issues fixed via: "Fixes #xxx" or "Closes #xxx"
  • Sensitive Modules (requires 2 PR approvers)
    • IAM Policy Document (in @aws-cdk/aws-iam)
    • EC2 Security Groups and ACLs (in @aws-cdk/aws-ec2)
    • Grant APIs (only if not based on official documentation with a reference)

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache-2.0 license.

Integration tests are now executed automatically as part of our
release pipeline.

Fixes #294
@eladb eladb requested a review from a team as a code owner January 29, 2019 14:44
* [ ] Testing
- Unit test added
- __CLI change?:__ manually run [integration tests](https://github.com/awslabs/aws-cdk/blob/master/packages/aws-cdk/integ-tests/test.sh) and paste output as a PR comment
- __CLI change?:__ coordinate update of integration tests with team
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'd fancy an automated run of integration tests as a PR check. Care to create an issue for that?

Ideally, CLI changes should be backwards-compatible (the CLI is an API as any other), and I worry that there is no way for a 3P contributor to have "fast" feedback on whether they broke something or not...

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We plan to move the test scripts themselves to this repo: https://github.com/awslabs/cdk-ops/issues/235

I think this should address your concerns for contributors not to be able to run those tests.

I am not 100% sure I agree that we should run all integ tests as a PR check. Ideally those should be "last resort protections". Granted, that's not true for the CLI, given we don't have good unit test coverage...

@eladb eladb merged commit 5b2de2b into master Jan 29, 2019
@rix0rrr rix0rrr deleted the benisrae/remove-toolkit-integ-tests branch April 23, 2019 07:13
@NGL321 NGL321 added the contribution/core This is a PR that came from AWS. label Sep 23, 2019
@mergify
Copy link
Contributor

mergify bot commented Sep 23, 2019

Thanks so much for taking the time to contribute to the AWS CDK ❤️

We will shortly assign someone to review this pull request and help get it
merged. In the meantime, please take a minute to make sure you follow this
checklist
:

  • PR title type(scope): text
    • type: fix, feat, refactor go into CHANGELOG, chore is hidden
    • scope: name of module without aws- or cdk- prefix or postfix (e.g. s3 instead of aws-s3-deployment)
    • text: use all lower-case, do not end with a period, do not include issue refs
  • PR Description
    • Rationale: describe rationale of change and approach taken
    • Issues: indicate issues fixed via: fixes #xxx or closes #xxx
    • Breaking?: last paragraph: BREAKING CHANGE: <describe what changed + link for details>
  • Testing
    • Unit test added. Prefer to add a new test rather than modify existing tests
    • CLI or init templates change? Re-run/add CLI integration tests
  • Documentation
    • README: update module README to describe new features
    • API docs: public APIs must be documented. Copy from official AWS docs when possible
    • Design: for significant features, follow design process

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

contribution/core This is a PR that came from AWS.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Toolkit: run integration tests automatically

3 participants