Skip to content

(integ-runner): assertion stacks are not deploying to the cloud #21639

@Bhuwan

Description

@Bhuwan

Describe the bug

I am trying to utilize integ-runner to build some very basic integration tests with assertions. I've noticed that while the integration test executes successfully, the stack for the Assertion never deploys to AWS.

Additionally, I tried to run some basic integration tests that are packaged with CDK, and the behavior is the same (the assertion stack is not deployed / executed). A sample would be @aws-cdk/aws-appsync/test/integ.log-retention.ts

Expected Behavior

  • integration test fails
  • assertion stack deployed to AWS

Current Behavior

  • integration test succeeds (despite a purposely failing assertion)
  • no assertion stack is deployed to AWS

Reproduction Steps

Here is a very basic integration test:

test/integ.sample.ts

import { IntegTest, ExpectedResult } from '@aws-cdk/integ-tests-alpha';
import { Stack } from 'aws-cdk-lib';


const app = new cdk.App();
const testCase = new Stack(app, 'cdk-integ-lambda-bundling');
const integ = new IntegTest(app, 'test.app', {
  testCases: [testCase],
});



const invoke = integ.assertions.invokeFunction({
  functionName: 'expected_to_fail',
});
invoke.expect(ExpectedResult.objectLike({
  Payload: '200',
}));

app.synth();

then execute:

npm run build
integ-runner --update-on-failed

Possible Solution

No response

Additional Information/Context

integ runner version = 2.38.0
See slack discussion https://cdk-dev.slack.com/archives/C018XT6REKT/p1660683475680059 with @mrgrain

CDK CLI Version

2.34.2

Framework Version

No response

Node.js Version

18.7.0

OS

macOS Monterey (arm)

Language

Typescript

Language Version

3.9.7

Other information

No response

Metadata

Metadata

Assignees

Labels

@aws-cdk/assertionsRelated to the @aws-cdk/assertv2 packagebugThis issue is a bug.effort/smallSmall work item – less than a day of effortin-progressThis issue is being actively worked on.p1

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions