Skip to content

Lambda Event Source - failure handling for kinesis and dynamodb event sources #5236

@advaj

Description

@advaj

Adding additional settings to Lambda Event Sources for handling failures while processing DynamoDB and Kinesis Streams

Use Case

On Nov 25th, Lambda announced support for failure handling while processing DynamoDB and Kinesis Streams. This allows Lambda to take actions like retry limits, bisect on error etc and not retry the entire batch of records being processed. The feature announcement is here - https://aws.amazon.com/about-aws/whats-new/2019/11/aws-lambda-supports-failure-handling-features-for-kinesis-and-dynamodb-event-sources/

Currently, only batch size, starting position and max batching window are the additional parameters that are supported.

This helps in reducing the number of retries and also avoids processing duplicate entries.

Other

The Cloud Formation resource is documented here -
https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-resource-lambda-eventsourcemapping.html

The specific additional fields that I am requesting for are:

  "BisectBatchOnFunctionError" : Boolean,
  "DestinationConfig" : DestinationConfig,
  "MaximumBatchingWindowInSeconds" : Integer,
  "MaximumRecordAgeInSeconds" : Integer,
  "MaximumRetryAttempts" : Integer,
  "ParallelizationFactor" : Integer

This is a 🚀 Feature Request

Metadata

Metadata

Assignees

Labels

@aws-cdk/aws-lambdaRelated to AWS Lambdaeffort/mediumMedium work item – several days of effortfeature-requestA feature should be added or improved.good first issueRelated to contributions. See CONTRIBUTING.mdin-progressThis issue is being actively worked on.

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions