The current implementation of the Lambda Processor in Data Prepper does not support conditional retries based on specific exception types. This enhancement will add the capability to configure the Lambda Processor to retry only when specific exceptions are encountered during invocation.
This feature will improve the reliability and efficiency of the processor by reducing unnecessary retries for non-recoverable errors and focusing on recoverable ones.
Retry Logic Enhancement:
Introduce a mechanism to classify exceptions (e.g., transient, recoverable).
Allow retries for specific exception classes (e.g., TooManyRequestException, ServiceUnavailableException).