Skip to content

KafkaIO should support topic patterns #19217

@kennknowles

Description

@kennknowles

For the moment, it is possible to set topics for KafkaIO.Read in 2 ways - one single topic by using withTopic(String) or list of topics by using withTopics(List<String>).

It would make sense to provide another way for this using patterns, based on regular expressions, like withTopics(“org_[0-9]+_source”). In this case, Kafka consumer could discover the topics based on user provided pattern.

Imported from Jira BEAM-5786. Original Jira may contain additional context.
Reported by: aromanenko.

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions