-
Notifications
You must be signed in to change notification settings - Fork 4.5k
KafkaIO should support topic patterns #19217
Copy link
Copy link
Closed
Labels
Milestone
Description
For the moment, it is possible to set topics for KafkaIO.Read in 2 ways - one single topic by using withTopic(String) or list of topics by using withTopics(List<String>).
It would make sense to provide another way for this using patterns, based on regular expressions, like withTopics(“org_[0-9]+_source”). In this case, Kafka consumer could discover the topics based on user provided pattern.
Imported from Jira BEAM-5786. Original Jira may contain additional context.
Reported by: aromanenko.
Reactions are currently unavailable