Skip to content

[Feature Request]: Make Pulsar IO connector publish messages asynchronously #22025

@nlu90

Description

@nlu90

What would you like to happen?

Currently the connector publishes messages to pulsar in a synchronous way.

https://github.com/apache/beam/blob/master/sdks/java/io/pulsar/src/main/java/org/apache/beam/sdk/io/pulsar/WriteToPulsarDoFn.java#L48

We need to make this publishing process async in order to improve the performance and throughput.

Issue Priority

Priority: 2

Issue Component

Component: io-java-pulsar

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions