Skip to content

[Bug] [Doris Sink] param of batchSize set to Doris Sink config is useless #1171

@baisui1981

Description

@baisui1981

Search before asking

  • I had searched in the issues and found no similar issues.

What happened

By the document of Chunjun Doris Sink , adding config param of batchSize with value of 100,

When I debug the code processing of Doris Sink as below:

As debug, value of config.getBatchSize() is 1 (not 100) ,this led to DorisStreamLoad commit record immediately without any locally buffering

I has review the Doris Sink Code as below,

jdbcConf.setConnection(Collections.singletonList(connectionConf));
jdbcConf.setJdbcUrl(url);
jdbcConf.setPassword(password);
jdbcConf.setUsername(username);

when I append code then batchSize will take effect.

jdbcConf.setBatchSize(this.getBatchSize())

What you expected to happen

make the param of batchSize set to Doris Sink config take effect.

How to reproduce

as described above

Anything else

No response

Version

1.12_release

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions