-
Notifications
You must be signed in to change notification settings - Fork 1.7k
Closed
Labels
bugSomething isn't workingSomething isn't working
Description
Search before asking
- I had searched in the issues and found no similar issues.
What happened
By the document of Chunjun Doris Sink , adding config param of batchSize with value of 100,
When I debug the code processing of Doris Sink as below:
chunjun/chunjun-core/src/main/java/com/dtstack/chunjun/sink/format/BaseRichOutputFormat.java
Line 212 in ee6aeaa
| this.batchSize = config.getBatchSize(); |
As debug, value of config.getBatchSize() is 1 (not 100) ,this led to DorisStreamLoad commit record immediately without any locally buffering
I has review the Doris Sink Code as below,
Lines 179 to 182 in ee6aeaa
| jdbcConf.setConnection(Collections.singletonList(connectionConf)); | |
| jdbcConf.setJdbcUrl(url); | |
| jdbcConf.setPassword(password); | |
| jdbcConf.setUsername(username); |
when I append code then batchSize will take effect.
jdbcConf.setBatchSize(this.getBatchSize())What you expected to happen
make the param of batchSize set to Doris Sink config take effect.
How to reproduce
as described above
Anything else
No response
Version
1.12_release
Are you willing to submit PR?
- Yes I am willing to submit a PR!
Code of Conduct
- I agree to follow this project's Code of Conduct
Metadata
Metadata
Assignees
Labels
bugSomething isn't workingSomething isn't working