Skip to content

[branch-2-0](http) add show_table_data http api #28633

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
lide-reed merged 2 commits into from
Dec 25, 2023
Merged

[branch-2-0](http) add show_table_data http api #28633

lide-reed merged 2 commits into from
Dec 25, 2023

Conversation

@nextdreamblue
Copy link
Contributor

@nextdreamblue nextdreamblue commented Dec 19, 2023 •
edited
Loading

In some cases, users need to get the data size of single replica of a table, and evaluate certain actions based on this, such as estimating the precise backup size.

Proposed changes

Issue Number: close #xxx

cherry pick from #28380

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@github-actions github-actions bot added the kind/docs Categorizes issue or PR as related to documentation. label Dec 19, 2023
@nextdreamblue nextdreamblue changed the title [improvement](http) add show_table_data http api (#28380) [branch-2.0](http) add show_table_data http api Dec 19, 2023
@nextdreamblue
Copy link
Contributor Author

nextdreamblue commented Dec 19, 2023

run buildall

@nextdreamblue nextdreamblue changed the title [branch-2.0](http) add show_table_data http api [branch-2-0](http) add show_table_data http api Dec 19, 2023
@nextdreamblue
[improvement](http) add show_table_data http api (apache#28380)
52a5ef0 
In some cases, users need to get the data size of single replica of a table, and evaluate certain actions based on this, such as estimating the precise backup size.

Signed-off-by: nextdreamblue <zxw520blue1@163.com>
@nextdreamblue
Copy link
Contributor Author

nextdreamblue commented Dec 19, 2023

run buildall

xy720
xy720 approved these changes Dec 19, 2023
View reviewed changes
Copy link
Member

@xy720 xy720 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Dec 19, 2023
@github-actions
Copy link
Contributor

github-actions bot commented Dec 19, 2023

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

github-actions bot commented Dec 19, 2023

PR approved by anyone and no changes requested.

@nextdreamblue
Copy link
Contributor Author

nextdreamblue commented Dec 20, 2023

run p0

@nextdreamblue
Copy link
Contributor Author

nextdreamblue commented Dec 20, 2023

run clickbench

@nextdreamblue
Copy link
Contributor Author

nextdreamblue commented Dec 21, 2023

run buildall

@doris-robot
Copy link

doris-robot commented Dec 21, 2023

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 50.83 seconds
stream load tsv: 568 seconds loaded 74807831229 Bytes, about 125 MB/s
stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s
stream load orc: 65 seconds loaded 1101869774 Bytes, about 16 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 29.8 seconds inserted 10000000 Rows, about 335K ops/s
storage size: 17162516388 Bytes

@nextdreamblue
Copy link
Contributor Author

nextdreamblue commented Dec 22, 2023

run buildall

1 similar comment
@nextdreamblue
Copy link
Contributor Author

nextdreamblue commented Dec 25, 2023

run buildall

@doris-robot
Copy link

doris-robot commented Dec 25, 2023

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 50.35 seconds
stream load tsv: 571 seconds loaded 74807831229 Bytes, about 124 MB/s
stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s
stream load orc: 65 seconds loaded 1101869774 Bytes, about 16 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 29.8 seconds inserted 10000000 Rows, about 335K ops/s
storage size: 17162829441 Bytes

Yulei-Yang
Yulei-Yang approved these changes Dec 25, 2023
View reviewed changes
Copy link
Contributor

@Yulei-Yang Yulei-Yang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@lide-reed lide-reed merged commit 4e3aefb into apache:branch-2.0 Dec 25, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@xy720 xy720 xy720 approved these changes

@Yulei-Yang Yulei-Yang Yulei-Yang approved these changes

Assignees

No one assigned

Labels

approved Indicates a PR has been approved by one committer. kind/docs Categorizes issue or PR as related to documentation. reviewed

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

6 participants

@nextdreamblue @doris-robot @xy720 @Yulei-Yang @lide-reed @xiaokang