Skip to content

[feat](warmup) display tables in SHOW WARM UP JOB results (#51594) #52291

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
dataroaring merged 1 commit into from
Jun 25, 2025
Merged

[feat](warmup) display tables in SHOW WARM UP JOB results (#51594) #52291

dataroaring merged 1 commit into from
Jun 25, 2025

Conversation

@kaijchen
Copy link
Member

@kaijchen kaijchen commented Jun 25, 2025

backport #51594

@kaijchen
[feat](warmup) display tables in SHOW WARM UP JOB results (apache#51594)
444bbfa 
Enhance the `SHOW WARM UP JOB` command to display tables for "warm up by
tables" jobs.
Table names are shown in the format `db.table.partition`, separated by
commas.

For example:

```
mysql> show warm up job;
+---------------+--------------+----------+-------+-------------------------+-------------+----------+-------------------------+--------+------------------+
| JobId         | ComputeGroup | Status   | Type  | CreateTime              | FinishBatch | AllBatch | FinishTime              | ErrMsg | Tables           |
+---------------+--------------+----------+-------+-------------------------+-------------+----------+-------------------------+--------+------------------+
| 1749488013342 | cluster1     | FINISHED | TABLE | 2025-06-10 01:01:43.670 | 1           | 1        | 2025-06-10 01:01:46.344 |        | test.y, test.t.t |
| 1749488013329 | cluster1     | FINISHED | TABLE | 2025-06-10 00:59:41.135 | 1           | 1        | 2025-06-10 00:59:43.336 |        | test.y, test.t   |
| 1749488013306 | cluster1     | FINISHED | TABLE | 2025-06-10 00:58:43.781 | 1           | 1        | 2025-06-10 00:58:46.332 |        | test.y           |
+---------------+--------------+----------+-------+-------------------------+-------------+----------+-------------------------+--------+------------------+
```

None
@kaijchen kaijchen requested a review from dataroaring as a code owner June 25, 2025 08:11
@Thearas
Copy link
Contributor

Thearas commented Jun 25, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@kaijchen
Copy link
Member Author

kaijchen commented Jun 25, 2025

run buildall

@doris-robot
Copy link

doris-robot commented Jun 25, 2025

TPC-H: Total hot run time: 39619 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 444bbfaf2ec7b0130a12a1061a119648ec8827a7, data reload: false

------ Round 1 ----------------------------------
q1	17578	6689	6559	6559
q2	2078	169	164	164
q3	10591	1055	1172	1055
q4	10559	691	694	691
q5	7763	2830	2810	2810
q6	211	135	128	128
q7	963	622	609	609
q8	9344	1939	2013	1939
q9	6567	6390	6442	6390
q10	6992	2271	2301	2271
q11	464	257	261	257
q12	395	213	219	213
q13	17776	2965	2972	2965
q14	234	200	208	200
q15	514	459	455	455
q16	490	397	389	389
q17	971	597	601	597
q18	7292	6705	6617	6617
q19	1390	1044	1032	1032
q20	468	197	196	196
q21	4119	3163	3102	3102
q22	1093	985	980	980
Total cold run time: 107852 ms
Total hot run time: 39619 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6563	6497	6499	6497
q2	326	236	221	221
q3	2865	2745	2733	2733
q4	2032	1790	1818	1790
q5	5763	5727	5724	5724
q6	203	128	134	128
q7	2239	1808	1786	1786
q8	3358	3508	3520	3508
q9	8903	8795	8856	8795
q10	3549	3526	3545	3526
q11	591	491	482	482
q12	794	614	595	595
q13	9084	3130	3177	3130
q14	334	294	269	269
q15	507	463	462	462
q16	481	429	443	429
q17	1829	1611	1596	1596
q18	8290	7900	7869	7869
q19	1671	1656	1512	1512
q20	2148	1825	1807	1807
q21	5070	5101	5061	5061
q22	1122	1062	1056	1056
Total cold run time: 67722 ms
Total hot run time: 58976 ms

@doris-robot
Copy link

doris-robot commented Jun 25, 2025

TPC-DS: Total hot run time: 197614 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 444bbfaf2ec7b0130a12a1061a119648ec8827a7, data reload: false

query1	1298	927	895	895
query2	6297	2018	1968	1968
query3	10818	4226	4480	4226
query4	61073	29684	23496	23496
query5	5271	455	450	450
query6	402	175	177	175
query7	5534	312	302	302
query8	298	218	208	208
query9	8743	2568	2568	2568
query10	483	271	263	263
query11	17834	15217	15795	15217
query12	169	104	114	104
query13	1503	439	429	429
query14	9881	7379	7695	7379
query15	210	179	191	179
query16	7170	459	484	459
query17	1210	583	550	550
query18	1819	327	311	311
query19	206	161	155	155
query20	112	116	106	106
query21	204	107	105	105
query22	4715	4487	4601	4487
query23	34607	34535	34244	34244
query24	6193	2954	2895	2895
query25	557	423	416	416
query26	677	178	177	177
query27	2066	369	379	369
query28	4201	2113	2130	2113
query29	720	480	469	469
query30	246	165	159	159
query31	998	870	840	840
query32	70	57	57	57
query33	499	306	319	306
query34	952	517	521	517
query35	860	751	723	723
query36	1078	981	946	946
query37	113	68	68	68
query38	4115	4107	3983	3983
query39	1532	1493	1472	1472
query40	207	109	111	109
query41	52	54	49	49
query42	114	100	104	100
query43	540	517	509	509
query44	1177	823	828	823
query45	197	182	178	178
query46	1170	730	729	729
query47	2056	1907	1935	1907
query48	486	409	411	409
query49	784	407	409	407
query50	843	423	432	423
query51	7398	7360	7336	7336
query52	103	91	98	91
query53	263	185	181	181
query54	566	485	472	472
query55	77	77	80	77
query56	269	251	237	237
query57	1321	1203	1183	1183
query58	227	228	215	215
query59	3462	3243	2921	2921
query60	279	243	252	243
query61	107	109	111	109
query62	777	665	668	665
query63	216	189	184	184
query64	1447	656	625	625
query65	3310	3212	3206	3206
query66	703	297	297	297
query67	15989	15794	15600	15600
query68	4218	600	572	572
query69	410	265	274	265
query70	1185	1183	1116	1116
query71	352	270	268	268
query72	6427	4111	3936	3936
query73	745	337	348	337
query74	10283	9042	9336	9042
query75	3374	2662	2721	2662
query76	2205	998	1069	998
query77	499	279	271	271
query78	10547	9703	9577	9577
query79	2141	618	614	614
query80	1357	438	436	436
query81	517	226	212	212
query82	1271	96	89	89
query83	266	153	150	150
query84	284	78	82	78
query85	1030	298	294	294
query86	381	298	299	298
query87	4519	4269	4245	4245
query88	3867	2404	2376	2376
query89	429	290	294	290
query90	2009	184	185	184
query91	181	145	150	145
query92	63	51	48	48
query93	2623	566	551	551
query94	789	289	304	289
query95	361	263	260	260
query96	626	282	289	282
query97	3340	3149	3133	3133
query98	223	214	200	200
query99	1588	1325	1351	1325
Total cold run time: 316984 ms
Total hot run time: 197614 ms

@doris-robot
Copy link

doris-robot commented Jun 25, 2025

ClickBench: Total hot run time: 29.35 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 444bbfaf2ec7b0130a12a1061a119648ec8827a7, data reload: false

query1	0.03	0.03	0.03
query2	0.07	0.03	0.03
query3	0.23	0.07	0.07
query4	1.62	0.11	0.11
query5	0.54	0.53	0.53
query6	1.14	0.72	0.73
query7	0.02	0.02	0.02
query8	0.04	0.03	0.03
query9	0.58	0.49	0.51
query10	0.55	0.55	0.56
query11	0.14	0.11	0.12
query12	0.16	0.12	0.11
query13	0.61	0.60	0.61
query14	0.78	0.78	0.82
query15	0.85	0.83	0.83
query16	0.38	0.38	0.39
query17	1.04	1.09	1.02
query18	0.24	0.22	0.23
query19	1.96	1.83	1.86
query20	0.01	0.01	0.01
query21	15.41	0.64	0.60
query22	2.39	2.32	0.96
query23	16.87	1.05	0.78
query24	3.54	0.97	1.46
query25	0.17	0.09	0.06
query26	0.60	0.15	0.14
query27	0.07	0.04	0.04
query28	9.83	0.53	0.48
query29	12.57	3.26	3.20
query30	0.25	0.07	0.06
query31	2.86	0.39	0.37
query32	3.24	0.47	0.46
query33	2.96	3.02	3.05
query34	17.03	4.47	4.54
query35	4.63	4.51	4.50
query36	0.68	0.51	0.48
query37	0.08	0.06	0.06
query38	0.05	0.04	0.03
query39	0.03	0.03	0.02
query40	0.16	0.13	0.12
query41	0.08	0.02	0.02
query42	0.04	0.03	0.02
query43	0.04	0.03	0.02
Total cold run time: 104.57 s
Total hot run time: 29.35 s

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Jun 25, 2025
@github-actions
Copy link
Contributor

github-actions bot commented Jun 25, 2025

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

github-actions bot commented Jun 25, 2025

PR approved by anyone and no changes requested.

dataroaring
dataroaring approved these changes Jun 25, 2025
View reviewed changes
Copy link
Contributor

@dataroaring dataroaring left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@dataroaring dataroaring merged commit 294db35 into apache:branch-3.0 Jun 25, 2025
25 of 27 checks passed
koarz pushed a commit to koarz/doris that referenced this pull request Jul 3, 2025
@kaijchen @koarz
[feat](warmup) display tables in SHOW WARM UP JOB results (apache#51594…
e193d33 
…) (apache#52291)

backport apache#51594
@kaijchen kaijchen mentioned this pull request Jul 16, 2025
Merged
16 tasks
dataroaring pushed a commit that referenced this pull request Jul 18, 2025
@kaijchen
[fix](warmup) fix show warm up tables (#53406)
8a1f679 
### What problem does this PR solve?

Related PR: #52291 #52514

Problem Summary:

Fix show warm up jobs after merging periodic and event driven warmup
feature.
@gavinchou gavinchou mentioned this pull request Aug 15, 2025
Open
kaijchen added a commit to kaijchen/doris that referenced this pull request Aug 22, 2025
@kaijchen
[fix](warmup) fix show warm up tables (apache#53406)
6625e00 
### What problem does this PR solve?

Related PR: apache#52291 apache#52514

Problem Summary:

Fix show warm up jobs after merging periodic and event driven warmup
feature.
kaijchen added a commit to kaijchen/doris that referenced this pull request Aug 22, 2025
@kaijchen
[fix](warmup) fix show warm up tables (apache#53406)
ef8ec5d 
Related PR: apache#52291 apache#52514

Problem Summary:

Fix show warm up jobs after merging periodic and event driven warmup
feature.
kaijchen added a commit to kaijchen/doris that referenced this pull request Aug 22, 2025
@kaijchen
[fix](warmup) fix show warm up tables (apache#53406)
5cfb240 
Related PR: apache#52291 apache#52514

Problem Summary:

Fix show warm up jobs after merging periodic and event driven warmup
feature.
@kaijchen kaijchen mentioned this pull request Aug 22, 2025
Merged
16 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@gavinchou gavinchou gavinchou approved these changes

@dataroaring dataroaring dataroaring approved these changes

Assignees

No one assigned

Labels

approved Indicates a PR has been approved by one committer. reviewed

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

5 participants

@kaijchen @Thearas @doris-robot @gavinchou @dataroaring