Skip to content

branch-3.0: [feature](cloud) support event driven or periodic warm up #52370 #52514

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
dataroaring merged 18 commits into from
Jul 11, 2025
Merged

branch-3.0: [feature](cloud) support event driven or periodic warm up #52370 #52514

dataroaring merged 18 commits into from
Jul 11, 2025

Conversation

@kaijchen
Copy link
Member

@kaijchen kaijchen commented Jun 30, 2025

What problem does this PR solve?

backport #52370

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason

  • Behavior changed:

    • No.
    • Yes.

  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

kaijchen added 10 commits June 30, 2025 15:59
@kaijchen kaijchen requested a review from dataroaring as a code owner June 30, 2025 08:19
@kaijchen
Copy link
Member Author

kaijchen commented Jun 30, 2025

run buildall

@Thearas
Copy link
Contributor

Thearas commented Jun 30, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@hello-stephen
Copy link
Contributor

hello-stephen commented Jun 30, 2025

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 82.63% (1118/1353)
Line Coverage 66.47% (19472/29296)
Region Coverage 65.52% (9311/14212)
Branch Coverage 55.48% (5064/9128)

@kaijchen
Copy link
Member Author

kaijchen commented Jun 30, 2025

run buildall

@hello-stephen
Copy link
Contributor

hello-stephen commented Jun 30, 2025

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 82.63% (1118/1353)
Line Coverage 66.44% (19464/29296)
Region Coverage 65.55% (9316/14212)
Branch Coverage 55.44% (5061/9128)

@doris-robot
Copy link

doris-robot commented Jun 30, 2025

TPC-H: Total hot run time: 40156 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 7ed195dcbd9c26e83907fe9d66a773c47c3d09c8, data reload: false

------ Round 1 ----------------------------------
q1	17629	7073	6647	6647
q2	2087	181	179	179
q3	10677	1082	1213	1082
q4	10321	792	709	709
q5	7704	2939	2892	2892
q6	219	135	133	133
q7	967	623	600	600
q8	9351	2004	2056	2004
q9	6622	6484	6455	6455
q10	6980	2274	2337	2274
q11	465	269	261	261
q12	398	209	209	209
q13	17767	2983	2988	2983
q14	238	220	213	213
q15	505	461	461	461
q16	487	382	375	375
q17	994	588	546	546
q18	7355	6722	6667	6667
q19	1411	1132	1013	1013
q20	490	210	206	206
q21	3949	3269	3253	3253
q22	1101	994	996	994
Total cold run time: 107717 ms
Total hot run time: 40156 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6709	6560	6621	6560
q2	335	227	232	227
q3	2938	2779	2967	2779
q4	2035	1780	1805	1780
q5	5736	5733	5776	5733
q6	207	132	133	132
q7	2244	1800	1792	1792
q8	3382	3546	3570	3546
q9	9034	8754	8887	8754
q10	3605	3541	3546	3541
q11	593	489	490	489
q12	818	605	591	591
q13	9558	3138	3161	3138
q14	317	282	289	282
q15	510	476	470	470
q16	479	439	433	433
q17	1847	1650	1605	1605
q18	8331	7834	7670	7670
q19	1713	1510	1642	1510
q20	2121	1910	1891	1891
q21	5098	5122	4925	4925
q22	1162	1072	1054	1054
Total cold run time: 68772 ms
Total hot run time: 58902 ms

@doris-robot
Copy link

doris-robot commented Jun 30, 2025

TPC-DS: Total hot run time: 198403 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 7ed195dcbd9c26e83907fe9d66a773c47c3d09c8, data reload: false

query1	1294	914	912	912
query2	6419	1893	1902	1893
query3	11002	4418	4458	4418
query4	61217	29552	23545	23545
query5	5108	465	443	443
query6	396	181	181	181
query7	5449	324	310	310
query8	319	239	244	239
query9	8308	2648	2606	2606
query10	445	275	268	268
query11	17513	15423	16085	15423
query12	165	108	107	107
query13	1450	448	443	443
query14	9913	7659	6831	6831
query15	204	187	181	181
query16	7271	502	497	497
query17	1156	598	620	598
query18	1929	321	316	316
query19	216	164	159	159
query20	125	116	114	114
query21	207	113	107	107
query22	4701	4761	4488	4488
query23	34601	34258	34264	34258
query24	6219	3006	3019	3006
query25	552	416	433	416
query26	671	185	179	179
query27	2047	378	369	369
query28	4422	2210	2224	2210
query29	737	454	480	454
query30	242	162	167	162
query31	963	853	822	822
query32	67	54	58	54
query33	427	310	304	304
query34	944	505	514	505
query35	850	729	749	729
query36	1105	963	963	963
query37	121	69	69	69
query38	4139	4019	4004	4004
query39	1556	1471	1475	1471
query40	205	100	101	100
query41	49	48	46	46
query42	118	100	102	100
query43	528	494	493	493
query44	1214	856	830	830
query45	186	172	173	172
query46	1173	749	739	739
query47	2064	1948	1931	1931
query48	489	403	412	403
query49	746	414	419	414
query50	856	440	431	431
query51	7549	7281	7285	7281
query52	106	91	96	91
query53	285	191	197	191
query54	582	461	459	459
query55	80	79	79	79
query56	265	250	254	250
query57	1323	1199	1211	1199
query58	236	230	224	224
query59	3265	3110	2910	2910
query60	274	275	259	259
query61	109	107	108	107
query62	775	673	677	673
query63	229	194	188	188
query64	1395	712	632	632
query65	3354	3272	3254	3254
query66	734	296	290	290
query67	15812	15688	15700	15688
query68	4139	601	578	578
query69	458	269	269	269
query70	1154	1139	1131	1131
query71	351	271	262	262
query72	6437	4158	3978	3978
query73	769	355	372	355
query74	10113	9208	9335	9208
query75	3370	2669	2677	2669
query76	1970	1030	1087	1030
query77	526	280	279	279
query78	10632	9653	9567	9567
query79	1331	630	616	616
query80	884	435	448	435
query81	525	219	221	219
query82	1305	97	95	95
query83	252	145	140	140
query84	287	103	78	78
query85	892	314	298	298
query86	329	307	297	297
query87	4410	4253	4237	4237
query88	3643	2465	2406	2406
query89	427	291	289	289
query90	2044	190	187	187
query91	189	154	151	151
query92	64	51	53	51
query93	1664	572	573	572
query94	781	308	300	300
query95	366	255	258	255
query96	627	291	287	287
query97	3300	3166	3175	3166
query98	208	209	197	197
query99	1772	1317	1313	1313
Total cold run time: 313690 ms
Total hot run time: 198403 ms

@doris-robot
Copy link

doris-robot commented Jun 30, 2025

ClickBench: Total hot run time: 31.22 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 7ed195dcbd9c26e83907fe9d66a773c47c3d09c8, data reload: false

query1	0.03	0.03	0.03
query2	0.09	0.04	0.05
query3	0.24	0.05	0.06
query4	1.64	0.10	0.10
query5	0.52	0.50	0.51
query6	1.12	0.75	0.74
query7	0.04	0.02	0.02
query8	0.06	0.05	0.05
query9	0.55	0.51	0.51
query10	0.57	0.56	0.58
query11	0.17	0.12	0.12
query12	0.16	0.12	0.12
query13	0.62	0.60	0.60
query14	0.79	0.81	0.83
query15	0.86	0.86	0.85
query16	0.38	0.38	0.37
query17	1.08	1.08	1.01
query18	0.19	0.19	0.21
query19	1.99	1.80	1.83
query20	0.02	0.02	0.01
query21	15.40	0.69	0.67
query22	3.50	6.85	2.09
query23	18.34	1.46	1.31
query24	2.26	0.22	0.22
query25	0.16	0.08	0.08
query26	0.27	0.19	0.18
query27	0.08	0.09	0.08
query28	13.22	0.61	0.59
query29	12.65	3.34	3.29
query30	0.24	0.07	0.06
query31	2.86	0.42	0.40
query32	3.24	0.49	0.49
query33	3.02	3.02	3.08
query34	16.77	4.53	4.57
query35	4.70	4.63	4.62
query36	0.68	0.50	0.47
query37	0.20	0.16	0.16
query38	0.17	0.16	0.16
query39	0.05	0.05	0.04
query40	0.15	0.13	0.13
query41	0.10	0.06	0.05
query42	0.07	0.05	0.05
query43	0.05	0.05	0.05
Total cold run time: 109.3 s
Total hot run time: 31.22 s

@kaijchen
Copy link
Member Author

kaijchen commented Jun 30, 2025

run buildall

@doris-robot
Copy link

doris-robot commented Jun 30, 2025

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 82.63% (1118/1353)
Line Coverage 66.47% (19472/29296)
Region Coverage 65.58% (9320/14212)
Branch Coverage 55.50% (5066/9128)

@doris-robot
Copy link

doris-robot commented Jun 30, 2025

TPC-H: Total hot run time: 39843 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 2d3dd5d89154de67bb08d84fa86a9ed9708437b1, data reload: false

------ Round 1 ----------------------------------
q1	17956	6932	6639	6639
q2	2080	173	167	167
q3	10960	1090	1208	1090
q4	10540	738	704	704
q5	7761	2847	2750	2750
q6	219	138	135	135
q7	979	623	609	609
q8	9374	1972	2023	1972
q9	6710	6355	6414	6355
q10	6998	2283	2408	2283
q11	455	264	278	264
q12	402	217	217	217
q13	17770	2984	2986	2984
q14	248	218	208	208
q15	511	472	484	472
q16	487	402	383	383
q17	978	586	572	572
q18	7432	6652	6785	6652
q19	1393	1107	1086	1086
q20	487	206	200	200
q21	4130	3250	3140	3140
q22	1120	961	977	961
Total cold run time: 108990 ms
Total hot run time: 39843 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6597	6644	6572	6572
q2	333	233	231	231
q3	2964	2777	2978	2777
q4	2034	1883	1755	1755
q5	5813	5757	5778	5757
q6	207	131	133	131
q7	2178	1788	1824	1788
q8	3375	3624	3551	3551
q9	8995	8905	9036	8905
q10	3579	3511	3532	3511
q11	590	500	496	496
q12	801	615	614	614
q13	6798	3179	3179	3179
q14	289	283	265	265
q15	515	466	471	466
q16	511	448	445	445
q17	1855	1641	1621	1621
q18	8226	7852	7809	7809
q19	1702	1550	1563	1550
q20	2063	1852	1804	1804
q21	5400	5184	5161	5161
q22	1145	1074	997	997
Total cold run time: 65970 ms
Total hot run time: 59385 ms

@doris-robot
Copy link

doris-robot commented Jun 30, 2025

TPC-DS: Total hot run time: 197908 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 2d3dd5d89154de67bb08d84fa86a9ed9708437b1, data reload: false

query1	1328	898	915	898
query2	6271	1921	1907	1907
query3	10842	4280	4280	4280
query4	61712	29219	23883	23883
query5	5201	445	437	437
query6	418	170	180	170
query7	5494	314	313	313
query8	311	225	223	223
query9	8669	2594	2583	2583
query10	459	284	252	252
query11	17579	15503	15830	15503
query12	158	109	113	109
query13	1499	452	433	433
query14	10485	7597	6776	6776
query15	215	180	176	176
query16	7115	512	491	491
query17	1159	595	593	593
query18	1926	346	321	321
query19	213	172	157	157
query20	119	117	119	117
query21	210	109	107	107
query22	4700	4635	4776	4635
query23	34706	34212	34248	34212
query24	6163	2893	2923	2893
query25	551	433	437	433
query26	661	175	176	175
query27	1998	343	354	343
query28	4257	2195	2181	2181
query29	733	450	427	427
query30	238	153	162	153
query31	978	807	820	807
query32	71	56	57	56
query33	444	301	313	301
query34	932	508	523	508
query35	854	741	738	738
query36	1091	943	917	917
query37	106	68	69	68
query38	4062	4033	3997	3997
query39	1515	1464	1538	1464
query40	203	100	102	100
query41	54	49	47	47
query42	113	99	100	99
query43	513	488	478	478
query44	1176	815	822	815
query45	187	178	177	177
query46	1180	746	778	746
query47	2070	1866	1946	1866
query48	479	385	386	385
query49	736	413	403	403
query50	841	418	424	418
query51	7382	7208	7283	7208
query52	102	91	88	88
query53	261	180	183	180
query54	562	459	455	455
query55	78	78	79	78
query56	284	268	259	259
query57	1315	1233	1213	1213
query58	226	220	223	220
query59	3226	3030	2992	2992
query60	313	303	255	255
query61	108	121	117	117
query62	789	714	686	686
query63	217	193	198	193
query64	1497	700	652	652
query65	3384	3218	3202	3202
query66	725	299	293	293
query67	16141	15537	15715	15537
query68	4085	609	571	571
query69	459	269	272	269
query70	1136	1056	1081	1056
query71	344	262	255	255
query72	6436	4051	4089	4051
query73	756	341	356	341
query74	10252	9227	9318	9227
query75	3411	2664	2687	2664
query76	1887	1052	983	983
query77	500	269	258	258
query78	10649	9617	9624	9617
query79	1410	602	603	602
query80	870	427	425	425
query81	507	221	223	221
query82	1271	97	88	88
query83	245	145	148	145
query84	286	86	83	83
query85	909	299	287	287
query86	330	268	274	268
query87	4436	4307	4228	4228
query88	3786	2420	2353	2353
query89	421	286	295	286
query90	1987	188	195	188
query91	191	171	153	153
query92	64	52	50	50
query93	1904	557	562	557
query94	754	297	294	294
query95	356	253	259	253
query96	619	284	288	284
query97	3308	3128	3126	3126
query98	222	203	198	198
query99	1983	1328	1338	1328
Total cold run time: 315379 ms
Total hot run time: 197908 ms

@doris-robot
Copy link

doris-robot commented Jun 30, 2025

ClickBench: Total hot run time: 31.4 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 2d3dd5d89154de67bb08d84fa86a9ed9708437b1, data reload: false

query1	0.03	0.04	0.03
query2	0.09	0.05	0.04
query3	0.24	0.06	0.06
query4	1.64	0.09	0.08
query5	0.52	0.50	0.49
query6	1.13	0.74	0.74
query7	0.02	0.02	0.01
query8	0.05	0.05	0.05
query9	0.56	0.50	0.50
query10	0.57	0.58	0.57
query11	0.17	0.12	0.12
query12	0.17	0.13	0.13
query13	0.61	0.60	0.60
query14	0.78	0.78	0.82
query15	0.85	0.83	0.82
query16	0.38	0.38	0.38
query17	1.06	1.08	1.03
query18	0.19	0.18	0.20
query19	1.90	1.90	1.84
query20	0.02	0.01	0.01
query21	15.40	0.69	0.67
query22	3.44	6.70	2.22
query23	18.25	1.40	1.40
query24	2.20	0.24	0.24
query25	0.15	0.09	0.09
query26	0.28	0.18	0.18
query27	0.08	0.08	0.08
query28	13.19	0.61	0.58
query29	12.70	3.35	3.33
query30	0.25	0.06	0.05
query31	2.84	0.40	0.40
query32	3.22	0.50	0.49
query33	3.01	3.02	3.02
query34	16.91	4.53	4.57
query35	4.57	4.57	4.55
query36	0.67	0.48	0.49
query37	0.20	0.17	0.18
query38	0.16	0.15	0.16
query39	0.05	0.05	0.04
query40	0.16	0.13	0.13
query41	0.10	0.05	0.06
query42	0.06	0.04	0.05
query43	0.05	0.05	0.05
Total cold run time: 108.92 s
Total hot run time: 31.4 s

@kaijchen
Copy link
Member Author

kaijchen commented Jul 2, 2025

run buildall

@doris-robot
Copy link

doris-robot commented Jul 2, 2025

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 82.67% (1121/1356)
Line Coverage 66.52% (19513/29332)
Region Coverage 65.96% (9620/14585)
Branch Coverage 55.49% (5067/9132)

@doris-robot
Copy link

doris-robot commented Jul 2, 2025

BE UT Coverage Report

Increment line coverage 0.32% (1/315) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 41.23% (10945/26543)
Line Coverage 31.99% (93712/292927)
Region Coverage 31.09% (48324/155450)
Branch Coverage 27.53% (24745/89870)

@doris-robot
Copy link

doris-robot commented Jul 2, 2025

TPC-H: Total hot run time: 39467 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 885aa48290f97f864c7a4503d604526797de7691, data reload: false

------ Round 1 ----------------------------------
q1	17946	7735	6618	6618
q2	2061	167	183	167
q3	10771	1066	1152	1066
q4	10544	736	716	716
q5	7751	2870	2845	2845
q6	218	141	137	137
q7	976	611	615	611
q8	9378	1967	1990	1967
q9	6612	6401	6384	6384
q10	6997	2234	2338	2234
q11	470	260	253	253
q12	410	210	207	207
q13	17809	2970	2958	2958
q14	236	212	212	212
q15	504	475	454	454
q16	484	367	382	367
q17	991	542	580	542
q18	7272	6716	6460	6460
q19	1451	1031	1022	1022
q20	459	203	200	200
q21	3876	3176	3081	3081
q22	1104	971	966	966
Total cold run time: 108320 ms
Total hot run time: 39467 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6640	6578	6512	6512
q2	322	229	230	229
q3	2896	2754	2919	2754
q4	2015	1783	1864	1783
q5	6019	5694	5696	5694
q6	208	127	130	127
q7	2151	1808	1789	1789
q8	3359	3578	3483	3483
q9	8910	8742	8918	8742
q10	3546	3546	3512	3512
q11	582	499	491	491
q12	807	600	626	600
q13	8981	3216	3149	3149
q14	317	280	264	264
q15	508	475	477	475
q16	479	441	446	441
q17	1835	1608	1603	1603
q18	8266	7709	7776	7709
q19	1699	1562	1606	1562
q20	2065	1841	1819	1819
q21	5258	4821	4990	4821
q22	1128	1061	1016	1016
Total cold run time: 67991 ms
Total hot run time: 58575 ms

@doris-robot
Copy link

doris-robot commented Jul 2, 2025

TPC-DS: Total hot run time: 195495 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 885aa48290f97f864c7a4503d604526797de7691, data reload: false

query1	1300	917	894	894
query2	6367	1931	1888	1888
query3	10858	4310	4248	4248
query4	61088	29064	23618	23618
query5	5215	456	443	443
query6	406	173	181	173
query7	5457	293	293	293
query8	306	220	225	220
query9	8362	2560	2539	2539
query10	459	273	246	246
query11	17482	15094	15713	15094
query12	154	97	99	97
query13	1485	444	430	430
query14	10506	6870	7153	6870
query15	215	177	190	177
query16	7124	470	506	470
query17	1157	568	594	568
query18	1838	339	333	333
query19	213	161	163	161
query20	122	113	113	113
query21	210	102	104	102
query22	4706	4415	4636	4415
query23	34248	34106	33818	33818
query24	6163	2883	2893	2883
query25	535	436	424	424
query26	655	168	163	163
query27	1704	360	364	360
query28	3805	2132	2111	2111
query29	699	471	426	426
query30	236	154	154	154
query31	967	807	821	807
query32	66	55	55	55
query33	422	285	280	280
query34	905	489	500	489
query35	845	732	728	728
query36	1082	954	959	954
query37	110	65	69	65
query38	4054	3944	3910	3910
query39	1531	1452	1458	1452
query40	199	107	96	96
query41	49	46	46	46
query42	112	97	98	97
query43	523	494	476	476
query44	1213	822	819	819
query45	186	164	167	164
query46	1130	735	751	735
query47	2044	1906	1921	1906
query48	466	372	403	372
query49	706	400	411	400
query50	836	422	430	422
query51	7470	7263	7325	7263
query52	99	90	89	89
query53	254	181	187	181
query54	559	456	455	455
query55	78	74	79	74
query56	256	242	262	242
query57	1311	1195	1214	1195
query58	229	213	218	213
query59	3190	2935	2981	2935
query60	315	260	260	260
query61	112	104	111	104
query62	801	679	680	679
query63	218	195	192	192
query64	1379	649	636	636
query65	3250	3174	3191	3174
query66	696	290	295	290
query67	15761	15501	15542	15501
query68	4304	579	557	557
query69	428	257	266	257
query70	1142	1083	1050	1050
query71	371	260	254	254
query72	6429	3993	3984	3984
query73	739	334	358	334
query74	10398	8918	9046	8918
query75	3431	2642	2676	2642
query76	2018	1055	1106	1055
query77	479	265	266	265
query78	10559	9594	9557	9557
query79	1993	591	585	585
query80	1163	427	420	420
query81	514	215	215	215
query82	387	85	87	85
query83	158	143	143	143
query84	283	82	74	74
query85	962	300	292	292
query86	397	301	311	301
query87	4406	4178	4152	4152
query88	4226	2336	2315	2315
query89	414	286	295	286
query90	1964	177	179	177
query91	176	145	145	145
query92	58	50	49	49
query93	2562	541	550	541
query94	786	288	278	278
query95	354	251	258	251
query96	615	270	274	270
query97	3297	3088	3121	3088
query98	216	194	199	194
query99	1567	1310	1274	1274
Total cold run time: 313295 ms
Total hot run time: 195495 ms

@doris-robot
Copy link

doris-robot commented Jul 2, 2025

ClickBench: Total hot run time: 31.19 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 885aa48290f97f864c7a4503d604526797de7691, data reload: false

query1	0.03	0.03	0.03
query2	0.09	0.05	0.05
query3	0.24	0.05	0.05
query4	1.64	0.08	0.08
query5	0.51	0.51	0.50
query6	1.12	0.74	0.75
query7	0.02	0.02	0.02
query8	0.05	0.04	0.04
query9	0.56	0.50	0.50
query10	0.56	0.54	0.55
query11	0.16	0.11	0.13
query12	0.16	0.12	0.13
query13	0.62	0.60	0.60
query14	0.78	0.81	0.80
query15	0.84	0.84	0.83
query16	0.36	0.38	0.38
query17	1.01	1.00	1.06
query18	0.18	0.18	0.18
query19	1.93	1.79	1.87
query20	0.01	0.02	0.01
query21	15.40	0.67	0.68
query22	3.48	6.37	2.19
query23	18.29	1.39	1.39
query24	2.15	0.23	0.22
query25	0.15	0.09	0.08
query26	0.26	0.18	0.17
query27	0.08	0.07	0.08
query28	13.30	0.59	0.58
query29	12.64	3.35	3.33
query30	0.24	0.06	0.05
query31	2.89	0.41	0.38
query32	3.22	0.49	0.49
query33	2.95	3.04	3.08
query34	16.89	4.52	4.50
query35	4.63	4.55	4.54
query36	0.66	0.49	0.51
query37	0.19	0.17	0.16
query38	0.17	0.15	0.15
query39	0.05	0.05	0.04
query40	0.16	0.13	0.13
query41	0.11	0.05	0.05
query42	0.06	0.05	0.05
query43	0.05	0.05	0.05
Total cold run time: 108.89 s
Total hot run time: 31.19 s

@kaijchen
Copy link
Member Author

kaijchen commented Jul 10, 2025

run buildall

@doris-robot
Copy link

doris-robot commented Jul 10, 2025

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 83.32% (1144/1373)
Line Coverage 67.01% (19764/29494)
Region Coverage 66.79% (9831/14720)
Branch Coverage 55.95% (5140/9186)

@doris-robot
Copy link

doris-robot commented Jul 10, 2025

BE UT Coverage Report

Increment line coverage 0.32% (1/315) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 41.21% (10949/26572)
Line Coverage 31.94% (93770/293610)
Region Coverage 31.09% (48360/155550)
Branch Coverage 27.53% (24771/89978)

@doris-robot
Copy link

doris-robot commented Jul 10, 2025

TPC-H: Total hot run time: 39923 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit cce7239fe8689710c2f6721996012455e2c2c203, data reload: false

------ Round 1 ----------------------------------
q1	17720	6944	6656	6656
q2	2106	176	166	166
q3	10605	1197	1237	1197
q4	10493	814	762	762
q5	7757	2913	2838	2838
q6	217	135	132	132
q7	989	616	599	599
q8	9367	1973	2097	1973
q9	6617	6401	6450	6401
q10	7002	2302	2288	2288
q11	449	259	255	255
q12	400	225	221	221
q13	17800	2995	3030	2995
q14	251	205	218	205
q15	514	484	473	473
q16	489	392	377	377
q17	992	578	581	578
q18	7459	6651	6731	6651
q19	1391	984	1117	984
q20	473	195	196	195
q21	3919	2997	3156	2997
q22	1068	1000	980	980
Total cold run time: 108078 ms
Total hot run time: 39923 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6635	6628	6653	6628
q2	330	230	230	230
q3	2938	2981	2954	2954
q4	2118	1871	1866	1866
q5	5733	5769	5739	5739
q6	208	132	138	132
q7	2243	1808	1836	1808
q8	3384	3612	3585	3585
q9	8784	9000	8909	8909
q10	3579	3520	3526	3520
q11	597	484	498	484
q12	819	582	609	582
q13	9089	3222	3171	3171
q14	310	272	272	272
q15	521	460	463	460
q16	487	448	443	443
q17	1869	1677	1622	1622
q18	8368	7805	7727	7727
q19	1695	1610	1525	1525
q20	2082	1886	1861	1861
q21	5338	5045	5113	5045
q22	1162	1064	1013	1013
Total cold run time: 68289 ms
Total hot run time: 59576 ms

@doris-robot
Copy link

doris-robot commented Jul 10, 2025

TPC-DS: Total hot run time: 196650 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit cce7239fe8689710c2f6721996012455e2c2c203, data reload: false

query1	1290	909	910	909
query2	6273	1921	1876	1876
query3	10844	4271	4429	4271
query4	33390	23949	23392	23392
query5	4676	467	449	449
query6	275	187	196	187
query7	4004	327	321	321
query8	290	237	221	221
query9	9564	2608	2580	2580
query10	482	260	263	260
query11	18113	15276	14959	14959
query12	157	104	103	103
query13	1572	435	415	415
query14	8791	7368	7680	7368
query15	256	183	193	183
query16	8019	485	466	466
query17	1583	595	561	561
query18	2183	320	304	304
query19	359	158	151	151
query20	125	120	108	108
query21	206	105	110	105
query22	4678	4590	4326	4326
query23	35285	34246	34167	34167
query24	11079	2849	2923	2849
query25	655	420	403	403
query26	1486	172	164	164
query27	2768	350	339	339
query28	7691	2173	2165	2165
query29	926	456	439	439
query30	257	166	159	159
query31	1033	831	833	831
query32	94	54	59	54
query33	760	322	305	305
query34	972	525	518	518
query35	897	746	760	746
query36	1109	953	974	953
query37	131	72	65	65
query38	4088	4005	4061	4005
query39	1510	1503	1459	1459
query40	266	103	101	101
query41	48	52	51	51
query42	111	95	101	95
query43	533	479	468	468
query44	1333	825	825	825
query45	187	178	166	166
query46	1146	744	745	744
query47	2003	1916	1909	1909
query48	480	376	386	376
query49	1020	381	397	381
query50	821	430	437	430
query51	7489	7212	7345	7212
query52	110	101	98	98
query53	270	200	194	194
query54	1330	481	475	475
query55	88	82	76	76
query56	277	271	258	258
query57	1324	1211	1187	1187
query58	238	216	227	216
query59	3229	3084	3022	3022
query60	301	270	262	262
query61	130	135	127	127
query62	862	708	712	708
query63	221	190	194	190
query64	5701	786	799	786
query65	3394	3351	3288	3288
query66	1424	309	343	309
query67	15945	15382	15440	15382
query68	4766	578	572	572
query69	449	264	257	257
query70	1127	1065	1095	1065
query71	333	249	258	249
query72	6190	3975	4133	3975
query73	764	350	346	346
query74	10266	8960	8829	8829
query75	3418	2634	2649	2634
query76	2612	1150	1103	1103
query77	370	271	265	265
query78	10497	9497	9551	9497
query79	1737	594	605	594
query80	1112	420	416	416
query81	546	220	219	219
query82	897	93	86	86
query83	231	144	143	143
query84	243	77	82	77
query85	1358	303	288	288
query86	416	289	295	289
query87	4359	4278	4250	4250
query88	3715	2406	2375	2375
query89	419	294	292	292
query90	2000	182	184	182
query91	203	153	146	146
query92	64	47	47	47
query93	2428	547	544	544
query94	871	300	301	300
query95	356	263	262	262
query96	604	282	281	281
query97	3284	3117	3122	3117
query98	235	201	197	197
query99	1501	1281	1322	1281
Total cold run time: 305523 ms
Total hot run time: 196650 ms

@doris-robot
Copy link

doris-robot commented Jul 10, 2025

ClickBench: Total hot run time: 30.88 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit cce7239fe8689710c2f6721996012455e2c2c203, data reload: false

query1	0.03	0.03	0.03
query2	0.09	0.04	0.05
query3	0.24	0.06	0.06
query4	1.64	0.07	0.08
query5	0.51	0.51	0.51
query6	1.13	0.73	0.74
query7	0.02	0.01	0.01
query8	0.06	0.05	0.04
query9	0.56	0.50	0.51
query10	0.55	0.55	0.60
query11	0.17	0.12	0.12
query12	0.16	0.13	0.13
query13	0.60	0.60	0.59
query14	0.78	0.80	0.79
query15	0.85	0.84	0.83
query16	0.37	0.37	0.37
query17	0.99	1.05	1.00
query18	0.19	0.17	0.19
query19	1.87	1.76	1.84
query20	0.01	0.01	0.01
query21	15.40	0.67	0.67
query22	4.11	6.59	2.12
query23	18.24	1.38	1.29
query24	2.21	0.22	0.22
query25	0.15	0.08	0.09
query26	0.27	0.18	0.18
query27	0.08	0.08	0.09
query28	13.30	0.58	0.56
query29	12.66	3.34	3.35
query30	0.25	0.06	0.06
query31	2.87	0.41	0.41
query32	3.22	0.49	0.49
query33	2.97	3.01	2.97
query34	16.82	4.46	4.46
query35	4.56	4.54	4.58
query36	0.67	0.49	0.47
query37	0.20	0.16	0.17
query38	0.17	0.15	0.15
query39	0.05	0.04	0.04
query40	0.16	0.13	0.13
query41	0.11	0.05	0.05
query42	0.07	0.06	0.05
query43	0.05	0.05	0.05
Total cold run time: 109.41 s
Total hot run time: 30.88 s

@kaijchen
Copy link
Member Author

kaijchen commented Jul 10, 2025

run cloud_p0

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Jul 11, 2025
@github-actions
Copy link
Contributor

github-actions bot commented Jul 11, 2025

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

github-actions bot commented Jul 11, 2025

PR approved by anyone and no changes requested.

dataroaring
dataroaring approved these changes Jul 11, 2025
View reviewed changes
Copy link
Contributor

@dataroaring dataroaring left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@dataroaring dataroaring merged commit 19b08a0 into apache:branch-3.0 Jul 11, 2025
23 of 26 checks passed
@kaijchen kaijchen mentioned this pull request Jul 16, 2025
Merged
16 tasks
dataroaring pushed a commit that referenced this pull request Jul 18, 2025
@kaijchen
[fix](warmup) fix show warm up tables (#53406)
8a1f679 
### What problem does this PR solve?

Related PR: #52291 #52514

Problem Summary:

Fix show warm up jobs after merging periodic and event driven warmup
feature.
@Hastyshell Hastyshell mentioned this pull request Jul 31, 2025
Merged
16 tasks
dataroaring pushed a commit that referenced this pull request Aug 4, 2025
@Hastyshell
[fix](replica) Get tablet replica infos should return all primary bac…
64a5781 
…kends except for warmup jobs (#54131)

### What problem does this PR solve?

Problem Summary:

Fix logic conflict of #52514 and
#52440

### Release note

None

### Check List (For Author)

- Test <!-- At least one of them must be included. -->
    - [ ] Regression test
    - [ ] Unit Test
    - [ ] Manual test (add detailed scripts or steps below)
    - [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
        - [ ] Previous test can cover this change.
        - [ ] No code files have been changed.
        - [ ] Other reason <!-- Add your reason?  -->

- Behavior changed:
    - [ ] No.
    - [ ] Yes. <!-- Explain the behavior change -->

- Does this need documentation?
    - [ ] No.
- [ ] Yes. <!-- Add document PR link here. eg:
apache/doris-website#1214 -->

### Check List (For Reviewer who merge this PR)

- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label <!-- Add branch pick label that this PR
should merge into -->
@gavinchou gavinchou mentioned this pull request Aug 15, 2025
Open
kaijchen added a commit to kaijchen/doris that referenced this pull request Aug 22, 2025
@kaijchen
[fix](warmup) fix show warm up tables (apache#53406)
6625e00 
### What problem does this PR solve?

Related PR: apache#52291 apache#52514

Problem Summary:

Fix show warm up jobs after merging periodic and event driven warmup
feature.
kaijchen added a commit to kaijchen/doris that referenced this pull request Aug 22, 2025
@kaijchen
[fix](warmup) fix show warm up tables (apache#53406)
ef8ec5d 
Related PR: apache#52291 apache#52514

Problem Summary:

Fix show warm up jobs after merging periodic and event driven warmup
feature.
kaijchen added a commit to kaijchen/doris that referenced this pull request Aug 22, 2025
@kaijchen
[fix](warmup) fix show warm up tables (apache#53406)
5cfb240 
Related PR: apache#52291 apache#52514

Problem Summary:

Fix show warm up jobs after merging periodic and event driven warmup
feature.
@kaijchen kaijchen mentioned this pull request Aug 22, 2025
Merged
16 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@gavinchou gavinchou gavinchou approved these changes

@dataroaring dataroaring dataroaring approved these changes

Assignees

No one assigned

Labels

approved Indicates a PR has been approved by one committer. reviewed

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

6 participants

@kaijchen @Thearas @hello-stephen @doris-robot @gavinchou @dataroaring