Skip to content

Conversation

@yujun777
Copy link
Contributor

cherry pick from #51546

@yujun777 yujun777 requested a review from dataroaring as a code owner June 16, 2025 02:43
@yujun777
Copy link
Contributor Author

run buildall

@Thearas
Copy link
Contributor

Thearas commented Jun 16, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@yujun777
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39783 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c9a224f0df808f3f8715b7268dbcc0ad83fc78b9, data reload: false

------ Round 1 ----------------------------------
q1	18055	7030	6554	6554
q2	2071	182	199	182
q3	10624	1096	1179	1096
q4	11193	832	795	795
q5	7848	2874	2813	2813
q6	213	135	130	130
q7	966	618	609	609
q8	9342	1942	1990	1942
q9	6510	6366	6410	6366
q10	7045	2261	2314	2261
q11	464	262	261	261
q12	408	212	212	212
q13	17813	3010	2970	2970
q14	239	219	207	207
q15	503	454	464	454
q16	488	375	379	375
q17	976	524	527	524
q18	7280	6730	6735	6730
q19	1457	1044	1059	1044
q20	459	213	209	209
q21	3920	3159	3076	3076
q22	1092	975	973	973
Total cold run time: 108966 ms
Total hot run time: 39783 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6613	6649	6536	6536
q2	329	240	232	232
q3	2946	2760	2986	2760
q4	2025	1851	1783	1783
q5	5782	5736	5728	5728
q6	210	127	132	127
q7	2217	1789	1802	1789
q8	3373	3585	3497	3497
q9	8980	8716	8931	8716
q10	3593	3495	3522	3495
q11	595	489	496	489
q12	827	584	590	584
q13	9896	3123	3152	3123
q14	300	279	268	268
q15	516	479	475	475
q16	486	433	442	433
q17	1826	1633	1613	1613
q18	8228	7731	7732	7731
q19	1708	1505	1448	1448
q20	2127	1902	1877	1877
q21	4985	5013	5047	5013
q22	1108	1027	1061	1027
Total cold run time: 68670 ms
Total hot run time: 58744 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 195469 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit c9a224f0df808f3f8715b7268dbcc0ad83fc78b9, data reload: false

query1	1269	891	925	891
query2	6386	2035	1925	1925
query3	10865	4346	4180	4180
query4	61344	28805	23642	23642
query5	5252	473	451	451
query6	430	183	183	183
query7	5522	326	313	313
query8	314	250	228	228
query9	8724	2621	2653	2621
query10	455	276	260	260
query11	17382	15242	15737	15242
query12	170	105	106	105
query13	1432	452	448	448
query14	9779	6783	6693	6693
query15	198	174	182	174
query16	7182	448	480	448
query17	1241	584	587	584
query18	1935	327	318	318
query19	215	160	158	158
query20	117	111	113	111
query21	207	101	104	101
query22	4668	4424	4782	4424
query23	35051	34162	34541	34162
query24	7025	2969	2933	2933
query25	574	439	451	439
query26	692	170	167	167
query27	2328	376	362	362
query28	4552	2149	2170	2149
query29	704	451	436	436
query30	238	156	160	156
query31	976	803	823	803
query32	65	58	54	54
query33	422	300	312	300
query34	932	524	525	524
query35	843	735	723	723
query36	1065	950	970	950
query37	118	69	69	69
query38	4022	4013	3948	3948
query39	1518	1481	1461	1461
query40	204	96	108	96
query41	51	53	48	48
query42	116	101	100	100
query43	550	514	495	495
query44	1175	829	840	829
query45	187	169	167	167
query46	1153	730	745	730
query47	2067	1926	1931	1926
query48	483	416	407	407
query49	740	413	407	407
query50	843	427	425	425
query51	7443	7329	7368	7329
query52	105	88	90	88
query53	273	192	184	184
query54	584	460	468	460
query55	79	80	79	79
query56	261	255	254	254
query57	1367	1220	1201	1201
query58	219	209	216	209
query59	3275	3238	3079	3079
query60	278	266	257	257
query61	106	103	106	103
query62	781	684	687	684
query63	219	187	188	187
query64	1368	658	629	629
query65	3293	3167	3219	3167
query66	701	294	306	294
query67	16100	15563	15696	15563
query68	4331	605	595	595
query69	425	260	270	260
query70	1176	1098	1064	1064
query71	354	255	261	255
query72	6400	3901	2433	2433
query73	763	345	350	345
query74	9446	9298	8920	8920
query75	3332	2652	2670	2652
query76	1988	1089	1059	1059
query77	493	289	268	268
query78	10542	9614	9569	9569
query79	1822	594	609	594
query80	1064	429	443	429
query81	502	222	219	219
query82	171	90	90	90
query83	159	154	142	142
query84	281	77	85	77
query85	957	295	291	291
query86	372	292	303	292
query87	4437	4331	4222	4222
query88	3785	2456	2433	2433
query89	414	294	304	294
query90	1989	188	180	180
query91	178	150	152	150
query92	64	50	50	50
query93	2501	560	560	560
query94	783	296	285	285
query95	353	258	250	250
query96	625	282	279	279
query97	3328	3195	3203	3195
query98	219	211	197	197
query99	1633	1314	1287	1287
Total cold run time: 315120 ms
Total hot run time: 195469 ms

@yujun777
Copy link
Contributor Author

run performance

@yujun777
Copy link
Contributor Author

run checkstyle

@doris-robot
Copy link

TPC-H: Total hot run time: 41069 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c9a224f0df808f3f8715b7268dbcc0ad83fc78b9, data reload: false

------ Round 1 ----------------------------------
q1	17631	7086	6579	6579
q2	2095	205	181	181
q3	10493	1211	1239	1211
q4	10215	859	810	810
q5	7776	2935	2836	2836
q6	231	136	135	135
q7	1025	644	638	638
q8	9374	2000	2088	2000
q9	6904	6523	6528	6523
q10	7142	2341	2363	2341
q11	503	297	298	297
q12	507	235	234	234
q13	17830	3038	3091	3038
q14	264	235	223	223
q15	521	499	461	461
q16	529	413	403	403
q17	1023	601	630	601
q18	7663	6930	6793	6793
q19	1455	1109	1141	1109
q20	516	242	241	241
q21	4135	3349	3355	3349
q22	1173	1070	1066	1066
Total cold run time: 109005 ms
Total hot run time: 41069 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6516	6509	6516	6509
q2	343	245	243	243
q3	2955	2797	2812	2797
q4	2012	1772	1776	1772
q5	5469	5532	5533	5532
q6	211	129	129	129
q7	2188	1797	1777	1777
q8	3305	3446	3493	3446
q9	8654	8601	8635	8601
q10	3541	3482	3449	3449
q11	634	517	513	513
q12	792	598	611	598
q13	12614	3027	3041	3027
q14	290	266	269	266
q15	516	464	462	462
q16	495	451	458	451
q17	1831	1589	1590	1589
q18	7963	7417	7616	7417
q19	1679	1611	1532	1532
q20	2101	1869	1886	1869
q21	5435	5216	5129	5129
q22	1163	1085	1084	1084
Total cold run time: 70707 ms
Total hot run time: 58192 ms

@yujun777
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39998 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c9a224f0df808f3f8715b7268dbcc0ad83fc78b9, data reload: false

------ Round 1 ----------------------------------
q1	17586	6793	6546	6546
q2	2073	176	189	176
q3	10593	1091	1191	1091
q4	10558	785	737	737
q5	7761	2834	2865	2834
q6	217	136	136	136
q7	982	647	622	622
q8	9370	1960	2010	1960
q9	6534	6335	6382	6335
q10	7048	2291	2314	2291
q11	487	275	273	273
q12	414	231	219	219
q13	17783	3024	3048	3024
q14	238	218	214	214
q15	505	474	471	471
q16	503	392	381	381
q17	977	585	554	554
q18	7248	6644	6724	6644
q19	1405	1101	1077	1077
q20	478	210	215	210
q21	4014	3190	3348	3190
q22	1129	1013	1013	1013
Total cold run time: 107903 ms
Total hot run time: 39998 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6638	6649	6571	6571
q2	326	234	250	234
q3	2889	2787	2928	2787
q4	2048	1823	1780	1780
q5	5976	5744	5692	5692
q6	210	130	130	130
q7	2210	1841	1842	1841
q8	3374	3553	3500	3500
q9	8921	8777	9019	8777
q10	3616	3541	3530	3530
q11	613	485	501	485
q12	802	604	600	600
q13	10131	3197	3153	3153
q14	304	267	285	267
q15	510	483	466	466
q16	501	445	441	441
q17	1843	1634	1610	1610
q18	8188	7796	7802	7796
q19	1707	1650	1404	1404
q20	2130	1905	1884	1884
q21	5225	5251	5139	5139
q22	1123	1078	1091	1078
Total cold run time: 69285 ms
Total hot run time: 59165 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 199310 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit c9a224f0df808f3f8715b7268dbcc0ad83fc78b9, data reload: false

query1	1287	926	923	923
query2	6381	2013	2019	2013
query3	10946	4495	4461	4461
query4	61764	28986	23447	23447
query5	5251	499	467	467
query6	433	185	190	185
query7	5492	346	344	344
query8	317	234	234	234
query9	8786	2769	2760	2760
query10	483	291	286	286
query11	17603	15647	15993	15647
query12	169	107	105	105
query13	1483	486	443	443
query14	10598	7730	6803	6803
query15	203	188	188	188
query16	7106	496	543	496
query17	1174	600	636	600
query18	1908	347	330	330
query19	226	175	169	169
query20	121	123	117	117
query21	206	107	113	107
query22	4809	4515	4568	4515
query23	34398	34072	34284	34072
query24	6168	2953	2976	2953
query25	541	437	452	437
query26	666	210	178	178
query27	1832	399	366	366
query28	4013	2305	2283	2283
query29	694	465	452	452
query30	259	153	164	153
query31	961	815	829	815
query32	70	57	62	57
query33	482	306	316	306
query34	959	533	540	533
query35	851	736	730	730
query36	1122	1008	1009	1008
query37	113	71	72	71
query38	4037	3974	3906	3906
query39	1738	1497	1514	1497
query40	206	98	100	98
query41	51	52	49	49
query42	117	108	106	106
query43	568	516	529	516
query44	1211	856	859	856
query45	184	169	171	169
query46	1169	765	771	765
query47	2022	1893	1921	1893
query48	500	407	431	407
query49	731	434	422	422
query50	862	453	457	453
query51	7650	7258	7363	7258
query52	116	99	98	98
query53	280	187	194	187
query54	610	510	505	505
query55	82	82	90	82
query56	271	280	268	268
query57	1332	1209	1213	1209
query58	224	226	219	219
query59	3409	3278	3145	3145
query60	282	281	284	281
query61	110	106	112	106
query62	784	661	671	661
query63	228	193	193	193
query64	1372	673	634	634
query65	3246	3211	3194	3194
query66	695	295	298	295
query67	16128	15571	15708	15571
query68	4183	625	654	625
query69	455	292	280	280
query70	1197	1189	1183	1183
query71	357	279	266	266
query72	6356	4096	4002	4002
query73	762	374	376	374
query74	10587	9028	9050	9028
query75	3361	2658	2705	2658
query76	1988	1069	1039	1039
query77	535	301	298	298
query78	10676	9605	9622	9605
query79	1820	636	641	636
query80	1182	433	441	433
query81	519	221	224	221
query82	1279	98	93	93
query83	268	148	151	148
query84	284	89	84	84
query85	949	319	294	294
query86	387	297	315	297
query87	4461	4271	4277	4271
query88	3823	2610	2571	2571
query89	423	293	300	293
query90	1998	194	189	189
query91	183	155	153	153
query92	71	52	51	51
query93	1967	591	578	578
query94	747	307	297	297
query95	368	265	277	265
query96	639	296	301	296
query97	3351	3163	3183	3163
query98	215	205	204	204
query99	1616	1321	1318	1318
Total cold run time: 317097 ms
Total hot run time: 199310 ms

@yujun777
Copy link
Contributor Author

run performance

@yujun777 yujun777 closed this Jun 17, 2025
@yujun777 yujun777 reopened this Jun 17, 2025
@yujun777
Copy link
Contributor Author

run performance

@doris-robot
Copy link

TPC-H: Total hot run time: 40274 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c9a224f0df808f3f8715b7268dbcc0ad83fc78b9, data reload: false

------ Round 1 ----------------------------------
q1	17577	6711	6556	6556
q2	2047	170	185	170
q3	10601	1070	1149	1070
q4	10559	758	774	758
q5	7764	2902	2807	2807
q6	215	133	133	133
q7	965	612	606	606
q8	9363	1950	2019	1950
q9	6618	6380	6413	6380
q10	6997	2268	2300	2268
q11	477	275	267	267
q12	399	217	212	212
q13	17918	3142	3200	3142
q14	256	213	223	213
q15	498	455	456	455
q16	501	400	386	386
q17	990	576	587	576
q18	7398	6937	6935	6935
q19	1393	1128	1121	1121
q20	467	212	214	212
q21	4020	3136	3076	3076
q22	1083	1005	981	981
Total cold run time: 108106 ms
Total hot run time: 40274 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6574	6580	6556	6556
q2	325	237	230	230
q3	2918	2754	2880	2754
q4	2033	1807	1836	1807
q5	5776	5771	5698	5698
q6	209	130	127	127
q7	2221	1817	1828	1817
q8	3346	3593	3544	3544
q9	8911	8777	8907	8777
q10	3565	3513	3497	3497
q11	572	499	508	499
q12	794	612	583	583
q13	9240	3133	3211	3133
q14	315	271	263	263
q15	512	453	458	453
q16	483	450	449	449
q17	1830	1610	1603	1603
q18	8426	7910	7823	7823
q19	1703	1687	1630	1630
q20	2120	1803	1839	1803
q21	5087	4988	5016	4988
q22	1131	1078	1040	1040
Total cold run time: 68091 ms
Total hot run time: 59074 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 196806 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit c9a224f0df808f3f8715b7268dbcc0ad83fc78b9, data reload: false

query1	1292	910	900	900
query2	6268	2025	1971	1971
query3	10844	4339	4201	4201
query4	61526	28939	23431	23431
query5	5177	453	444	444
query6	391	185	185	185
query7	5452	331	310	310
query8	315	224	220	220
query9	8223	2588	2586	2586
query10	460	262	248	248
query11	17507	15155	15834	15155
query12	158	104	107	104
query13	1418	441	423	423
query14	10786	6652	7137	6652
query15	208	175	191	175
query16	7234	504	486	486
query17	1166	582	577	577
query18	1929	323	319	319
query19	212	175	163	163
query20	117	108	110	108
query21	210	104	106	104
query22	4701	4585	4426	4426
query23	34916	33770	33801	33770
query24	6214	2994	3035	2994
query25	559	438	444	438
query26	677	176	175	175
query27	1851	371	362	362
query28	4140	2141	2178	2141
query29	715	484	455	455
query30	243	163	168	163
query31	1014	789	842	789
query32	70	58	58	58
query33	423	308	319	308
query34	964	556	523	523
query35	890	743	782	743
query36	1106	957	959	957
query37	116	68	67	67
query38	4063	4058	4010	4010
query39	1690	1469	1521	1469
query40	203	102	99	99
query41	50	50	47	47
query42	111	109	105	105
query43	558	515	501	501
query44	1223	803	809	803
query45	182	169	174	169
query46	1195	755	720	720
query47	2004	1907	1951	1907
query48	489	393	409	393
query49	728	412	411	411
query50	889	435	430	430
query51	7516	7261	7320	7261
query52	102	91	89	89
query53	264	185	192	185
query54	576	457	477	457
query55	80	74	75	74
query56	258	263	247	247
query57	1341	1211	1223	1211
query58	227	211	214	211
query59	3301	3207	3169	3169
query60	290	259	264	259
query61	115	134	106	106
query62	800	703	707	703
query63	222	193	190	190
query64	1387	670	642	642
query65	3270	3199	3202	3199
query66	718	296	292	292
query67	16092	15663	15485	15485
query68	4300	587	563	563
query69	445	272	271	271
query70	1206	1136	1169	1136
query71	370	245	262	245
query72	6337	4211	4058	4058
query73	805	347	361	347
query74	10493	9033	9467	9033
query75	3419	2688	2676	2676
query76	1983	1182	1195	1182
query77	519	264	268	264
query78	10727	9553	9522	9522
query79	1475	604	597	597
query80	881	431	432	431
query81	496	223	225	223
query82	1267	96	87	87
query83	250	152	146	146
query84	278	81	75	75
query85	894	306	287	287
query86	334	296	291	291
query87	4428	4280	4281	4280
query88	3631	2430	2419	2419
query89	431	302	286	286
query90	1968	191	190	190
query91	182	152	151	151
query92	70	52	48	48
query93	1925	552	558	552
query94	750	289	297	289
query95	352	266	254	254
query96	648	290	283	283
query97	3314	3143	3171	3143
query98	212	211	194	194
query99	1573	1311	1308	1308
Total cold run time: 315399 ms
Total hot run time: 196806 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.37 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit c9a224f0df808f3f8715b7268dbcc0ad83fc78b9, data reload: false

query1	0.04	0.03	0.03
query2	0.07	0.03	0.02
query3	0.24	0.06	0.06
query4	1.62	0.10	0.10
query5	0.53	0.52	0.52
query6	1.13	0.72	0.74
query7	0.02	0.02	0.01
query8	0.05	0.03	0.03
query9	0.57	0.50	0.49
query10	0.56	0.55	0.56
query11	0.14	0.10	0.10
query12	0.14	0.12	0.12
query13	0.60	0.60	0.61
query14	0.79	0.78	0.81
query15	0.86	0.83	0.82
query16	0.39	0.38	0.39
query17	1.08	1.05	1.01
query18	0.24	0.23	0.23
query19	1.94	1.82	1.80
query20	0.01	0.01	0.01
query21	15.39	0.63	0.59
query22	2.93	1.75	2.38
query23	16.94	0.97	0.88
query24	3.30	1.89	1.06
query25	0.20	0.14	0.20
query26	0.55	0.14	0.15
query27	0.04	0.05	0.04
query28	9.29	0.56	0.53
query29	12.57	3.22	3.23
query30	0.24	0.06	0.06
query31	2.86	0.38	0.40
query32	3.23	0.46	0.46
query33	3.02	3.02	2.99
query34	17.10	4.47	4.46
query35	4.48	4.52	4.52
query36	0.68	0.49	0.48
query37	0.09	0.06	0.06
query38	0.05	0.03	0.03
query39	0.04	0.03	0.02
query40	0.17	0.13	0.12
query41	0.08	0.03	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.02
Total cold run time: 104.34 s
Total hot run time: 30.37 s

Copy link
Contributor

@dataroaring dataroaring left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added approved Indicates a PR has been approved by one committer. reviewed labels Jun 18, 2025
@github-actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@dataroaring dataroaring merged commit 2404371 into apache:branch-3.0 Jun 18, 2025
25 of 27 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants