Skip to content

branch-3.1: [opt](catalog) remove old properties (#55625 #56163) #56505

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
morningman merged 5 commits into from
Sep 28, 2025
Merged

branch-3.1: [opt](catalog) remove old properties (#55625 #56163) #56505

morningman merged 5 commits into from
Sep 28, 2025

Conversation

@CalvinKirs
Copy link
Member

@CalvinKirs CalvinKirs commented Sep 26, 2025

cherry-pick #55625 #56163

@CalvinKirs
Copy link
Member Author

CalvinKirs commented Sep 26, 2025

run buildall

@hello-stephen
Copy link
Contributor

hello-stephen commented Sep 26, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@doris-robot
Copy link

doris-robot commented Sep 26, 2025

TPC-H: Total hot run time: 32732 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 7bfee8b7ccb0ba3b6dcbba24f77826ebddfd56a0, data reload: false

------ Round 1 ----------------------------------
q1	17592	5461	5460	5460
q2	2028	396	279	279
q3	12250	1252	782	782
q4	10321	862	453	453
q5	9542	2392	2149	2149
q6	190	167	140	140
q7	897	741	638	638
q8	9341	1408	1184	1184
q9	5321	4970	4885	4885
q10	6761	2262	1841	1841
q11	479	282	263	263
q12	340	357	208	208
q13	17759	3633	2987	2987
q14	227	240	208	208
q15	522	478	457	457
q16	422	428	363	363
q17	582	860	358	358
q18	6838	6362	6299	6299
q19	1208	953	533	533
q20	324	343	197	197
q21	2844	2151	2026	2026
q22	1031	1036	1022	1022
Total cold run time: 106819 ms
Total hot run time: 32732 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5504	5465	5534	5465
q2	225	330	231	231
q3	2272	2635	2295	2295
q4	1377	1758	1383	1383
q5	4419	4979	4933	4933
q6	169	165	129	129
q7	2105	1962	1823	1823
q8	2611	2837	2688	2688
q9	7213	7212	7195	7195
q10	3042	3328	2742	2742
q11	569	501	503	501
q12	659	760	602	602
q13	3419	3757	3176	3176
q14	283	299	276	276
q15	515	473	485	473
q16	429	490	419	419
q17	1225	1739	1263	1263
q18	7581	7489	7370	7370
q19	798	1073	1115	1073
q20	2064	2057	1898	1898
q21	5409	4908	4709	4709
q22	1107	1083	1033	1033
Total cold run time: 52995 ms
Total hot run time: 51677 ms

@doris-robot
Copy link

doris-robot commented Sep 26, 2025

TPC-DS: Total hot run time: 193239 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 7bfee8b7ccb0ba3b6dcbba24f77826ebddfd56a0, data reload: false

query1	950	410	404	404
query2	6168	1969	1846	1846
query3	8682	202	192	192
query4	33584	24156	23951	23951
query5	4365	598	470	470
query6	313	186	174	174
query7	4210	485	311	311
query8	303	240	231	231
query9	9252	2647	2635	2635
query10	478	319	267	267
query11	18155	15374	15182	15182
query12	162	106	110	106
query13	1559	528	421	421
query14	9972	6705	7223	6705
query15	244	191	179	179
query16	8110	705	515	515
query17	1531	774	626	626
query18	2138	451	333	333
query19	227	191	171	171
query20	131	138	127	127
query21	207	140	107	107
query22	4756	4820	4364	4364
query23	35765	34745	34127	34127
query24	7790	2708	2707	2707
query25	549	514	437	437
query26	1156	288	174	174
query27	2000	494	377	377
query28	5366	2260	2261	2260
query29	805	588	473	473
query30	252	193	171	171
query31	1017	937	813	813
query32	91	55	57	55
query33	489	360	320	320
query34	771	863	518	518
query35	775	814	769	769
query36	1027	1053	971	971
query37	104	99	68	68
query38	3996	3977	3966	3966
query39	1565	1462	1504	1462
query40	204	122	110	110
query41	62	50	50	50
query42	122	105	98	98
query43	500	507	484	484
query44	1392	840	847	840
query45	187	178	172	172
query46	885	1054	686	686
query47	2021	2020	1953	1953
query48	418	437	348	348
query49	784	507	423	423
query50	665	707	435	435
query51	7229	7346	7242	7242
query52	106	105	99	99
query53	244	262	191	191
query54	541	561	486	486
query55	80	79	78	78
query56	287	268	266	266
query57	1285	1281	1273	1273
query58	244	223	215	215
query59	3048	3183	3105	3105
query60	291	289	275	275
query61	117	112	114	112
query62	831	766	696	696
query63	243	207	206	206
query64	4467	1009	637	637
query65	3361	3319	3308	3308
query66	1078	446	319	319
query67	16678	15922	15723	15723
query68	7684	822	548	548
query69	500	303	290	290
query70	1192	1094	1088	1088
query71	388	310	264	264
query72	5817	3740	3830	3740
query73	628	728	357	357
query74	10267	9404	9230	9230
query75	3218	3168	2671	2671
query76	3121	1192	765	765
query77	658	357	277	277
query78	10460	10435	9620	9620
query79	3631	855	596	596
query80	694	522	429	429
query81	532	254	219	219
query82	573	120	91	91
query83	165	157	150	150
query84	242	100	75	75
query85	786	384	298	298
query86	387	323	320	320
query87	4346	4271	4214	4214
query88	5187	2440	2428	2428
query89	421	332	292	292
query90	1774	197	188	188
query91	140	144	106	106
query92	64	56	52	52
query93	2090	867	543	543
query94	688	398	308	308
query95	351	292	274	274
query96	492	615	289	289
query97	3208	3283	3180	3180
query98	222	218	205	205
query99	1591	1439	1317	1317
Total cold run time: 297902 ms
Total hot run time: 193239 ms

@doris-robot
Copy link

doris-robot commented Sep 26, 2025

ClickBench: Total hot run time: 29.55 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 7bfee8b7ccb0ba3b6dcbba24f77826ebddfd56a0, data reload: false

query1	0.03	0.03	0.03
query2	0.07	0.04	0.03
query3	0.23	0.07	0.07
query4	1.63	0.11	0.11
query5	0.52	0.51	0.52
query6	1.14	0.73	0.73
query7	0.02	0.02	0.02
query8	0.04	0.03	0.03
query9	0.60	0.50	0.51
query10	0.55	0.56	0.55
query11	0.15	0.10	0.10
query12	0.13	0.13	0.11
query13	0.62	0.60	0.60
query14	0.80	0.79	0.80
query15	0.84	0.84	0.83
query16	0.40	0.41	0.40
query17	1.01	1.10	1.05
query18	0.25	0.22	0.22
query19	1.92	1.77	1.85
query20	0.02	0.00	0.02
query21	15.39	0.92	0.58
query22	0.75	0.73	0.68
query23	15.15	1.44	0.59
query24	3.57	1.42	1.99
query25	0.17	0.10	0.10
query26	0.21	0.14	0.14
query27	0.05	0.05	0.04
query28	14.29	0.92	0.43
query29	12.60	4.00	3.32
query30	0.25	0.09	0.06
query31	2.81	0.59	0.37
query32	3.24	0.54	0.47
query33	3.00	3.03	3.04
query34	16.66	5.28	4.51
query35	4.59	4.58	4.59
query36	0.63	0.50	0.48
query37	0.08	0.05	0.06
query38	0.05	0.04	0.04
query39	0.04	0.03	0.02
query40	0.16	0.13	0.12
query41	0.08	0.03	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 104.81 s
Total hot run time: 29.55 s

@CalvinKirs
Copy link
Member Author

CalvinKirs commented Sep 26, 2025

run buildall

@doris-robot
Copy link

doris-robot commented Sep 26, 2025

TPC-H: Total hot run time: 32761 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 0b0ed3771f579ca4f4aed934ff6029bc6c6eea75, data reload: false

------ Round 1 ----------------------------------
q1	17595	5457	5455	5455
q2	2052	288	161	161
q3	10450	1307	718	718
q4	10208	883	451	451
q5	7660	2407	2140	2140
q6	182	164	134	134
q7	890	733	615	615
q8	9334	1452	1228	1228
q9	5395	4920	4895	4895
q10	6760	2258	1816	1816
q11	497	271	264	264
q12	339	353	211	211
q13	17748	3586	3075	3075
q14	220	226	217	217
q15	525	468	456	456
q16	409	424	378	378
q17	580	882	373	373
q18	6976	6450	6445	6445
q19	1220	969	531	531
q20	323	333	201	201
q21	2855	2194	2001	2001
q22	1051	1030	996	996
Total cold run time: 103269 ms
Total hot run time: 32761 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5523	5461	5570	5461
q2	231	337	232	232
q3	2206	2610	2316	2316
q4	1319	1804	1346	1346
q5	4446	4898	5029	4898
q6	181	161	125	125
q7	2086	1966	1789	1789
q8	2624	2796	2732	2732
q9	7180	7193	7185	7185
q10	2963	3278	2793	2793
q11	573	508	519	508
q12	647	788	609	609
q13	3390	3759	3187	3187
q14	281	298	270	270
q15	520	469	464	464
q16	452	499	458	458
q17	1238	1738	1248	1248
q18	7606	7585	7457	7457
q19	774	1104	1066	1066
q20	1962	2061	1882	1882
q21	5307	4945	4717	4717
q22	1097	1116	1048	1048
Total cold run time: 52606 ms
Total hot run time: 51791 ms

@doris-robot
Copy link

doris-robot commented Sep 26, 2025

TPC-DS: Total hot run time: 191009 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 0b0ed3771f579ca4f4aed934ff6029bc6c6eea75, data reload: false

query1	978	392	395	392
query2	6542	1948	1858	1858
query3	6701	215	228	215
query4	34255	23843	23263	23263
query5	4420	638	459	459
query6	289	222	188	188
query7	4645	502	322	322
query8	298	243	249	243
query9	9538	2649	2625	2625
query10	479	341	265	265
query11	18421	15419	15507	15419
query12	161	108	109	108
query13	1652	533	417	417
query14	9268	7539	6745	6745
query15	233	197	182	182
query16	8072	653	513	513
query17	1811	770	604	604
query18	2178	417	337	337
query19	223	215	169	169
query20	129	122	122	122
query21	215	144	109	109
query22	4898	4690	4519	4519
query23	34966	33460	33896	33460
query24	7193	2664	2653	2653
query25	483	453	395	395
query26	1218	275	170	170
query27	2469	446	335	335
query28	5620	2199	2165	2165
query29	752	560	444	444
query30	269	190	155	155
query31	935	880	798	798
query32	86	62	56	56
query33	517	360	311	311
query34	739	822	520	520
query35	765	782	719	719
query36	997	1040	916	916
query37	108	99	68	68
query38	3938	3869	3869	3869
query39	1489	1417	1413	1413
query40	212	120	103	103
query41	48	46	47	46
query42	117	107	110	107
query43	504	516	496	496
query44	1335	795	795	795
query45	183	177	167	167
query46	856	1035	679	679
query47	1891	1931	1834	1834
query48	408	427	341	341
query49	794	508	413	413
query50	671	681	428	428
query51	7178	7185	7121	7121
query52	102	106	93	93
query53	227	252	188	188
query54	533	536	473	473
query55	80	82	79	79
query56	269	275	256	256
query57	1225	1225	1180	1180
query58	241	225	238	225
query59	2924	3040	2941	2941
query60	289	293	272	272
query61	112	112	108	108
query62	792	736	693	693
query63	229	198	195	195
query64	4488	975	657	657
query65	3316	3256	3213	3213
query66	1057	414	307	307
query67	15838	15768	15709	15709
query68	2354	857	590	590
query69	421	323	279	279
query70	1132	1087	1130	1087
query71	365	300	277	277
query72	5644	3767	4135	3767
query73	612	747	362	362
query74	10108	9336	8890	8890
query75	3155	3184	2713	2713
query76	2220	1169	793	793
query77	426	379	285	285
query78	10491	10335	9592	9592
query79	2912	886	612	612
query80	913	565	485	485
query81	527	263	231	231
query82	728	127	93	93
query83	173	167	159	159
query84	256	112	89	89
query85	863	441	405	405
query86	443	319	300	300
query87	4337	4298	4236	4236
query88	5181	2438	2386	2386
query89	397	340	302	302
query90	1845	190	192	190
query91	141	145	113	113
query92	63	59	52	52
query93	2709	933	549	549
query94	776	413	261	261
query95	358	278	270	270
query96	488	613	293	293
query97	3210	3294	3191	3191
query98	234	208	194	194
query99	1342	1401	1323	1323
Total cold run time: 288693 ms
Total hot run time: 191009 ms

@doris-robot
Copy link

doris-robot commented Sep 26, 2025

ClickBench: Total hot run time: 28.62 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 0b0ed3771f579ca4f4aed934ff6029bc6c6eea75, data reload: false

query1	0.03	0.03	0.03
query2	0.07	0.03	0.03
query3	0.23	0.07	0.06
query4	1.61	0.11	0.10
query5	0.50	0.51	0.51
query6	1.12	0.73	0.73
query7	0.02	0.02	0.02
query8	0.05	0.04	0.03
query9	0.56	0.51	0.50
query10	0.55	0.56	0.56
query11	0.15	0.10	0.13
query12	0.14	0.11	0.12
query13	0.62	0.59	0.59
query14	0.77	0.82	0.80
query15	0.86	0.82	0.83
query16	0.38	0.38	0.39
query17	1.09	1.00	1.01
query18	0.24	0.22	0.22
query19	1.99	1.80	1.94
query20	0.02	0.01	0.01
query21	15.39	0.98	0.59
query22	0.75	0.78	0.55
query23	15.27	1.38	0.56
query24	2.84	1.70	0.77
query25	0.14	0.11	0.07
query26	0.27	0.15	0.13
query27	0.05	0.05	0.05
query28	13.37	1.01	0.44
query29	12.56	3.99	3.27
query30	0.25	0.09	0.07
query31	2.83	0.59	0.36
query32	3.22	0.54	0.47
query33	3.05	2.99	3.07
query34	16.60	5.22	4.53
query35	4.60	4.62	4.57
query36	0.63	0.50	0.49
query37	0.09	0.06	0.06
query38	0.05	0.04	0.03
query39	0.04	0.02	0.02
query40	0.18	0.14	0.13
query41	0.08	0.02	0.02
query42	0.03	0.03	0.02
query43	0.03	0.03	0.03
Total cold run time: 103.32 s
Total hot run time: 28.62 s

@morningman morningman merged commit 8d2288d into apache:branch-3.1 Sep 28, 2025
22 checks passed
@morrySnow morrySnow mentioned this pull request Oct 23, 2025
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@morrySnow morrySnow morrySnow approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

5 participants

@CalvinKirs @hello-stephen @doris-robot @morrySnow @morningman