Skip to content

branch-3.1: [feat](table) let compress type be configable #56074 #56276

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
morrySnow merged 1 commit into from
Sep 25, 2025
Merged

branch-3.1: [feat](table) let compress type be configable #56074 #56276

morrySnow merged 1 commit into from
Sep 25, 2025

Conversation

@github-actions
Copy link
Contributor

@github-actions github-actions bot commented Sep 22, 2025

Cherry-picked from #56074

@github-actions github-actions bot requested a review from morrySnow as a code owner September 22, 2025 02:50
@Thearas
Copy link
Contributor

Thearas commented Sep 22, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@dataroaring dataroaring reopened this Sep 22, 2025
@Thearas
Copy link
Contributor

Thearas commented Sep 22, 2025

run buildall

@doris-robot
Copy link

doris-robot commented Sep 22, 2025

TPC-H: Total hot run time: 32652 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit eed2d715cbf764cc29d1521bbd7a70df08b74a1a, data reload: false

------ Round 1 ----------------------------------
q1	17610	5424	5428	5424
q2	2039	418	281	281
q3	12284	1254	770	770
q4	10482	883	462	462
q5	9586	2390	2136	2136
q6	193	166	131	131
q7	894	732	613	613
q8	9332	1420	1148	1148
q9	5308	4951	4947	4947
q10	6752	2253	1865	1865
q11	455	273	257	257
q12	335	355	208	208
q13	17774	3626	3029	3029
q14	232	220	207	207
q15	527	473	458	458
q16	420	421	365	365
q17	626	866	366	366
q18	6903	6336	6282	6282
q19	1337	970	568	568
q20	324	344	206	206
q21	2875	2223	1964	1964
q22	1023	1035	965	965
Total cold run time: 107311 ms
Total hot run time: 32652 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5522	5472	5520	5472
q2	241	335	246	246
q3	2195	2639	2331	2331
q4	1406	1807	1399	1399
q5	4407	5006	4964	4964
q6	167	169	129	129
q7	2071	1997	1882	1882
q8	2674	2848	2681	2681
q9	7246	7213	7238	7213
q10	3017	3342	2744	2744
q11	558	501	498	498
q12	642	775	577	577
q13	3428	3832	3139	3139
q14	273	293	265	265
q15	507	459	470	459
q16	430	482	433	433
q17	1219	1724	1235	1235
q18	7556	7382	7278	7278
q19	782	1102	1082	1082
q20	1970	2049	1883	1883
q21	5322	5011	4688	4688
q22	1066	1028	983	983
Total cold run time: 52699 ms
Total hot run time: 51581 ms

@doris-robot
Copy link

doris-robot commented Sep 22, 2025

TPC-DS: Total hot run time: 192822 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit eed2d715cbf764cc29d1521bbd7a70df08b74a1a, data reload: false

query1	946	408	389	389
query2	6255	1928	1843	1843
query3	8687	196	190	190
query4	33570	23697	23571	23571
query5	3686	602	446	446
query6	293	197	170	170
query7	4211	501	319	319
query8	308	248	241	241
query9	9526	2610	2584	2584
query10	481	322	272	272
query11	18469	15461	15612	15461
query12	159	107	102	102
query13	1544	560	436	436
query14	10011	7509	6818	6818
query15	239	189	181	181
query16	8052	648	504	504
query17	1578	792	613	613
query18	2117	418	328	328
query19	244	189	164	164
query20	125	117	120	117
query21	206	134	110	110
query22	4609	4547	4447	4447
query23	35261	34090	34266	34090
query24	7608	2692	2718	2692
query25	552	504	435	435
query26	816	291	180	180
query27	2235	481	372	372
query28	5038	2260	2212	2212
query29	729	603	472	472
query30	238	196	163	163
query31	976	917	826	826
query32	83	63	60	60
query33	503	377	327	327
query34	749	885	507	507
query35	790	805	728	728
query36	1026	1058	961	961
query37	103	93	69	69
query38	4019	4017	4009	4009
query39	1531	1505	1467	1467
query40	200	117	114	114
query41	53	48	47	47
query42	133	112	112	112
query43	493	511	467	467
query44	1335	844	831	831
query45	184	182	174	174
query46	884	1071	678	678
query47	1982	1979	1906	1906
query48	414	433	354	354
query49	747	503	407	407
query50	688	705	433	433
query51	7431	7253	7313	7253
query52	104	96	92	92
query53	229	255	187	187
query54	552	556	468	468
query55	77	75	83	75
query56	287	268	251	251
query57	1258	1281	1222	1222
query58	247	212	214	212
query59	3159	3081	2945	2945
query60	300	289	280	280
query61	134	109	116	109
query62	808	735	712	712
query63	230	190	206	190
query64	3697	1040	639	639
query65	3352	3290	3278	3278
query66	834	428	315	315
query67	16342	15607	15591	15591
query68	7567	826	549	549
query69	503	301	261	261
query70	1131	1138	1129	1129
query71	369	308	266	266
query72	5723	3882	3802	3802
query73	640	745	357	357
query74	10401	9469	9176	9176
query75	3138	3135	2683	2683
query76	2973	1171	785	785
query77	546	370	271	271
query78	10397	10438	9737	9737
query79	3185	895	595	595
query80	699	525	447	447
query81	511	260	218	218
query82	589	117	89	89
query83	180	156	138	138
query84	283	103	81	81
query85	781	379	298	298
query86	399	314	305	305
query87	4300	4341	4299	4299
query88	5065	2411	2403	2403
query89	411	342	297	297
query90	1768	187	185	185
query91	139	142	110	110
query92	71	57	52	52
query93	1991	913	567	567
query94	690	419	307	307
query95	340	285	276	276
query96	495	613	280	280
query97	3165	3318	3122	3122
query98	224	203	197	197
query99	1513	1383	1322	1322
Total cold run time: 293914 ms
Total hot run time: 192822 ms

@doris-robot
Copy link

doris-robot commented Sep 22, 2025

ClickBench: Total hot run time: 28.9 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit eed2d715cbf764cc29d1521bbd7a70df08b74a1a, data reload: false

query1	0.04	0.03	0.02
query2	0.07	0.03	0.03
query3	0.24	0.07	0.06
query4	1.61	0.11	0.11
query5	0.53	0.53	0.53
query6	1.13	0.73	0.73
query7	0.02	0.01	0.01
query8	0.04	0.03	0.04
query9	0.57	0.50	0.49
query10	0.59	0.55	0.55
query11	0.15	0.10	0.10
query12	0.14	0.11	0.11
query13	0.62	0.60	0.60
query14	0.78	0.81	0.80
query15	0.85	0.84	0.83
query16	0.42	0.42	0.41
query17	1.07	1.06	1.10
query18	0.24	0.22	0.22
query19	1.91	1.89	1.78
query20	0.02	0.00	0.02
query21	15.40	0.93	0.58
query22	0.74	0.80	0.81
query23	14.99	1.45	0.51
query24	3.34	1.12	0.75
query25	0.14	0.07	0.16
query26	0.35	0.15	0.14
query27	0.05	0.04	0.05
query28	13.26	1.03	0.44
query29	12.60	3.92	3.28
query30	0.26	0.09	0.06
query31	2.83	0.60	0.39
query32	3.23	0.54	0.47
query33	2.99	3.02	3.05
query34	16.72	5.13	4.55
query35	4.62	4.60	4.56
query36	0.65	0.50	0.47
query37	0.09	0.06	0.06
query38	0.05	0.04	0.03
query39	0.04	0.02	0.02
query40	0.16	0.14	0.12
query41	0.08	0.03	0.02
query42	0.03	0.02	0.02
query43	0.03	0.04	0.03
Total cold run time: 103.69 s
Total hot run time: 28.9 s

@hello-stephen
Copy link
Contributor

hello-stephen commented Sep 22, 2025

FE UT Coverage Report

Increment line coverage 56.25% (9/16) 🎉
Increment coverage report
Complete coverage report

@morrySnow morrySnow merged commit 29fb03f into branch-3.1 Sep 25, 2025
23 checks passed
@morrySnow morrySnow deleted the auto-pick-56074-branch-3.1 branch September 25, 2025 09:22
@morrySnow morrySnow mentioned this pull request Oct 23, 2025
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@morrySnow morrySnow morrySnow approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

6 participants

@Thearas @doris-robot @hello-stephen @morrySnow @dataroaring