Skip to content

Conversation

@deardeng
Copy link
Contributor

@deardeng deardeng commented Aug 4, 2025

cherry pick from #54227

Fix
1. cloud_decommission increased it robustness
2. test_cloud_full_compaction_multi_segments,
test_cloud_mow_retry_txn_interleave, test_cloud_concurrent_calc_dbm_task
fix its not set fe debug point
3. fix CloudTablet.capture_rs_readers.return.e-230 debug point not work,
due to apache#52440,
@deardeng
Copy link
Contributor Author

deardeng commented Aug 4, 2025

run buildall

@deardeng deardeng requested a review from morrySnow as a code owner August 4, 2025 02:26
@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@doris-robot
Copy link

TPC-H: Total hot run time: 32416 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ebf3a6a94af19fbca73f118979a39173d0e39de4, data reload: false

------ Round 1 ----------------------------------
q1	17587	5419	5481	5419
q2	2060	301	161	161
q3	10633	1235	754	754
q4	10318	919	454	454
q5	9548	2337	2104	2104
q6	199	162	135	135
q7	900	733	611	611
q8	9336	1407	1089	1089
q9	5287	4917	4882	4882
q10	6752	2285	1838	1838
q11	481	273	254	254
q12	331	354	211	211
q13	17776	3600	3047	3047
q14	217	228	209	209
q15	533	467	457	457
q16	415	430	367	367
q17	612	861	367	367
q18	6895	6387	6422	6387
q19	1337	940	547	547
q20	322	323	208	208
q21	2971	2188	1932	1932
q22	1029	1013	983	983
Total cold run time: 105539 ms
Total hot run time: 32416 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5564	5461	5500	5461
q2	241	325	244	244
q3	2212	2653	2337	2337
q4	1371	1820	1316	1316
q5	4366	4913	4909	4909
q6	170	164	128	128
q7	2026	1952	1855	1855
q8	2579	2756	2658	2658
q9	7264	7160	7261	7160
q10	3020	3342	2760	2760
q11	565	496	502	496
q12	634	740	590	590
q13	3416	3854	3165	3165
q14	297	316	271	271
q15	521	477	457	457
q16	440	494	441	441
q17	1240	1727	1247	1247
q18	7591	7490	7321	7321
q19	784	1120	1098	1098
q20	1992	2078	1892	1892
q21	5395	4766	4639	4639
q22	1111	1066	977	977
Total cold run time: 52799 ms
Total hot run time: 51422 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 197969 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ebf3a6a94af19fbca73f118979a39173d0e39de4, data reload: false

query1	1322	965	897	897
query2	6246	1927	1945	1927
query3	10904	4419	4515	4419
query4	33198	24200	23910	23910
query5	4760	620	455	455
query6	289	196	179	179
query7	4018	493	321	321
query8	294	237	228	228
query9	9223	2577	2555	2555
query10	492	337	265	265
query11	18136	15452	15164	15164
query12	154	110	105	105
query13	1573	546	432	432
query14	10496	7421	7491	7421
query15	218	197	186	186
query16	7824	687	530	530
query17	1570	761	615	615
query18	2063	437	324	324
query19	236	213	165	165
query20	126	119	121	119
query21	200	125	113	113
query22	4631	4590	4436	4436
query23	34833	33984	34345	33984
query24	7643	2762	2743	2743
query25	495	511	438	438
query26	1140	271	180	180
query27	2216	494	360	360
query28	5341	2230	2187	2187
query29	601	586	497	497
query30	245	203	170	170
query31	985	920	878	878
query32	68	60	60	60
query33	495	357	321	321
query34	773	866	551	551
query35	790	821	716	716
query36	1053	1066	968	968
query37	121	92	66	66
query38	4020	4072	3986	3986
query39	1532	1476	1490	1476
query40	209	123	105	105
query41	51	51	49	49
query42	136	109	110	109
query43	498	529	497	497
query44	1419	827	854	827
query45	185	175	170	170
query46	888	1064	683	683
query47	1916	1961	1919	1919
query48	408	424	359	359
query49	773	516	426	426
query50	691	711	437	437
query51	7416	7374	7359	7359
query52	97	103	97	97
query53	241	260	195	195
query54	571	577	458	458
query55	86	84	79	79
query56	271	268	263	263
query57	1262	1289	1192	1192
query58	235	218	219	218
query59	3080	3140	3150	3140
query60	304	271	272	271
query61	112	108	115	108
query62	797	762	706	706
query63	241	196	199	196
query64	3711	986	631	631
query65	3372	3286	3322	3286
query66	946	415	310	310
query67	16270	15738	15376	15376
query68	7369	839	538	538
query69	486	304	265	265
query70	1183	1137	1091	1091
query71	399	301	267	267
query72	5817	3744	3773	3744
query73	661	752	354	354
query74	10305	9172	8968	8968
query75	3203	3136	2671	2671
query76	3141	1171	772	772
query77	499	377	284	284
query78	10349	10396	9658	9658
query79	4398	853	587	587
query80	848	527	445	445
query81	516	261	220	220
query82	673	120	89	89
query83	168	168	147	147
query84	293	100	81	81
query85	787	376	305	305
query86	397	308	292	292
query87	4307	4346	4246	4246
query88	5140	2401	2380	2380
query89	435	333	299	299
query90	1752	195	196	195
query91	141	140	109	109
query92	70	54	54	54
query93	2855	877	537	537
query94	697	416	322	322
query95	347	283	277	277
query96	496	619	279	279
query97	3198	3260	3173	3173
query98	234	199	206	199
query99	1583	1442	1308	1308
Total cold run time: 299257 ms
Total hot run time: 197969 ms

@doris-robot
Copy link

BE UT Coverage Report

Increment line coverage 0.00% (0/5) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 45.39% (12637/27838)
Line Coverage 36.26% (112671/310723)
Region Coverage 35.30% (58222/164943)
Branch Coverage 32.49% (31662/97448)

@doris-robot
Copy link

ClickBench: Total hot run time: 28.63 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit ebf3a6a94af19fbca73f118979a39173d0e39de4, data reload: false

query1	0.03	0.04	0.03
query2	0.07	0.03	0.03
query3	0.23	0.07	0.06
query4	1.61	0.11	0.10
query5	0.51	0.53	0.53
query6	1.13	0.74	0.72
query7	0.02	0.01	0.01
query8	0.04	0.03	0.03
query9	0.58	0.50	0.50
query10	0.56	0.54	0.54
query11	0.14	0.13	0.11
query12	0.13	0.11	0.11
query13	0.61	0.59	0.60
query14	0.78	0.77	0.79
query15	0.83	0.85	0.82
query16	0.38	0.38	0.37
query17	1.06	0.97	1.04
query18	0.24	0.22	0.20
query19	1.84	1.89	1.79
query20	0.02	0.00	0.02
query21	15.39	0.94	0.59
query22	0.74	0.76	0.55
query23	15.22	1.40	0.55
query24	3.04	0.85	1.31
query25	0.17	0.13	0.07
query26	0.29	0.15	0.13
query27	0.06	0.05	0.05
query28	13.70	1.05	0.43
query29	12.60	4.01	3.35
query30	0.26	0.09	0.06
query31	2.81	0.61	0.38
query32	3.22	0.53	0.46
query33	3.00	2.99	3.02
query34	16.36	5.24	4.55
query35	4.59	4.62	4.55
query36	0.63	0.49	0.49
query37	0.09	0.06	0.06
query38	0.04	0.03	0.03
query39	0.04	0.03	0.02
query40	0.16	0.13	0.12
query41	0.08	0.02	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 103.37 s
Total hot run time: 28.63 s

@hello-stephen
Copy link
Contributor

BE Regression && UT Coverage Report

Increment line coverage 100.00% (5/5) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 76.34% (20997/27506)
Line Coverage 69.78% (216680/310516)
Region Coverage 67.76% (129619/191282)
Branch Coverage 61.32% (67433/109974)

@morrySnow morrySnow merged commit 86f4bf7 into apache:branch-3.1 Aug 4, 2025
22 of 23 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants