Skip to content

Conversation

@yx-keith
Copy link
Contributor

@yx-keith yx-keith commented Mar 11, 2025

What problem does this PR solve?

Issue Number: close #42712,#42713

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@yx-keith
Copy link
Contributor Author

run buildAll

@Thearas
Copy link
Contributor

Thearas commented Mar 11, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@yx-keith yx-keith changed the title [Enhancement] (nereids) implement dropAnalyzeJobCommand and killAnalyzeJobCommand in nereids [Enhancement] (nereids) implement drop/ killAnalyzeJobCommand in nereids Mar 11, 2025
@yx-keith yx-keith changed the title [Enhancement] (nereids) implement drop/ killAnalyzeJobCommand in nereids [Enhancement] (nereids) implement drop/killAnalyzeJobCommand in nereids Mar 11, 2025
@starocean999
Copy link
Contributor

please add a regression test case

@yx-keith
Copy link
Contributor Author

run builall

@yx-keith
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 34318 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 5e67557b2ee88f855936b1e8aa1fc2e488536bb3, data reload: false

------ Round 1 ----------------------------------
q1	23982	5256	5175	5175
q2	2074	318	186	186
q3	10378	1288	682	682
q4	10218	1022	536	536
q5	7530	2297	2354	2297
q6	194	168	130	130
q7	904	722	597	597
q8	9326	1418	1221	1221
q9	7004	5189	5171	5171
q10	6871	2321	1899	1899
q11	506	286	254	254
q12	355	355	213	213
q13	17780	3720	3024	3024
q14	226	227	207	207
q15	538	497	488	488
q16	628	621	586	586
q17	565	890	354	354
q18	7534	7302	7066	7066
q19	1211	968	565	565
q20	307	327	204	204
q21	3904	3417	2498	2498
q22	1083	1042	965	965
Total cold run time: 113118 ms
Total hot run time: 34318 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5395	5330	5362	5330
q2	241	327	230	230
q3	2129	2643	2256	2256
q4	1404	1802	1382	1382
q5	4475	4361	4359	4359
q6	225	168	129	129
q7	2051	1910	1763	1763
q8	2609	2658	2569	2569
q9	7251	7237	7079	7079
q10	2987	3181	2791	2791
q11	575	517	487	487
q12	649	748	598	598
q13	3576	3874	3190	3190
q14	268	301	272	272
q15	539	480	476	476
q16	665	697	653	653
q17	1192	1615	1296	1296
q18	7767	7600	7546	7546
q19	853	864	909	864
q20	1998	1982	1804	1804
q21	5200	4917	4829	4829
q22	1092	1085	1053	1053
Total cold run time: 53141 ms
Total hot run time: 50956 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 193544 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 5e67557b2ee88f855936b1e8aa1fc2e488536bb3, data reload: false

query1	1428	1041	1014	1014
query2	6363	1895	1882	1882
query3	11091	4624	4740	4624
query4	25604	23835	23402	23402
query5	4367	693	472	472
query6	306	199	182	182
query7	3992	488	268	268
query8	302	251	235	235
query9	8483	2583	2563	2563
query10	466	300	265	265
query11	15396	15350	14865	14865
query12	166	114	110	110
query13	1575	529	401	401
query14	9271	6569	6719	6569
query15	200	196	171	171
query16	7547	620	476	476
query17	1172	757	570	570
query18	1975	405	320	320
query19	189	179	155	155
query20	133	124	115	115
query21	207	125	112	112
query22	4656	4534	4390	4390
query23	34119	33555	33418	33418
query24	7996	2424	2402	2402
query25	512	472	402	402
query26	1197	271	155	155
query27	2572	483	323	323
query28	4356	2447	2419	2419
query29	686	591	471	471
query30	283	221	197	197
query31	932	866	754	754
query32	71	69	64	64
query33	561	372	326	326
query34	796	851	508	508
query35	818	860	788	788
query36	973	1005	957	957
query37	117	116	73	73
query38	4111	4117	4199	4117
query39	1476	1463	1444	1444
query40	210	115	110	110
query41	53	51	52	51
query42	126	105	106	105
query43	475	491	467	467
query44	1304	806	805	805
query45	176	167	167	167
query46	842	1051	664	664
query47	1863	1893	1788	1788
query48	384	423	297	297
query49	766	516	424	424
query50	689	756	422	422
query51	4260	4312	4340	4312
query52	110	103	101	101
query53	226	254	177	177
query54	494	485	409	409
query55	82	84	82	82
query56	282	297	266	266
query57	1209	1177	1131	1131
query58	250	238	234	234
query59	2787	2778	2642	2642
query60	282	280	263	263
query61	163	133	124	124
query62	771	744	685	685
query63	225	181	179	179
query64	4080	1024	688	688
query65	4533	4500	4515	4500
query66	975	393	298	298
query67	16406	15454	15333	15333
query68	9446	814	501	501
query69	466	291	260	260
query70	1168	1100	1057	1057
query71	466	288	262	262
query72	5194	5015	5079	5015
query73	713	593	352	352
query74	8969	9100	8748	8748
query75	4349	3256	2725	2725
query76	3742	1189	737	737
query77	791	347	274	274
query78	9835	10077	9431	9431
query79	3433	771	550	550
query80	568	503	440	440
query81	465	258	219	219
query82	196	125	105	105
query83	163	167	157	157
query84	288	96	72	72
query85	765	440	300	300
query86	334	322	290	290
query87	4439	4549	4292	4292
query88	2843	2239	2231	2231
query89	422	306	272	272
query90	2176	205	203	203
query91	136	148	108	108
query92	80	66	52	52
query93	2265	1015	578	578
query94	675	397	299	299
query95	358	260	265	260
query96	488	554	279	279
query97	3239	3380	3305	3305
query98	220	199	207	199
query99	1441	1403	1268	1268
Total cold run time: 280621 ms
Total hot run time: 193544 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.33 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 5e67557b2ee88f855936b1e8aa1fc2e488536bb3, data reload: false

query1	0.03	0.04	0.03
query2	0.12	0.11	0.10
query3	0.25	0.19	0.20
query4	1.59	0.20	0.20
query5	0.59	0.57	0.58
query6	1.18	0.70	0.72
query7	0.02	0.02	0.02
query8	0.05	0.03	0.03
query9	0.56	0.53	0.50
query10	0.63	0.61	0.56
query11	0.15	0.10	0.11
query12	0.14	0.11	0.11
query13	0.62	0.60	0.60
query14	2.77	2.68	2.69
query15	0.93	0.84	0.84
query16	0.37	0.37	0.38
query17	0.99	1.02	1.00
query18	0.20	0.19	0.20
query19	1.90	1.84	1.94
query20	0.01	0.01	0.01
query21	15.36	0.91	0.55
query22	0.75	1.18	0.73
query23	14.88	1.37	0.62
query24	7.00	0.88	1.18
query25	0.47	0.22	0.19
query26	0.60	0.15	0.13
query27	0.05	0.05	0.05
query28	9.28	0.88	0.42
query29	12.54	4.05	3.38
query30	0.26	0.09	0.06
query31	2.83	0.60	0.38
query32	3.22	0.54	0.47
query33	2.95	2.99	3.03
query34	15.75	5.14	4.53
query35	4.59	4.52	4.54
query36	0.65	0.48	0.48
query37	0.09	0.06	0.06
query38	0.05	0.04	0.04
query39	0.03	0.02	0.02
query40	0.17	0.13	0.12
query41	0.09	0.03	0.02
query42	0.04	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 104.79 s
Total hot run time: 31.33 s

@yx-keith
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 33904 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit f96ce9a500099711bb0a27935273b623b244d6b1, data reload: false

------ Round 1 ----------------------------------
q1	24172	5086	5017	5017
q2	2041	305	189	189
q3	10378	1230	689	689
q4	10227	1017	552	552
q5	7556	2397	2270	2270
q6	199	166	135	135
q7	912	754	618	618
q8	9327	1235	1068	1068
q9	6937	5085	5087	5085
q10	6801	2302	1874	1874
q11	480	284	255	255
q12	343	347	225	225
q13	17777	3616	3097	3097
q14	227	231	204	204
q15	539	481	482	481
q16	643	613	588	588
q17	559	846	338	338
q18	7606	7105	7139	7105
q19	1417	945	548	548
q20	296	320	189	189
q21	3832	2704	2418	2418
q22	1061	1026	959	959
Total cold run time: 113330 ms
Total hot run time: 33904 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5123	5087	5080	5080
q2	231	325	224	224
q3	2105	2599	2319	2319
q4	1399	1847	1352	1352
q5	4301	4348	4414	4348
q6	221	168	128	128
q7	1964	1972	1773	1773
q8	2587	2663	2620	2620
q9	7315	7402	7202	7202
q10	3054	3207	2793	2793
q11	571	501	506	501
q12	705	761	630	630
q13	3638	4011	3403	3403
q14	288	325	298	298
q15	523	484	470	470
q16	649	677	647	647
q17	1148	1663	1315	1315
q18	7804	7538	7459	7459
q19	792	799	868	799
q20	1956	1937	1858	1858
q21	5269	4911	4877	4877
q22	1113	1056	1006	1006
Total cold run time: 52756 ms
Total hot run time: 51102 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 193188 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit f96ce9a500099711bb0a27935273b623b244d6b1, data reload: false

query1	1408	1070	1042	1042
query2	6145	1908	1860	1860
query3	11145	4542	4580	4542
query4	57405	25839	23098	23098
query5	5191	502	482	482
query6	385	206	186	186
query7	5130	476	265	265
query8	336	250	238	238
query9	6538	2551	2580	2551
query10	388	294	248	248
query11	15201	14974	14946	14946
query12	165	114	107	107
query13	1134	492	383	383
query14	10623	7195	6258	6258
query15	197	201	183	183
query16	6998	641	492	492
query17	1056	752	571	571
query18	1556	391	310	310
query19	184	203	160	160
query20	123	119	149	119
query21	214	124	103	103
query22	4695	4525	4352	4352
query23	33936	33351	33556	33351
query24	5671	2415	2529	2415
query25	468	479	412	412
query26	643	268	147	147
query27	1678	491	336	336
query28	2915	2434	2428	2428
query29	571	562	417	417
query30	282	218	192	192
query31	878	844	816	816
query32	72	62	64	62
query33	442	373	310	310
query34	767	847	502	502
query35	804	841	776	776
query36	931	1009	915	915
query37	117	101	73	73
query38	4185	4165	4138	4138
query39	1526	1413	1578	1413
query40	233	120	106	106
query41	52	52	49	49
query42	120	106	103	103
query43	499	514	466	466
query44	1320	813	831	813
query45	184	180	171	171
query46	850	1035	643	643
query47	1823	1886	1832	1832
query48	407	417	327	327
query49	689	528	400	400
query50	700	758	409	409
query51	4211	4310	4339	4310
query52	112	109	102	102
query53	220	248	176	176
query54	493	499	442	442
query55	90	86	85	85
query56	291	322	288	288
query57	1186	1240	1111	1111
query58	256	256	260	256
query59	2676	2734	2730	2730
query60	295	277	265	265
query61	129	128	125	125
query62	720	743	672	672
query63	226	175	190	175
query64	1389	1071	691	691
query65	4492	4453	4379	4379
query66	714	394	290	290
query67	15738	15431	15250	15250
query68	5516	821	502	502
query69	536	387	257	257
query70	1166	1088	1088	1088
query71	462	280	283	280
query72	5939	5160	5209	5160
query73	1084	665	338	338
query74	9078	8885	8916	8885
query75	3515	3209	2715	2715
query76	3771	1173	763	763
query77	543	359	284	284
query78	9978	10317	9374	9374
query79	1507	809	548	548
query80	710	537	452	452
query81	500	257	228	228
query82	210	121	94	94
query83	172	169	155	155
query84	294	94	71	71
query85	770	359	309	309
query86	321	283	281	281
query87	4365	4512	4346	4346
query88	2828	2280	2278	2278
query89	385	316	275	275
query90	1776	206	208	206
query91	143	141	104	104
query92	62	59	59	59
query93	1496	1059	574	574
query94	622	436	306	306
query95	353	271	273	271
query96	481	575	275	275
query97	3262	3421	3354	3354
query98	218	204	201	201
query99	1325	1426	1290	1290
Total cold run time: 295606 ms
Total hot run time: 193188 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.37 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit f96ce9a500099711bb0a27935273b623b244d6b1, data reload: false

query1	0.04	0.04	0.02
query2	0.13	0.11	0.10
query3	0.24	0.19	0.19
query4	1.59	0.19	0.19
query5	0.58	0.58	0.58
query6	1.20	0.71	0.71
query7	0.03	0.01	0.02
query8	0.04	0.04	0.04
query9	0.58	0.52	0.53
query10	0.57	0.60	0.56
query11	0.14	0.10	0.11
query12	0.14	0.11	0.12
query13	0.60	0.60	0.61
query14	2.79	2.80	2.79
query15	0.93	0.85	0.85
query16	0.39	0.37	0.37
query17	1.03	1.03	1.03
query18	0.21	0.20	0.20
query19	1.85	1.97	1.78
query20	0.02	0.01	0.02
query21	15.36	0.91	0.55
query22	0.76	1.02	0.59
query23	15.18	1.37	0.61
query24	6.73	1.77	0.96
query25	0.53	0.31	0.11
query26	0.51	0.15	0.14
query27	0.05	0.04	0.05
query28	9.79	0.86	0.44
query29	12.61	4.07	3.38
query30	0.25	0.09	0.06
query31	2.82	0.58	0.38
query32	3.22	0.55	0.47
query33	2.97	3.05	3.04
query34	15.78	5.16	4.54
query35	4.61	4.55	4.52
query36	0.67	0.49	0.47
query37	0.08	0.06	0.06
query38	0.06	0.04	0.04
query39	0.04	0.02	0.02
query40	0.17	0.12	0.12
query41	0.09	0.02	0.02
query42	0.03	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 105.44 s
Total hot run time: 31.37 s

@yx-keith
Copy link
Contributor Author

run buildall

@yx-keith
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 34051 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit bd836d143759ff672a0531d25e7a925c538100e7, data reload: false

------ Round 1 ----------------------------------
q1	26144	5017	5012	5012
q2	2057	283	157	157
q3	10413	1202	676	676
q4	10221	979	519	519
q5	7531	2379	2623	2379
q6	188	159	131	131
q7	916	734	599	599
q8	9327	1297	1082	1082
q9	6949	5310	5097	5097
q10	6874	2324	1905	1905
q11	474	271	263	263
q12	352	352	217	217
q13	17820	3793	3237	3237
q14	232	236	209	209
q15	538	491	506	491
q16	636	616	597	597
q17	586	856	350	350
q18	7605	7298	7008	7008
q19	2003	941	544	544
q20	311	322	191	191
q21	3846	3415	2457	2457
q22	1083	1012	930	930
Total cold run time: 116106 ms
Total hot run time: 34051 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5215	5102	5091	5091
q2	233	322	231	231
q3	2127	2656	2306	2306
q4	1379	1777	1507	1507
q5	4491	4480	4529	4480
q6	220	171	128	128
q7	2027	1976	1853	1853
q8	2631	2595	2571	2571
q9	7482	7318	7249	7249
q10	2976	3172	2773	2773
q11	584	494	484	484
q12	685	758	653	653
q13	3533	3921	3408	3408
q14	295	282	280	280
q15	534	491	480	480
q16	651	689	669	669
q17	1174	1563	1392	1392
q18	7785	7551	7542	7542
q19	798	744	789	744
q20	1960	1972	1851	1851
q21	5318	4812	4937	4812
q22	1063	1062	991	991
Total cold run time: 53161 ms
Total hot run time: 51495 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 193746 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit bd836d143759ff672a0531d25e7a925c538100e7, data reload: false

query1	1393	1051	1070	1051
query2	6309	1962	1943	1943
query3	11025	4661	4440	4440
query4	25825	23865	23321	23321
query5	5744	675	488	488
query6	316	205	197	197
query7	3990	485	272	272
query8	316	261	241	241
query9	8512	2593	2593	2593
query10	537	313	254	254
query11	15866	15160	14914	14914
query12	167	117	108	108
query13	1754	537	389	389
query14	10224	6117	6100	6100
query15	210	184	162	162
query16	7595	675	489	489
query17	1323	720	578	578
query18	2082	402	313	313
query19	198	202	165	165
query20	123	119	118	118
query21	208	130	111	111
query22	4557	4617	4576	4576
query23	34364	33758	33433	33433
query24	8103	2453	2430	2430
query25	504	473	397	397
query26	725	268	141	141
query27	2683	490	318	318
query28	4790	2431	2405	2405
query29	649	576	444	444
query30	271	231	194	194
query31	917	908	807	807
query32	74	67	68	67
query33	546	371	316	316
query34	786	864	491	491
query35	841	869	787	787
query36	973	1011	886	886
query37	123	100	73	73
query38	4311	4172	4180	4172
query39	1556	1454	1477	1454
query40	208	118	105	105
query41	64	56	52	52
query42	119	108	104	104
query43	500	515	489	489
query44	1312	834	820	820
query45	184	182	168	168
query46	857	1034	640	640
query47	1858	1897	1832	1832
query48	397	410	327	327
query49	694	525	440	440
query50	687	780	414	414
query51	4261	4340	4299	4299
query52	104	108	98	98
query53	237	254	187	187
query54	490	514	438	438
query55	81	86	82	82
query56	287	297	280	280
query57	1200	1219	1155	1155
query58	263	249	250	249
query59	2633	2924	2806	2806
query60	310	298	282	282
query61	155	153	144	144
query62	772	743	668	668
query63	226	193	184	184
query64	3173	1151	710	710
query65	4667	4507	4511	4507
query66	792	399	302	302
query67	16040	15611	15568	15568
query68	8773	878	505	505
query69	519	315	265	265
query70	1233	1118	1112	1112
query71	487	303	262	262
query72	5671	5043	5100	5043
query73	657	549	339	339
query74	9031	9254	8704	8704
query75	4132	3241	2727	2727
query76	3787	1198	743	743
query77	794	375	288	288
query78	10048	10172	9297	9297
query79	2918	822	562	562
query80	685	530	450	450
query81	480	261	226	226
query82	495	123	95	95
query83	198	172	153	153
query84	286	96	77	77
query85	745	354	310	310
query86	327	316	338	316
query87	4727	4496	4274	4274
query88	3369	2212	2197	2197
query89	431	316	276	276
query90	1992	207	249	207
query91	139	140	109	109
query92	73	58	55	55
query93	2561	1059	570	570
query94	671	410	310	310
query95	339	293	261	261
query96	485	559	270	270
query97	3383	3420	3278	3278
query98	228	205	209	205
query99	1448	1421	1272	1272
Total cold run time: 284173 ms
Total hot run time: 193746 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.26 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit bd836d143759ff672a0531d25e7a925c538100e7, data reload: false

query1	0.04	0.03	0.03
query2	0.12	0.11	0.10
query3	0.24	0.20	0.19
query4	1.59	0.19	0.20
query5	0.60	0.56	0.58
query6	1.19	0.73	0.72
query7	0.02	0.02	0.02
query8	0.04	0.03	0.03
query9	0.57	0.53	0.55
query10	0.56	0.59	0.57
query11	0.15	0.11	0.12
query12	0.14	0.11	0.11
query13	0.61	0.61	0.61
query14	2.80	2.69	2.71
query15	0.93	0.85	0.85
query16	0.40	0.38	0.37
query17	1.03	1.01	1.07
query18	0.21	0.20	0.20
query19	1.93	1.94	1.84
query20	0.01	0.01	0.01
query21	15.36	0.90	0.54
query22	0.76	1.13	0.64
query23	15.07	1.41	0.65
query24	7.17	1.61	0.85
query25	0.50	0.19	0.20
query26	0.70	0.17	0.15
query27	0.04	0.05	0.05
query28	9.15	0.93	0.45
query29	12.60	4.03	3.29
query30	0.25	0.09	0.06
query31	2.81	0.59	0.39
query32	3.22	0.54	0.48
query33	3.12	3.00	3.09
query34	15.76	5.09	4.51
query35	4.50	4.48	4.53
query36	0.66	0.49	0.48
query37	0.08	0.06	0.06
query38	0.06	0.04	0.03
query39	0.03	0.03	0.02
query40	0.18	0.14	0.13
query41	0.08	0.02	0.02
query42	0.04	0.03	0.02
query43	0.04	0.03	0.03
Total cold run time: 105.36 s
Total hot run time: 31.26 s

@yx-keith
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 34388 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e9725d83f4c34296b6e783c56bcc502e629b1267, data reload: false

------ Round 1 ----------------------------------
q1	26143	5117	5061	5061
q2	2081	294	169	169
q3	10399	1302	715	715
q4	10243	1025	536	536
q5	7556	2364	2412	2364
q6	191	167	136	136
q7	929	748	628	628
q8	9329	1380	1166	1166
q9	6911	5203	5181	5181
q10	6874	2327	1907	1907
q11	502	285	279	279
q12	353	375	224	224
q13	17831	3685	3170	3170
q14	231	222	221	221
q15	552	493	500	493
q16	609	633	604	604
q17	587	873	332	332
q18	7879	7347	7038	7038
q19	2731	982	561	561
q20	318	328	194	194
q21	3861	2726	2436	2436
q22	1085	1023	973	973
Total cold run time: 117195 ms
Total hot run time: 34388 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5484	5075	5100	5075
q2	247	328	231	231
q3	2198	2669	2271	2271
q4	1485	1977	1511	1511
q5	4550	4479	4385	4385
q6	218	165	127	127
q7	1974	1896	1786	1786
q8	2566	2495	2513	2495
q9	7285	7181	7206	7181
q10	3025	3205	2741	2741
q11	589	509	479	479
q12	698	777	589	589
q13	3531	3879	3306	3306
q14	290	301	273	273
q15	534	481	469	469
q16	640	687	655	655
q17	1156	1578	1396	1396
q18	7763	7449	7584	7449
q19	816	795	892	795
q20	1963	2045	1871	1871
q21	5254	4712	4648	4648
q22	1050	1037	950	950
Total cold run time: 53316 ms
Total hot run time: 50683 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 186497 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e9725d83f4c34296b6e783c56bcc502e629b1267, data reload: false

query1	1007	480	468	468
query2	6525	1932	1944	1932
query3	6792	243	221	221
query4	26316	23641	23278	23278
query5	4306	645	486	486
query6	306	189	181	181
query7	4593	484	281	281
query8	307	247	253	247
query9	8592	2599	2590	2590
query10	464	327	250	250
query11	15535	15123	14894	14894
query12	170	109	102	102
query13	1660	518	386	386
query14	8849	6108	6343	6108
query15	206	186	167	167
query16	7182	669	472	472
query17	1193	676	552	552
query18	1959	394	290	290
query19	188	182	150	150
query20	119	114	120	114
query21	209	124	98	98
query22	4010	4409	4081	4081
query23	33820	32977	33040	32977
query24	8403	2381	2404	2381
query25	511	441	381	381
query26	1220	268	152	152
query27	2753	503	320	320
query28	4352	2412	2377	2377
query29	783	588	453	453
query30	294	225	196	196
query31	951	868	757	757
query32	73	66	67	66
query33	571	386	339	339
query34	778	845	517	517
query35	781	846	738	738
query36	972	979	916	916
query37	117	117	81	81
query38	4259	4245	4053	4053
query39	1465	1398	1407	1398
query40	220	125	110	110
query41	60	61	56	56
query42	171	103	105	103
query43	499	514	481	481
query44	1333	805	799	799
query45	175	170	167	167
query46	837	1007	625	625
query47	1800	1841	1730	1730
query48	367	401	292	292
query49	794	509	432	432
query50	683	726	423	423
query51	4192	4323	4151	4151
query52	115	107	95	95
query53	216	255	178	178
query54	497	501	413	413
query55	87	79	103	79
query56	285	259	252	252
query57	1161	1157	1073	1073
query58	246	238	229	229
query59	2708	2740	2788	2740
query60	271	260	274	260
query61	130	128	125	125
query62	813	724	689	689
query63	214	187	187	187
query64	4307	994	684	684
query65	4443	4242	4296	4242
query66	1129	411	298	298
query67	15796	15781	15398	15398
query68	9184	884	508	508
query69	464	306	266	266
query70	1192	1056	1119	1056
query71	454	297	267	267
query72	5551	4734	5005	4734
query73	736	655	338	338
query74	9135	9097	9005	9005
query75	4308	3248	2719	2719
query76	3869	1177	731	731
query77	977	382	294	294
query78	9983	10280	9318	9318
query79	1382	823	611	611
query80	634	520	437	437
query81	486	253	225	225
query82	427	130	102	102
query83	221	176	155	155
query84	292	91	70	70
query85	782	345	297	297
query86	334	320	278	278
query87	4574	4643	4376	4376
query88	2843	2222	2223	2222
query89	393	319	276	276
query90	1925	206	207	206
query91	141	147	115	115
query92	79	62	54	54
query93	1177	1070	576	576
query94	675	409	307	307
query95	352	266	257	257
query96	478	569	268	268
query97	3156	3219	3170	3170
query98	230	209	205	205
query99	1466	1402	1293	1293
Total cold run time: 274040 ms
Total hot run time: 186497 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.92 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e9725d83f4c34296b6e783c56bcc502e629b1267, data reload: false

query1	0.04	0.03	0.04
query2	0.12	0.10	0.10
query3	0.25	0.19	0.19
query4	1.59	0.20	0.11
query5	0.56	0.56	0.55
query6	1.18	0.73	0.72
query7	0.02	0.02	0.02
query8	0.04	0.03	0.03
query9	0.58	0.54	0.50
query10	0.62	0.58	0.57
query11	0.16	0.11	0.12
query12	0.16	0.11	0.11
query13	0.61	0.59	0.60
query14	2.66	2.71	2.66
query15	0.94	0.85	0.85
query16	0.39	0.39	0.38
query17	1.02	1.06	1.04
query18	0.20	0.20	0.19
query19	1.99	1.92	1.81
query20	0.01	0.01	0.02
query21	15.38	0.92	0.54
query22	0.77	1.20	0.74
query23	14.85	1.39	0.60
query24	6.78	1.51	0.64
query25	0.47	0.27	0.14
query26	0.55	0.16	0.13
query27	0.05	0.05	0.05
query28	9.90	0.89	0.43
query29	12.51	3.97	3.33
query30	0.26	0.10	0.06
query31	2.80	0.61	0.40
query32	3.24	0.58	0.48
query33	3.03	3.03	3.06
query34	15.72	5.12	4.48
query35	4.50	4.53	4.50
query36	0.68	0.49	0.48
query37	0.09	0.07	0.07
query38	0.06	0.04	0.03
query39	0.02	0.02	0.02
query40	0.17	0.14	0.13
query41	0.09	0.03	0.02
query42	0.03	0.03	0.02
query43	0.03	0.03	0.03
Total cold run time: 105.12 s
Total hot run time: 30.92 s

@yx-keith
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 34243 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 074a2d5df26a828f1f6ca5bfd78fa7246044c7cc, data reload: false

------ Round 1 ----------------------------------
q1	26800	5090	5064	5064
q2	2071	294	172	172
q3	10474	1268	699	699
q4	10275	1035	545	545
q5	8966	2405	2380	2380
q6	196	168	134	134
q7	929	755	632	632
q8	9338	1300	1024	1024
q9	6965	5152	5209	5152
q10	6822	2336	1882	1882
q11	495	285	255	255
q12	355	357	225	225
q13	17766	3663	3053	3053
q14	236	233	226	226
q15	555	514	520	514
q16	636	626	600	600
q17	572	872	353	353
q18	7633	7397	7196	7196
q19	1724	953	555	555
q20	301	334	197	197
q21	4089	2641	2418	2418
q22	1096	1045	967	967
Total cold run time: 118294 ms
Total hot run time: 34243 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5194	5111	5050	5050
q2	240	321	229	229
q3	2182	2646	2325	2325
q4	1431	1962	1522	1522
q5	4546	4428	4395	4395
q6	210	169	127	127
q7	1954	1872	1760	1760
q8	2883	2636	2511	2511
q9	7205	7307	7270	7270
q10	3012	3180	2780	2780
q11	568	499	487	487
q12	693	785	624	624
q13	3407	4012	3345	3345
q14	276	310	292	292
q15	553	491	512	491
q16	672	700	633	633
q17	1162	1581	1337	1337
q18	7787	7542	7404	7404
q19	763	841	853	841
q20	1967	2033	1827	1827
q21	5082	4688	4809	4688
q22	1085	1033	979	979
Total cold run time: 52872 ms
Total hot run time: 50917 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 187123 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 074a2d5df26a828f1f6ca5bfd78fa7246044c7cc, data reload: false

query1	1024	478	465	465
query2	6542	2004	1976	1976
query3	6780	217	217	217
query4	26212	23741	23601	23601
query5	4339	658	480	480
query6	312	207	192	192
query7	4610	498	284	284
query8	304	246	242	242
query9	8598	2584	2556	2556
query10	496	323	253	253
query11	15705	15326	15051	15051
query12	158	115	109	109
query13	1663	529	393	393
query14	9329	6234	6182	6182
query15	208	184	174	174
query16	7404	617	474	474
query17	1165	675	541	541
query18	1953	404	300	300
query19	191	181	186	181
query20	120	120	120	120
query21	215	121	101	101
query22	4216	4301	4087	4087
query23	34076	33096	33281	33096
query24	8485	2414	2374	2374
query25	543	451	393	393
query26	1236	270	145	145
query27	2765	491	315	315
query28	4333	2399	2366	2366
query29	725	568	432	432
query30	287	220	189	189
query31	956	874	749	749
query32	76	70	66	66
query33	596	354	319	319
query34	796	833	536	536
query35	798	819	783	783
query36	952	974	895	895
query37	116	96	75	75
query38	4106	4186	4067	4067
query39	1447	1402	1397	1397
query40	208	117	111	111
query41	56	51	54	51
query42	124	103	106	103
query43	518	511	480	480
query44	1290	783	802	783
query45	178	171	165	165
query46	837	1023	624	624
query47	1767	1812	1759	1759
query48	368	406	302	302
query49	790	523	451	451
query50	698	735	400	400
query51	4226	4237	4204	4204
query52	102	103	96	96
query53	223	249	174	174
query54	484	500	412	412
query55	81	81	82	81
query56	280	253	268	253
query57	1167	1197	1080	1080
query58	255	245	232	232
query59	2582	2743	2714	2714
query60	286	283	254	254
query61	137	128	123	123
query62	791	724	661	661
query63	222	185	178	178
query64	4287	1009	670	670
query65	4377	4178	4289	4178
query66	1157	400	293	293
query67	15975	15697	15280	15280
query68	6825	868	499	499
query69	488	302	262	262
query70	1189	1120	1095	1095
query71	397	290	268	268
query72	5644	5047	4896	4896
query73	708	671	346	346
query74	8910	9120	8789	8789
query75	3244	3251	2700	2700
query76	3261	1185	739	739
query77	475	382	366	366
query78	9983	10168	9337	9337
query79	2276	880	582	582
query80	610	506	425	425
query81	501	261	213	213
query82	487	127	98	98
query83	176	171	158	158
query84	247	94	76	76
query85	818	371	306	306
query86	380	315	291	291
query87	4524	4449	4574	4449
query88	3927	2205	2236	2205
query89	387	311	282	282
query90	1910	210	208	208
query91	145	142	111	111
query92	77	115	55	55
query93	1842	1054	581	581
query94	724	425	288	288
query95	360	274	264	264
query96	488	567	278	278
query97	3170	3282	3169	3169
query98	244	215	213	213
query99	1371	1402	1286	1286
Total cold run time: 273091 ms
Total hot run time: 187123 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.45 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 074a2d5df26a828f1f6ca5bfd78fa7246044c7cc, data reload: false

query1	0.04	0.03	0.03
query2	0.13	0.10	0.10
query3	0.25	0.19	0.19
query4	1.58	0.19	0.19
query5	0.59	0.59	0.59
query6	1.21	0.72	0.72
query7	0.03	0.02	0.01
query8	0.04	0.03	0.04
query9	0.58	0.53	0.52
query10	0.58	0.60	0.58
query11	0.15	0.11	0.10
query12	0.15	0.11	0.12
query13	0.61	0.60	0.60
query14	2.67	2.68	2.70
query15	0.92	0.85	0.85
query16	0.38	0.38	0.37
query17	1.06	1.04	1.02
query18	0.22	0.21	0.20
query19	1.88	1.85	1.89
query20	0.02	0.01	0.02
query21	15.36	0.92	0.55
query22	0.77	1.20	0.66
query23	14.94	1.35	0.65
query24	7.94	0.89	0.98
query25	0.40	0.14	0.15
query26	0.75	0.18	0.13
query27	0.05	0.05	0.06
query28	8.94	0.90	0.45
query29	12.56	4.03	3.34
query30	0.25	0.10	0.07
query31	2.81	0.60	0.40
query32	3.29	0.55	0.48
query33	3.00	3.01	3.12
query34	15.73	5.09	4.53
query35	4.59	4.56	4.57
query36	0.67	0.50	0.48
query37	0.08	0.06	0.07
query38	0.06	0.04	0.04
query39	0.02	0.02	0.02
query40	0.17	0.13	0.12
query41	0.09	0.03	0.02
query42	0.03	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 105.62 s
Total hot run time: 31.45 s

@yx-keith
Copy link
Contributor Author

run p0


@Override
public void doRun(ConnectContext ctx, StmtExecutor executor) throws Exception {
validate();
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't think we need to do the validate() here, because there is a privilege chech in the handleKillAnalyzeJob() function. Same for the JobAnalyzeJobCommand above.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ok

@yx-keith
Copy link
Contributor Author

run buildall

@yx-keith
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 34273 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 8194d3d84002ad5408bcbc41edf277070de414fb, data reload: false

------ Round 1 ----------------------------------
q1	25790	5021	5052	5021
q2	2071	279	160	160
q3	10429	1251	669	669
q4	10216	1017	538	538
q5	7522	2399	2315	2315
q6	185	161	134	134
q7	921	732	606	606
q8	9313	1295	1115	1115
q9	6873	5148	5129	5129
q10	6820	2307	1893	1893
q11	495	271	251	251
q12	348	357	229	229
q13	17743	3702	3047	3047
q14	216	217	217	217
q15	535	486	489	486
q16	622	627	570	570
q17	576	863	335	335
q18	7580	7277	7583	7277
q19	1619	977	563	563
q20	327	330	202	202
q21	4477	2650	2500	2500
q22	1125	1051	1016	1016
Total cold run time: 115803 ms
Total hot run time: 34273 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5213	5126	5136	5126
q2	246	329	232	232
q3	2250	2674	2310	2310
q4	1383	1800	1440	1440
q5	4490	4486	4383	4383
q6	223	182	129	129
q7	2029	1896	1806	1806
q8	2584	2538	2543	2538
q9	7341	7158	7201	7158
q10	3004	3163	2727	2727
q11	604	506	498	498
q12	684	792	610	610
q13	3473	3817	3394	3394
q14	284	299	268	268
q15	513	489	475	475
q16	650	661	644	644
q17	1151	1538	1429	1429
q18	7840	7685	7545	7545
q19	802	799	981	799
q20	1930	2010	1898	1898
q21	5359	4943	4918	4918
q22	1100	1104	1025	1025
Total cold run time: 53153 ms
Total hot run time: 51352 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 193325 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 8194d3d84002ad5408bcbc41edf277070de414fb, data reload: false

query1	1407	1058	1048	1048
query2	6136	1865	1903	1865
query3	11146	4612	4505	4505
query4	53547	25557	23382	23382
query5	5018	607	490	490
query6	336	188	187	187
query7	4898	494	274	274
query8	298	244	245	244
query9	5698	2519	2549	2519
query10	401	312	242	242
query11	15295	14908	14960	14908
query12	164	123	101	101
query13	1039	505	381	381
query14	10144	6204	6245	6204
query15	201	185	177	177
query16	7164	687	560	560
query17	1089	740	610	610
query18	1574	434	325	325
query19	211	194	174	174
query20	136	128	121	121
query21	214	128	113	113
query22	4383	4642	4508	4508
query23	34018	33401	33552	33401
query24	6607	2451	2428	2428
query25	496	523	402	402
query26	728	272	154	154
query27	2426	500	327	327
query28	3385	2440	2435	2435
query29	606	584	444	444
query30	273	226	193	193
query31	882	892	757	757
query32	76	64	65	64
query33	463	365	314	314
query34	777	858	506	506
query35	809	833	751	751
query36	935	987	930	930
query37	130	104	80	80
query38	4158	4232	4164	4164
query39	1485	1461	1430	1430
query40	217	116	105	105
query41	51	50	50	50
query42	127	107	103	103
query43	491	506	478	478
query44	1349	820	820	820
query45	179	174	164	164
query46	858	1053	653	653
query47	1891	1895	1829	1829
query48	384	412	305	305
query49	710	550	447	447
query50	728	755	419	419
query51	4279	4305	4243	4243
query52	113	107	101	101
query53	224	260	180	180
query54	491	493	436	436
query55	83	82	82	82
query56	286	297	281	281
query57	1205	1217	1142	1142
query58	265	245	241	241
query59	2751	2841	2653	2653
query60	286	285	262	262
query61	144	131	126	126
query62	759	737	667	667
query63	228	190	193	190
query64	1867	1048	674	674
query65	4488	4440	4403	4403
query66	744	397	289	289
query67	15980	15656	15603	15603
query68	7026	834	520	520
query69	538	301	268	268
query70	1212	1039	1096	1039
query71	507	291	254	254
query72	5804	4780	4810	4780
query73	1442	618	348	348
query74	8979	8870	8978	8870
query75	4055	3428	2719	2719
query76	4199	1187	750	750
query77	661	370	284	284
query78	9925	10235	9324	9324
query79	2258	796	563	563
query80	617	518	438	438
query81	487	261	225	225
query82	419	127	93	93
query83	257	181	157	157
query84	278	93	82	82
query85	778	352	311	311
query86	331	286	299	286
query87	4576	4572	4289	4289
query88	2947	2244	2244	2244
query89	400	306	279	279
query90	1965	213	220	213
query91	144	141	109	109
query92	75	62	54	54
query93	1200	1055	600	600
query94	665	424	300	300
query95	350	267	265	265
query96	488	560	279	279
query97	3163	3259	3220	3220
query98	225	220	210	210
query99	1461	1410	1288	1288
Total cold run time: 297363 ms
Total hot run time: 193325 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.84 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 8194d3d84002ad5408bcbc41edf277070de414fb, data reload: false

query1	0.04	0.03	0.03
query2	0.14	0.10	0.11
query3	0.25	0.19	0.18
query4	1.60	0.19	0.19
query5	0.59	0.58	0.57
query6	1.18	0.71	0.71
query7	0.03	0.02	0.02
query8	0.04	0.03	0.04
query9	0.57	0.52	0.51
query10	0.60	0.60	0.57
query11	0.15	0.11	0.11
query12	0.15	0.11	0.11
query13	0.61	0.60	0.60
query14	2.68	2.83	2.71
query15	0.93	0.85	0.83
query16	0.39	0.38	0.39
query17	1.08	1.04	1.04
query18	0.22	0.20	0.20
query19	1.93	1.99	1.84
query20	0.02	0.01	0.00
query21	15.35	0.89	0.54
query22	0.77	1.20	0.63
query23	14.94	1.37	0.64
query24	7.40	1.25	0.52
query25	0.54	0.18	0.10
query26	0.68	0.16	0.13
query27	0.05	0.05	0.05
query28	9.38	0.89	0.42
query29	12.61	3.98	3.30
query30	0.25	0.09	0.06
query31	2.82	0.59	0.39
query32	3.22	0.55	0.47
query33	3.03	3.01	3.08
query34	15.78	5.16	4.52
query35	4.60	4.54	4.55
query36	0.66	0.51	0.49
query37	0.09	0.07	0.06
query38	0.06	0.04	0.04
query39	0.02	0.02	0.02
query40	0.16	0.14	0.12
query41	0.08	0.03	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.02
Total cold run time: 105.76 s
Total hot run time: 30.84 s

@yx-keith yx-keith requested a review from Jibing-Li March 27, 2025 01:07
@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Mar 27, 2025
@github-actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@starocean999 starocean999 merged commit a7d6148 into apache:master Mar 27, 2025
24 of 26 checks passed
koarz pushed a commit to koarz/doris that referenced this pull request Jun 4, 2025
morningman pushed a commit to morningman/doris that referenced this pull request Jun 24, 2025
morrySnow pushed a commit that referenced this pull request Jun 24, 2025
…y trace id #46882 #48942 #50791 #43231 (#52197)

bp #46882 #48942 #50791 #43231

---------

Co-authored-by: yaoxiao <yx136264032@163.com>
Co-authored-by: Vallish Pai <vallishpai@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. dev/3.1.0-merged reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Enhancement] (nereids)implement dropAanalyzeJobCommand in nereids

6 participants