Skip to content

branch-3.1: [feat](oss)Support datalake VPC Endpoint Format (dlf / datalake-vpc) #56473 #56476

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
morningman merged 1 commit into from
Sep 28, 2025
Merged

branch-3.1: [feat](oss)Support datalake VPC Endpoint Format (dlf / datalake-vpc) #56473 #56476

morningman merged 1 commit into from
Sep 28, 2025

Conversation

@github-actions
Copy link
Contributor

@github-actions github-actions bot commented Sep 25, 2025

Cherry-picked from #56473

@github-actions github-actions bot requested a review from morrySnow as a code owner September 25, 2025 13:48
@hello-stephen
Copy link
Contributor

hello-stephen commented Sep 25, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@dataroaring dataroaring reopened this Sep 25, 2025
@hello-stephen
Copy link
Contributor

hello-stephen commented Sep 25, 2025

run buildall

@hello-stephen
Copy link
Contributor

hello-stephen commented Sep 25, 2025

FE UT Coverage Report

Increment line coverage 100.00% (2/2) 🎉
Increment coverage report
Complete coverage report

@doris-robot
Copy link

doris-robot commented Sep 25, 2025

TPC-H: Total hot run time: 32831 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c907be1fdb1fe8191eaa0cb39a0cbfffbb6515f4, data reload: false

------ Round 1 ----------------------------------
q1	17820	5554	5485	5485
q2	2043	390	289	289
q3	11980	1253	758	758
q4	10257	884	473	473
q5	8625	2414	2141	2141
q6	180	164	130	130
q7	899	754	612	612
q8	9324	1542	1243	1243
q9	5184	4966	4892	4892
q10	6757	2266	1832	1832
q11	500	285	265	265
q12	346	361	214	214
q13	17797	3598	3008	3008
q14	228	223	215	215
q15	524	470	457	457
q16	434	440	366	366
q17	582	894	362	362
q18	6970	6391	6309	6309
q19	1403	965	563	563
q20	330	348	208	208
q21	2853	2275	2009	2009
q22	1067	1000	1020	1000
Total cold run time: 106103 ms
Total hot run time: 32831 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5675	5541	5546	5541
q2	239	328	230	230
q3	2265	2648	2293	2293
q4	1398	1796	1417	1417
q5	4455	4982	4974	4974
q6	169	164	129	129
q7	2097	1944	1813	1813
q8	2618	2816	2659	2659
q9	7240	7158	7185	7158
q10	3068	3333	2703	2703
q11	574	494	487	487
q12	594	734	573	573
q13	3482	3772	3182	3182
q14	292	314	277	277
q15	512	474	470	470
q16	430	483	422	422
q17	1233	1747	1255	1255
q18	7510	7528	7286	7286
q19	812	1114	1103	1103
q20	1981	2073	1902	1902
q21	5366	5031	4752	4752
q22	1087	1087	1051	1051
Total cold run time: 53097 ms
Total hot run time: 51677 ms

@doris-robot
Copy link

doris-robot commented Sep 25, 2025

TPC-DS: Total hot run time: 191613 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit c907be1fdb1fe8191eaa0cb39a0cbfffbb6515f4, data reload: false

query1	959	386	387	386
query2	6228	1971	1839	1839
query3	8681	200	203	200
query4	33814	23947	23579	23579
query5	3721	596	459	459
query6	297	194	195	194
query7	4204	494	316	316
query8	312	255	249	249
query9	9583	2643	2633	2633
query10	467	326	270	270
query11	18156	15424	15114	15114
query12	156	108	107	107
query13	1550	541	413	413
query14	10224	6581	7062	6581
query15	234	190	179	179
query16	8120	655	455	455
query17	1582	790	614	614
query18	2220	425	325	325
query19	236	192	174	174
query20	128	132	123	123
query21	212	127	120	120
query22	4517	4662	4395	4395
query23	34997	34060	34143	34060
query24	7217	2750	2730	2730
query25	504	465	396	396
query26	773	284	165	165
query27	2164	479	359	359
query28	4986	2244	2210	2210
query29	669	570	440	440
query30	238	194	165	165
query31	1022	917	840	840
query32	86	60	64	60
query33	489	364	336	336
query34	743	903	531	531
query35	778	814	733	733
query36	999	1050	935	935
query37	101	93	74	74
query38	3947	3934	3929	3929
query39	1518	1478	1488	1478
query40	205	114	109	109
query41	49	50	46	46
query42	120	113	111	111
query43	505	531	467	467
query44	1332	847	830	830
query45	182	183	170	170
query46	879	1056	687	687
query47	1985	2016	1924	1924
query48	417	424	349	349
query49	739	498	417	417
query50	682	705	445	445
query51	7357	7230	7213	7213
query52	103	102	100	100
query53	234	254	190	190
query54	547	565	478	478
query55	82	82	79	79
query56	267	265	265	265
query57	1276	1286	1232	1232
query58	268	220	223	220
query59	3141	3173	3028	3028
query60	320	294	275	275
query61	141	134	141	134
query62	791	790	700	700
query63	242	201	204	201
query64	3869	1097	736	736
query65	3424	3322	3292	3292
query66	796	441	324	324
query67	16341	15796	15587	15587
query68	7438	866	547	547
query69	503	311	254	254
query70	1195	1072	1131	1072
query71	366	290	268	268
query72	5754	3757	3756	3756
query73	654	732	360	360
query74	10758	9089	8907	8907
query75	3217	3126	2683	2683
query76	2972	1158	770	770
query77	492	381	276	276
query78	10404	10414	9589	9589
query79	3478	819	595	595
query80	664	509	426	426
query81	517	260	217	217
query82	585	116	84	84
query83	159	157	144	144
query84	239	103	76	76
query85	774	366	312	312
query86	406	310	280	280
query87	4321	4289	4178	4178
query88	4972	2423	2388	2388
query89	415	330	298	298
query90	1776	191	189	189
query91	139	130	107	107
query92	64	53	51	51
query93	2100	872	536	536
query94	690	391	292	292
query95	340	274	274	274
query96	486	609	287	287
query97	3205	3304	3126	3126
query98	222	198	200	198
query99	1529	1411	1298	1298
Total cold run time: 293960 ms
Total hot run time: 191613 ms

@doris-robot
Copy link

doris-robot commented Sep 25, 2025

ClickBench: Total hot run time: 29.29 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit c907be1fdb1fe8191eaa0cb39a0cbfffbb6515f4, data reload: false

query1	0.04	0.03	0.04
query2	0.06	0.03	0.03
query3	0.23	0.06	0.06
query4	1.63	0.10	0.11
query5	0.50	0.52	0.52
query6	1.13	0.73	0.72
query7	0.02	0.02	0.01
query8	0.05	0.04	0.03
query9	0.57	0.49	0.55
query10	0.56	0.54	0.56
query11	0.14	0.11	0.10
query12	0.14	0.10	0.10
query13	0.61	0.60	0.60
query14	0.77	0.79	0.79
query15	0.85	0.82	0.81
query16	0.37	0.41	0.39
query17	0.97	1.01	1.02
query18	0.24	0.22	0.22
query19	1.86	1.84	1.86
query20	0.02	0.01	0.01
query21	15.41	0.91	0.60
query22	0.74	0.77	0.61
query23	15.21	1.39	0.61
query24	2.66	1.32	1.43
query25	0.25	0.13	0.04
query26	0.24	0.14	0.14
query27	0.05	0.04	0.06
query28	13.80	1.01	0.43
query29	12.56	4.02	3.29
query30	0.24	0.09	0.07
query31	2.81	0.60	0.38
query32	3.24	0.54	0.47
query33	3.03	3.00	3.02
query34	16.77	5.20	4.61
query35	4.61	4.50	4.52
query36	0.64	0.51	0.48
query37	0.09	0.06	0.06
query38	0.05	0.04	0.03
query39	0.03	0.02	0.02
query40	0.15	0.12	0.12
query41	0.08	0.02	0.02
query42	0.04	0.03	0.02
query43	0.03	0.03	0.03
Total cold run time: 103.49 s
Total hot run time: 29.29 s

@morningman morningman changed the title branch-3.1: [feat](oss)Support DeltaLake VPC Endpoint Format (dlf / deltalake-vpc) #56473 branch-3.1: [feat](oss)Support datalake VPC Endpoint Format (dlf / datalake-vpc) #56473 Sep 25, 2025
@morningman morningman merged commit d3d7a64 into branch-3.1 Sep 28, 2025
24 checks passed
@github-actions github-actions bot deleted the auto-pick-56473-branch-3.1 branch September 28, 2025 02:30
@morrySnow morrySnow mentioned this pull request Oct 23, 2025
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@morrySnow morrySnow morrySnow approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

7 participants

@hello-stephen @doris-robot @morrySnow @morningman @dataroaring @CalvinKirs