Skip to content

Conversation

@feiniaofeiafei
Copy link
Contributor

@feiniaofeiafei feiniaofeiafei commented Mar 25, 2024

This pr supports create view stmt in nereids planner. For example:

create view v1 as select * from t1

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@feiniaofeiafei
Copy link
Contributor Author

run buildall

@feiniaofeiafei feiniaofeiafei changed the title Create view [feat](nereids) support create view in nereids Mar 25, 2024
@doris-robot
Copy link

TPC-H: Total hot run time: 37763 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 4922b796e5cce4058f681e8b3c01a2d2523f6592, data reload: false

------ Round 1 ----------------------------------
q1	17641	4228	4073	4073
q2	2111	156	148	148
q3	10596	1160	1189	1160
q4	10225	703	815	703
q5	7470	2974	2951	2951
q6	198	124	125	124
q7	1033	579	565	565
q8	9337	2021	1971	1971
q9	7221	6674	6651	6651
q10	8456	3485	3562	3485
q11	432	223	216	216
q12	419	201	197	197
q13	17836	2814	2832	2814
q14	239	205	209	205
q15	517	474	460	460
q16	481	368	374	368
q17	953	526	611	526
q18	7064	6329	6533	6329
q19	1822	1423	1466	1423
q20	522	240	232	232
q21	3532	2865	2860	2860
q22	354	302	304	302
Total cold run time: 108459 ms
Total hot run time: 37763 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4122	4066	4036	4036
q2	323	224	225	224
q3	2938	2790	2831	2790
q4	1837	1513	1534	1513
q5	5287	5293	5313	5293
q6	189	115	115	115
q7	2218	1829	1855	1829
q8	3125	3277	3263	3263
q9	8686	8623	8671	8623
q10	3762	3747	3706	3706
q11	552	443	438	438
q12	731	517	531	517
q13	16922	2849	2869	2849
q14	281	257	262	257
q15	499	454	454	454
q16	487	419	421	419
q17	1713	1447	1466	1447
q18	7430	7075	7066	7066
q19	1610	1499	1496	1496
q20	1893	1717	1700	1700
q21	4905	4616	4727	4616
q22	496	446	448	446
Total cold run time: 70006 ms
Total hot run time: 53097 ms

@feiniaofeiafei
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 38292 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ba0a2abf8c1c79e24db42754e726924f8cf4d657, data reload: false

------ Round 1 ----------------------------------
q1	17782	4516	4136	4136
q2	2111	159	148	148
q3	10607	1169	1220	1169
q4	10500	785	814	785
q5	7511	3052	3059	3052
q6	205	129	127	127
q7	1058	601	589	589
q8	9706	2028	2010	2010
q9	7271	6642	6621	6621
q10	8396	3476	3561	3476
q11	430	218	215	215
q12	374	201	190	190
q13	17796	2885	2861	2861
q14	244	210	205	205
q15	512	450	458	450
q16	496	372	371	371
q17	956	621	569	569
q18	7368	6517	6511	6511
q19	2893	1410	1484	1410
q20	582	247	247	247
q21	3587	2950	2868	2868
q22	344	305	282	282
Total cold run time: 110729 ms
Total hot run time: 38292 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4122	4070	4097	4070
q2	335	235	228	228
q3	2994	2846	2836	2836
q4	1851	1559	1570	1559
q5	5317	5349	5365	5349
q6	198	118	119	118
q7	2241	1851	1877	1851
q8	3157	3320	3297	3297
q9	8730	8671	8721	8671
q10	3792	3790	3786	3786
q11	535	436	435	435
q12	723	537	588	537
q13	16880	2853	2843	2843
q14	296	261	247	247
q15	501	452	479	452
q16	467	411	419	411
q17	1747	1495	1460	1460
q18	7520	7183	7079	7079
q19	1639	1534	1537	1534
q20	1895	1751	1683	1683
q21	4772	4739	4803	4739
q22	531	438	450	438
Total cold run time: 70243 ms
Total hot run time: 53623 ms

@feiniaofeiafei
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 38149 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 3b9a8ace00b81478b67b566f0e11c15ceee0a272, data reload: false

------ Round 1 ----------------------------------
q1	18263	4422	4351	4351
q2	2832	198	195	195
q3	11199	1125	1173	1125
q4	10188	746	735	735
q5	7520	2767	2802	2767
q6	216	128	130	128
q7	1052	606	600	600
q8	9208	1974	2001	1974
q9	7475	6607	6493	6493
q10	8473	3458	3499	3458
q11	448	239	229	229
q12	384	218	230	218
q13	19054	2959	2962	2959
q14	277	232	249	232
q15	516	465	466	465
q16	531	387	389	387
q17	973	628	529	529
q18	7425	6789	6629	6629
q19	1555	1436	1405	1405
q20	674	308	289	289
q21	3407	2666	2824	2666
q22	377	315	316	315
Total cold run time: 112047 ms
Total hot run time: 38149 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4303	4219	4215	4215
q2	374	271	276	271
q3	2975	2740	2771	2740
q4	1840	1537	1506	1506
q5	5283	5220	5213	5213
q6	215	126	126	126
q7	2211	1864	1847	1847
q8	3206	3294	3294	3294
q9	8636	8566	8576	8566
q10	3919	3686	3673	3673
q11	589	490	478	478
q12	773	566	605	566
q13	17562	2922	3004	2922
q14	288	260	266	260
q15	499	472	464	464
q16	478	420	425	420
q17	1769	1423	1427	1423
q18	7668	7518	7459	7459
q19	1599	1556	1518	1518
q20	1926	1736	1744	1736
q21	4947	4776	4738	4738
q22	570	456	454	454
Total cold run time: 71630 ms
Total hot run time: 53889 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 182077 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 3b9a8ace00b81478b67b566f0e11c15ceee0a272, data reload: false

query1	892	1122	1126	1122
query2	7336	1988	1823	1823
query3	6660	218	223	218
query4	33268	21632	21263	21263
query5	4213	404	413	404
query6	241	188	185	185
query7	3991	317	301	301
query8	228	168	178	168
query9	5488	2273	2243	2243
query10	480	228	236	228
query11	14758	14243	14172	14172
query12	138	93	98	93
query13	950	360	379	360
query14	9246	6743	6796	6743
query15	221	179	196	179
query16	7349	269	282	269
query17	1418	585	572	572
query18	1909	290	289	289
query19	196	168	154	154
query20	94	95	90	90
query21	200	134	130	130
query22	4975	4889	4853	4853
query23	33255	32788	32925	32788
query24	12655	2794	2789	2789
query25	650	392	404	392
query26	1901	160	157	157
query27	3280	324	324	324
query28	7279	1851	1846	1846
query29	1051	639	638	638
query30	292	151	159	151
query31	926	712	740	712
query32	68	54	57	54
query33	600	261	259	259
query34	907	494	488	488
query35	802	698	677	677
query36	1030	953	899	899
query37	271	69	70	69
query38	3509	3424	3477	3424
query39	1588	1555	1525	1525
query40	284	134	132	132
query41	54	48	47	47
query42	110	99	98	98
query43	514	463	461	461
query44	1231	744	741	741
query45	283	271	269	269
query46	1069	718	693	693
query47	1951	1872	1851	1851
query48	385	302	308	302
query49	1177	369	371	369
query50	790	390	394	390
query51	6835	6778	6714	6714
query52	102	108	92	92
query53	348	281	286	281
query54	285	243	251	243
query55	89	86	82	82
query56	249	231	236	231
query57	1223	1125	1141	1125
query58	233	211	216	211
query59	2857	2655	2718	2655
query60	262	242	254	242
query61	121	118	120	118
query62	626	448	439	439
query63	310	288	282	282
query64	6574	4242	4202	4202
query65	3152	3035	3032	3032
query66	1394	367	335	335
query67	15629	14985	14913	14913
query68	10239	546	550	546
query69	619	314	297	297
query70	1249	1132	1189	1132
query71	550	270	273	270
query72	6441	2647	2444	2444
query73	1545	335	336	335
query74	7235	6500	6355	6355
query75	3857	2398	2274	2274
query76	6377	935	1042	935
query77	681	252	259	252
query78	11070	10292	10124	10124
query79	8988	547	556	547
query80	1462	429	429	429
query81	502	223	222	222
query82	465	91	96	91
query83	226	170	169	169
query84	258	83	88	83
query85	930	280	263	263
query86	352	289	275	275
query87	3692	3526	3596	3526
query88	5163	2437	2444	2437
query89	520	383	396	383
query90	2010	182	184	182
query91	133	102	97	97
query92	64	49	52	49
query93	5709	530	510	510
query94	1222	179	182	179
query95	393	321	310	310
query96	631	276	273	273
query97	2668	2457	2444	2444
query98	235	219	222	219
query99	1112	824	861	824
Total cold run time: 309050 ms
Total hot run time: 182077 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.87 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 3b9a8ace00b81478b67b566f0e11c15ceee0a272, data reload: false

query1	0.04	0.03	0.03
query2	0.08	0.04	0.04
query3	0.22	0.05	0.06
query4	1.68	0.08	0.08
query5	0.50	0.50	0.50
query6	1.13	0.66	0.65
query7	0.02	0.01	0.01
query8	0.05	0.05	0.04
query9	0.54	0.51	0.49
query10	0.54	0.55	0.56
query11	0.15	0.10	0.11
query12	0.14	0.11	0.11
query13	0.59	0.58	0.58
query14	0.77	0.78	0.79
query15	0.83	0.80	0.80
query16	0.35	0.37	0.38
query17	0.97	1.01	0.96
query18	0.23	0.21	0.22
query19	1.73	1.68	1.71
query20	0.01	0.00	0.01
query21	15.56	0.63	0.63
query22	2.67	2.14	2.41
query23	17.03	0.79	0.88
query24	1.15	0.23	0.22
query25	0.10	0.07	0.08
query26	0.24	0.17	0.16
query27	0.08	0.08	0.08
query28	14.01	0.94	0.93
query29	12.58	3.22	3.24
query30	0.28	0.08	0.08
query31	2.81	0.38	0.37
query32	3.30	0.45	0.45
query33	2.78	2.92	2.83
query34	16.81	4.40	4.45
query35	4.49	4.46	4.42
query36	0.59	0.46	0.47
query37	0.18	0.15	0.16
query38	0.14	0.14	0.14
query39	0.05	0.03	0.04
query40	0.18	0.14	0.15
query41	0.09	0.05	0.05
query42	0.06	0.05	0.05
query43	0.04	0.04	0.03
Total cold run time: 105.79 s
Total hot run time: 29.87 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 3b9a8ace00b81478b67b566f0e11c15ceee0a272 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       13.7 seconds inserted 10000000 Rows, about 729K ops/s

@feiniaofeiafei
Copy link
Contributor Author

run buildall

@feiniaofeiafei
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 38538 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 4a941dda85c42f4670d75e9ff6ffbc5e401eb4e4, data reload: false

------ Round 1 ----------------------------------
q1	17624	4096	4081	4081
q2	2091	194	182	182
q3	10477	1236	1369	1236
q4	10200	885	1012	885
q5	7492	2908	2916	2908
q6	210	134	131	131
q7	1092	636	615	615
q8	9414	2011	2009	2009
q9	6714	6194	6107	6107
q10	8457	3492	3463	3463
q11	426	245	231	231
q12	394	239	216	216
q13	17787	2927	2896	2896
q14	274	231	244	231
q15	532	477	486	477
q16	500	385	373	373
q17	940	924	913	913
q18	7238	6454	6404	6404
q19	1737	1524	1521	1521
q20	602	320	306	306
q21	3552	3053	3076	3053
q22	355	300	308	300
Total cold run time: 108108 ms
Total hot run time: 38538 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4061	4037	4037	4037
q2	329	225	220	220
q3	2950	2936	2923	2923
q4	1893	1837	1805	1805
q5	5212	5190	5202	5190
q6	210	124	124	124
q7	2248	1817	1798	1798
q8	3200	3268	3264	3264
q9	8460	8398	8431	8398
q10	3747	3887	3991	3887
q11	545	448	476	448
q12	742	562	592	562
q13	16831	3102	3114	3102
q14	309	288	273	273
q15	542	492	486	486
q16	520	480	465	465
q17	1778	1731	1727	1727
q18	8260	7756	7572	7572
q19	1675	1671	1672	1671
q20	2052	1832	1854	1832
q21	5212	4892	4899	4892
q22	504	456	446	446
Total cold run time: 71280 ms
Total hot run time: 55122 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 182456 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 4a941dda85c42f4670d75e9ff6ffbc5e401eb4e4, data reload: false

query1	1209	1115	1127	1115
query2	6357	2014	1790	1790
query3	6668	216	206	206
query4	24106	21464	21590	21464
query5	4179	403	404	403
query6	272	185	175	175
query7	4610	313	304	304
query8	245	186	179	179
query9	8493	2244	2215	2215
query10	442	239	261	239
query11	14952	14467	14671	14467
query12	145	97	92	92
query13	1627	389	371	371
query14	8561	6966	6913	6913
query15	215	176	179	176
query16	6874	292	281	281
query17	972	613	594	594
query18	1863	302	297	297
query19	220	173	166	166
query20	97	92	96	92
query21	198	128	139	128
query22	4975	4862	4869	4862
query23	33254	32564	32683	32564
query24	12867	3182	3182	3182
query25	727	439	438	438
query26	1886	173	164	164
query27	3265	393	393	393
query28	7072	1909	1882	1882
query29	1296	616	627	616
query30	309	159	165	159
query31	1083	775	760	760
query32	100	63	68	63
query33	697	257	260	257
query34	1116	501	523	501
query35	871	761	721	721
query36	983	892	868	868
query37	281	87	83	83
query38	3796	3593	3610	3593
query39	1669	1620	1720	1620
query40	248	150	144	144
query41	50	48	47	47
query42	122	114	107	107
query43	447	405	412	405
query44	1132	756	742	742
query45	289	264	266	264
query46	1103	855	839	839
query47	1992	1887	1986	1887
query48	401	326	316	316
query49	931	369	396	369
query50	838	409	419	409
query51	6846	6757	6781	6757
query52	117	111	99	99
query53	380	301	311	301
query54	314	235	230	230
query55	91	86	87	86
query56	254	251	237	237
query57	1274	1178	1161	1161
query58	249	233	236	233
query59	2524	2406	2541	2406
query60	251	247	239	239
query61	109	93	90	90
query62	677	447	446	446
query63	306	282	283	282
query64	5951	3038	3390	3038
query65	3029	3007	3022	3007
query66	1321	337	334	334
query67	15604	15154	14993	14993
query68	9032	582	595	582
query69	573	332	327	327
query70	1421	1119	1096	1096
query71	485	271	268	268
query72	6342	2604	2446	2446
query73	1534	329	333	329
query74	6671	6277	6318	6277
query75	3454	2274	2303	2274
query76	5148	1091	1187	1091
query77	573	260	258	258
query78	10934	10278	10212	10212
query79	8696	531	538	531
query80	1398	448	433	433
query81	484	230	225	225
query82	408	107	112	107
query83	221	165	167	165
query84	262	90	90	90
query85	920	302	304	302
query86	357	275	276	275
query87	3673	3593	3474	3474
query88	3739	2328	2295	2295
query89	549	375	373	373
query90	1928	176	180	176
query91	136	107	111	107
query92	66	52	52	52
query93	6605	526	524	524
query94	1133	196	198	196
query95	441	331	329	329
query96	606	268	272	268
query97	2662	2469	2530	2469
query98	230	215	212	212
query99	1216	832	855	832
Total cold run time: 297299 ms
Total hot run time: 182456 ms

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit ab8ade15b3ddcf441f651f60e22eec4c963510d0 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       13.6 seconds inserted 10000000 Rows, about 735K ops/s

@feiniaofeiafei
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 38503 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit bf7dee4d25dd8197886c2c1f81b73605e341d8a9, data reload: false

------ Round 1 ----------------------------------
q1	17615	4392	4227	4227
q2	1998	189	185	185
q3	10526	1201	1221	1201
q4	10482	826	732	732
q5	7820	2791	2676	2676
q6	214	134	131	131
q7	1023	592	596	592
q8	9210	2187	2036	2036
q9	7926	6584	6520	6520
q10	8438	3566	3504	3504
q11	461	235	224	224
q12	442	217	208	208
q13	17787	2920	2923	2920
q14	266	240	230	230
q15	521	483	465	465
q16	508	403	383	383
q17	960	668	667	667
q18	7390	6755	6702	6702
q19	1575	1484	1507	1484
q20	689	322	305	305
q21	3360	2810	2866	2810
q22	359	301	321	301
Total cold run time: 109570 ms
Total hot run time: 38503 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4274	4190	4203	4190
q2	366	255	265	255
q3	3003	2790	2791	2790
q4	1838	1585	1638	1585
q5	5307	5298	5312	5298
q6	211	122	122	122
q7	2248	1855	1885	1855
q8	3191	3341	3314	3314
q9	8553	8617	8482	8482
q10	3910	3733	3680	3680
q11	582	487	483	483
q12	763	588	597	588
q13	17581	2926	2866	2866
q14	283	259	264	259
q15	510	469	473	469
q16	469	413	410	410
q17	1799	1473	1460	1460
q18	7586	7357	7585	7357
q19	1632	1545	1605	1545
q20	1940	1761	1748	1748
q21	4903	4765	4695	4695
q22	539	443	463	443
Total cold run time: 71488 ms
Total hot run time: 53894 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 180922 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit bf7dee4d25dd8197886c2c1f81b73605e341d8a9, data reload: false

query1	1211	1135	1114	1114
query2	7021	1850	1848	1848
query3	6646	200	211	200
query4	37527	21560	21362	21362
query5	4142	404	394	394
query6	237	182	183	182
query7	4038	289	283	283
query8	227	166	162	162
query9	5773	2280	2272	2272
query10	501	232	236	232
query11	14511	14188	14126	14126
query12	136	91	85	85
query13	986	345	351	345
query14	8704	6839	6861	6839
query15	197	181	186	181
query16	6828	262	255	255
query17	1671	580	558	558
query18	1410	286	275	275
query19	200	152	154	152
query20	93	85	86	85
query21	202	131	123	123
query22	5017	4877	4777	4777
query23	33641	32955	32874	32874
query24	12555	2943	2935	2935
query25	542	374	399	374
query26	1848	153	151	151
query27	3095	308	309	308
query28	7639	1896	1881	1881
query29	850	619	599	599
query30	307	171	160	160
query31	935	707	709	707
query32	60	54	53	53
query33	589	248	242	242
query34	866	462	485	462
query35	799	679	685	679
query36	1018	892	868	868
query37	250	71	70	70
query38	3514	3468	3387	3387
query39	1607	1581	1502	1502
query40	278	128	129	128
query41	48	47	46	46
query42	103	97	99	97
query43	479	456	460	456
query44	1347	700	699	699
query45	285	262	250	250
query46	1043	703	728	703
query47	1948	1855	1840	1840
query48	361	278	280	278
query49	1172	382	363	363
query50	757	370	383	370
query51	6687	6689	6630	6630
query52	103	88	89	88
query53	346	280	281	280
query54	260	249	250	249
query55	78	70	73	70
query56	241	236	231	231
query57	1230	1109	1111	1109
query58	235	205	202	202
query59	2931	2649	2677	2649
query60	265	244	245	244
query61	114	108	107	107
query62	613	441	433	433
query63	303	274	281	274
query64	4986	4167	3480	3480
query65	3097	3048	3016	3016
query66	1325	330	320	320
query67	15682	15012	14913	14913
query68	9254	539	547	539
query69	606	298	305	298
query70	1293	1176	1131	1131
query71	560	265	273	265
query72	6544	2617	2397	2397
query73	984	313	318	313
query74	7136	6385	6367	6367
query75	3646	2235	2239	2235
query76	6180	1090	1141	1090
query77	654	248	241	241
query78	10832	10235	10196	10196
query79	11425	516	510	510
query80	1438	419	418	418
query81	539	246	227	227
query82	299	99	91	91
query83	214	167	164	164
query84	259	80	80	80
query85	1017	269	260	260
query86	345	307	297	297
query87	3711	3519	3487	3487
query88	5675	2260	2271	2260
query89	509	377	368	368
query90	2072	178	175	175
query91	123	96	95	95
query92	58	49	49	49
query93	5728	510	496	496
query94	1298	182	179	179
query95	406	313	309	309
query96	605	263	261	261
query97	2643	2433	2470	2433
query98	222	217	218	217
query99	1044	855	847	847
Total cold run time: 311029 ms
Total hot run time: 180922 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.65 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit bf7dee4d25dd8197886c2c1f81b73605e341d8a9, data reload: false

query1	0.04	0.04	0.03
query2	0.08	0.04	0.04
query3	0.24	0.05	0.04
query4	1.68	0.06	0.06
query5	0.48	0.50	0.48
query6	1.12	0.66	0.64
query7	0.02	0.01	0.02
query8	0.05	0.04	0.05
query9	0.55	0.49	0.48
query10	0.54	0.55	0.55
query11	0.17	0.11	0.11
query12	0.14	0.12	0.12
query13	0.59	0.58	0.58
query14	0.76	0.79	0.77
query15	0.82	0.81	0.79
query16	0.39	0.40	0.36
query17	0.94	1.02	0.97
query18	0.20	0.25	0.24
query19	1.76	1.73	1.71
query20	0.02	0.01	0.01
query21	15.42	0.65	0.64
query22	4.96	5.86	2.41
query23	18.20	1.38	1.10
query24	1.70	0.34	0.22
query25	0.14	0.09	0.08
query26	0.26	0.16	0.15
query27	0.09	0.08	0.08
query28	13.27	1.01	0.97
query29	12.60	3.30	3.29
query30	0.28	0.07	0.05
query31	2.85	0.39	0.37
query32	3.30	0.46	0.46
query33	2.84	2.78	2.89
query34	17.25	4.43	4.44
query35	4.55	4.57	4.59
query36	0.67	0.46	0.46
query37	0.18	0.15	0.15
query38	0.15	0.14	0.14
query39	0.05	0.03	0.04
query40	0.17	0.13	0.14
query41	0.09	0.04	0.05
query42	0.05	0.04	0.04
query43	0.04	0.03	0.04
Total cold run time: 109.7 s
Total hot run time: 30.65 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit bf7dee4d25dd8197886c2c1f81b73605e341d8a9 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       13.4 seconds inserted 10000000 Rows, about 746K ops/s

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Apr 11, 2024
@github-actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@morrySnow morrySnow merged commit ff13783 into apache:master Apr 12, 2024
liutang123 added a commit to liutang123/doris that referenced this pull request Apr 12, 2024
seawinde pushed a commit to seawinde/doris that referenced this pull request Apr 15, 2024
seawinde pushed a commit to seawinde/doris that referenced this pull request Apr 17, 2024
morrySnow pushed a commit that referenced this pull request Oct 23, 2024
…42206)

This is brought by #32743

set enable_unicode_name_support = true;
If run create view sql should fail beausel_shipdate column name contains
invalid char '(' and ')', but now success
this pr fix this and throw exception
`ERROR 1105 (HY000): errCode = 2, detailMessage = Incorrect column name
'(日期)'. Column regex is
'^[_a-zA-Z@0-9\s/][.a-zA-Z0-9_+-/?@#$%^&*"\s,:]{0,255}$'`


CREATE VIEW view1
AS
SELECT "零售公司", l_shipdate as '(日期)', l_receiptdate as k2
FROM lineitem;

and if run create view sql as following, should success:

CREATE VIEW view2
AS
SELECT "零售公司", l_shipdate as '日期', l_receiptdate as k2
FROM lineitem;

and the schema of view2 should be

mysql> desc view2;
+-------------+-------------+------+-------+---------+-------+
| Field       | Type        | Null | Key   | Default | Extra |
+-------------+-------------+------+-------+---------+-------+
| __literal_0 | varchar(16) | No   | false | NULL    |       |
| 日期        | date        | No   | false | NULL    |       |
| k2          | date        | No   | false | NULL    |       |
+-------------+-------------+------+-------+---------+-------+
3 rows in set (0.01 sec)
seawinde added a commit to seawinde/doris that referenced this pull request Oct 23, 2024
…pache#42206)

This is brought by apache#32743

set enable_unicode_name_support = true;
If run create view sql should fail beausel_shipdate column name contains
invalid char '(' and ')', but now success
this pr fix this and throw exception
`ERROR 1105 (HY000): errCode = 2, detailMessage = Incorrect column name
'(日期)'. Column regex is
'^[_a-zA-Z@0-9\s/][.a-zA-Z0-9_+-/?@#$%^&*"\s,:]{0,255}$'`

CREATE VIEW view1
AS
SELECT "零售公司", l_shipdate as '(日期)', l_receiptdate as k2
FROM lineitem;

and if run create view sql as following, should success:

CREATE VIEW view2
AS
SELECT "零售公司", l_shipdate as '日期', l_receiptdate as k2
FROM lineitem;

and the schema of view2 should be

mysql> desc view2;
+-------------+-------------+------+-------+---------+-------+
| Field       | Type        | Null | Key   | Default | Extra |
+-------------+-------------+------+-------+---------+-------+
| __literal_0 | varchar(16) | No   | false | NULL    |       |
| 日期        | date        | No   | false | NULL    |       |
| k2          | date        | No   | false | NULL    |       |
+-------------+-------------+------+-------+---------+-------+
3 rows in set (0.01 sec)
seawinde added a commit to seawinde/doris that referenced this pull request Oct 23, 2024
…pache#42206)

This is brought by apache#32743

set enable_unicode_name_support = true;
If run create view sql should fail beausel_shipdate column name contains
invalid char '(' and ')', but now success
this pr fix this and throw exception
`ERROR 1105 (HY000): errCode = 2, detailMessage = Incorrect column name
'(日期)'. Column regex is
'^[_a-zA-Z@0-9\s/][.a-zA-Z0-9_+-/?@#$%^&*"\s,:]{0,255}$'`


CREATE VIEW view1
AS
SELECT "零售公司", l_shipdate as '(日期)', l_receiptdate as k2
FROM lineitem;

and if run create view sql as following, should success:

CREATE VIEW view2
AS
SELECT "零售公司", l_shipdate as '日期', l_receiptdate as k2
FROM lineitem;

and the schema of view2 should be

mysql> desc view2;
+-------------+-------------+------+-------+---------+-------+
| Field       | Type        | Null | Key   | Default | Extra |
+-------------+-------------+------+-------+---------+-------+
| __literal_0 | varchar(16) | No   | false | NULL    |       |
| 日期        | date        | No   | false | NULL    |       |
| k2          | date        | No   | false | NULL    |       |
+-------------+-------------+------+-------+---------+-------+
3 rows in set (0.01 sec)
zy-kkk pushed a commit that referenced this pull request May 19, 2025
Related PR: #32743

Problem Summary:
problem before this pr:
1. null type problem
the type of NULL is null_type, this will lead to error when select this view through jdbc catalog.
```sql
mysql> CREATE VIEW test_null COMMENT '测试null类型' AS SELECT NULL AS `col1`;
Query OK, 0 rows affected (0.02 sec)

mysql> desc test_null;
+-------+-----------+------+-------+---------+-------+
| Field | Type      | Null | Key   | Default | Extra |
+-------+-----------+------+-------+---------+-------+
| col1  | null_type | Yes  | false | NULL    |       |
+-------+-----------+------+-------+---------+-------+
1 row in set (0.00 sec)
```
after this pr, the type is changed to tinyint.
mysql> CREATE VIEW test_null2 COMMENT '测试null类型' AS SELECT NULL AS `col1`;
Query OK, 0 rows affected (0.03 sec)
```sql
mysql> desc test_null2;
+-------+---------+------+-------+---------+-------+
| Field | Type    | Null | Key   | Default | Extra |
+-------+---------+------+-------+---------+-------+
| col1  | tinyint | Yes  | false | NULL    |       |
+-------+---------+------+-------+---------+-------+
1 row in set (0.01 sec)
```
2. nullable problem
Modify the internal elements of nested types returned by JDBC to always be null, in order to maintain consistency with Doris' internal implementation
### Release note
github-actions bot pushed a commit that referenced this pull request May 19, 2025
Related PR: #32743

Problem Summary:
problem before this pr:
1. null type problem
the type of NULL is null_type, this will lead to error when select this view through jdbc catalog.
```sql
mysql> CREATE VIEW test_null COMMENT '测试null类型' AS SELECT NULL AS `col1`;
Query OK, 0 rows affected (0.02 sec)

mysql> desc test_null;
+-------+-----------+------+-------+---------+-------+
| Field | Type      | Null | Key   | Default | Extra |
+-------+-----------+------+-------+---------+-------+
| col1  | null_type | Yes  | false | NULL    |       |
+-------+-----------+------+-------+---------+-------+
1 row in set (0.00 sec)
```
after this pr, the type is changed to tinyint.
mysql> CREATE VIEW test_null2 COMMENT '测试null类型' AS SELECT NULL AS `col1`;
Query OK, 0 rows affected (0.03 sec)
```sql
mysql> desc test_null2;
+-------+---------+------+-------+---------+-------+
| Field | Type    | Null | Key   | Default | Extra |
+-------+---------+------+-------+---------+-------+
| col1  | tinyint | Yes  | false | NULL    |       |
+-------+---------+------+-------+---------+-------+
1 row in set (0.01 sec)
```
2. nullable problem
Modify the internal elements of nested types returned by JDBC to always be null, in order to maintain consistency with Doris' internal implementation
### Release note
github-actions bot pushed a commit that referenced this pull request May 19, 2025
Related PR: #32743

Problem Summary:
problem before this pr:
1. null type problem
the type of NULL is null_type, this will lead to error when select this view through jdbc catalog.
```sql
mysql> CREATE VIEW test_null COMMENT '测试null类型' AS SELECT NULL AS `col1`;
Query OK, 0 rows affected (0.02 sec)

mysql> desc test_null;
+-------+-----------+------+-------+---------+-------+
| Field | Type      | Null | Key   | Default | Extra |
+-------+-----------+------+-------+---------+-------+
| col1  | null_type | Yes  | false | NULL    |       |
+-------+-----------+------+-------+---------+-------+
1 row in set (0.00 sec)
```
after this pr, the type is changed to tinyint.
mysql> CREATE VIEW test_null2 COMMENT '测试null类型' AS SELECT NULL AS `col1`;
Query OK, 0 rows affected (0.03 sec)
```sql
mysql> desc test_null2;
+-------+---------+------+-------+---------+-------+
| Field | Type    | Null | Key   | Default | Extra |
+-------+---------+------+-------+---------+-------+
| col1  | tinyint | Yes  | false | NULL    |       |
+-------+---------+------+-------+---------+-------+
1 row in set (0.01 sec)
```
2. nullable problem
Modify the internal elements of nested types returned by JDBC to always be null, in order to maintain consistency with Doris' internal implementation
### Release note
koarz pushed a commit to koarz/doris that referenced this pull request Jun 4, 2025
Related PR: apache#32743

Problem Summary:
problem before this pr:
1. null type problem
the type of NULL is null_type, this will lead to error when select this view through jdbc catalog.
```sql
mysql> CREATE VIEW test_null COMMENT '测试null类型' AS SELECT NULL AS `col1`;
Query OK, 0 rows affected (0.02 sec)

mysql> desc test_null;
+-------+-----------+------+-------+---------+-------+
| Field | Type      | Null | Key   | Default | Extra |
+-------+-----------+------+-------+---------+-------+
| col1  | null_type | Yes  | false | NULL    |       |
+-------+-----------+------+-------+---------+-------+
1 row in set (0.00 sec)
```
after this pr, the type is changed to tinyint.
mysql> CREATE VIEW test_null2 COMMENT '测试null类型' AS SELECT NULL AS `col1`;
Query OK, 0 rows affected (0.03 sec)
```sql
mysql> desc test_null2;
+-------+---------+------+-------+---------+-------+
| Field | Type    | Null | Key   | Default | Extra |
+-------+---------+------+-------+---------+-------+
| col1  | tinyint | Yes  | false | NULL    |       |
+-------+---------+------+-------+---------+-------+
1 row in set (0.01 sec)
```
2. nullable problem
Modify the internal elements of nested types returned by JDBC to always be null, in order to maintain consistency with Doris' internal implementation
### Release note
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants