Skip to content

[feature](inverted index) Support the IS NOT NULL condition in expr via inverted indexes #50748

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
eldenmoon merged 3 commits into from
May 16, 2025
Merged

[feature](inverted index) Support the IS NOT NULL condition in expr via inverted indexes #50748

eldenmoon merged 3 commits into from
May 16, 2025

Conversation

@csun5285
Copy link
Contributor

@csun5285 csun5285 commented May 9, 2025 •
edited
Loading

What problem does this PR solve?

Support the IS NOT NULL condition in expr via inverted indexes

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason

  • Behavior changed:

    • No.
    • Yes.

  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@hello-stephen
Copy link
Contributor

hello-stephen commented May 9, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@csun5285
Copy link
Contributor Author

csun5285 commented May 9, 2025

run buildall

@doris-robot
Copy link

doris-robot commented May 9, 2025

TPC-H: Total hot run time: 33725 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 44c0d0afe281b329a4ed6568ff34af0c8a1be0fd, data reload: false

------ Round 1 ----------------------------------
q1	26056	5556	4989	4989
q2	2094	289	187	187
q3	10378	1217	687	687
q4	10229	979	511	511
q5	7524	2316	2317	2316
q6	178	163	131	131
q7	919	745	604	604
q8	9323	1183	1043	1043
q9	6753	5092	5075	5075
q10	6851	2273	1884	1884
q11	472	294	256	256
q12	340	363	212	212
q13	17779	3699	3092	3092
q14	225	230	213	213
q15	535	484	492	484
q16	419	423	367	367
q17	588	842	360	360
q18	7564	7078	7208	7078
q19	1377	945	582	582
q20	324	331	229	229
q21	4167	3342	2460	2460
q22	1017	1020	965	965
Total cold run time: 115112 ms
Total hot run time: 33725 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5114	5113	5050	5050
q2	242	336	234	234
q3	2282	2704	2396	2396
q4	1429	1857	1409	1409
q5	4421	4391	4368	4368
q6	215	170	124	124
q7	1985	1888	1753	1753
q8	2577	2459	2533	2459
q9	7157	7159	6893	6893
q10	3044	3164	2729	2729
q11	562	518	512	512
q12	688	773	645	645
q13	3486	3937	3250	3250
q14	268	314	279	279
q15	537	499	500	499
q16	431	468	431	431
q17	1128	1528	1403	1403
q18	7753	7541	7393	7393
q19	823	823	891	823
q20	1979	2011	1842	1842
q21	5007	4842	4653	4653
q22	1071	1099	1041	1041
Total cold run time: 52199 ms
Total hot run time: 50186 ms

@doris-robot
Copy link

doris-robot commented May 9, 2025

TPC-DS: Total hot run time: 191505 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 44c0d0afe281b329a4ed6568ff34af0c8a1be0fd, data reload: false

query1	1406	1070	1071	1070
query2	6257	1734	1758	1734
query3	10988	4421	4315	4315
query4	53437	25309	23325	23325
query5	4994	508	456	456
query6	349	213	196	196
query7	4865	504	286	286
query8	330	257	241	241
query9	5646	2556	2541	2541
query10	413	317	249	249
query11	15085	15070	14797	14797
query12	160	108	101	101
query13	1026	497	387	387
query14	10085	6226	6348	6226
query15	198	195	173	173
query16	7121	634	519	519
query17	1073	727	562	562
query18	1513	414	297	297
query19	198	197	161	161
query20	124	124	117	117
query21	204	131	109	109
query22	4365	4487	4306	4306
query23	33877	33237	33117	33117
query24	6629	2389	2443	2389
query25	505	485	436	436
query26	677	286	162	162
query27	2138	514	338	338
query28	3087	2146	2141	2141
query29	604	597	454	454
query30	270	216	190	190
query31	882	872	820	820
query32	78	67	63	63
query33	456	413	310	310
query34	784	859	524	524
query35	789	834	766	766
query36	934	1002	929	929
query37	115	107	75	75
query38	4123	4269	4192	4192
query39	1545	1443	1487	1443
query40	216	121	105	105
query41	56	55	49	49
query42	118	103	113	103
query43	496	501	482	482
query44	1295	810	792	792
query45	187	174	165	165
query46	831	1029	624	624
query47	1851	1856	1849	1849
query48	376	421	302	302
query49	699	540	421	421
query50	682	692	404	404
query51	4201	4158	4104	4104
query52	108	105	101	101
query53	233	271	195	195
query54	575	587	501	501
query55	83	84	84	84
query56	303	290	324	290
query57	1151	1188	1096	1096
query58	258	257	240	240
query59	2673	2767	2625	2625
query60	348	352	321	321
query61	143	154	124	124
query62	734	747	683	683
query63	222	190	188	188
query64	1450	1031	719	719
query65	4410	4261	4150	4150
query66	724	404	313	313
query67	15620	15469	15373	15373
query68	7155	886	497	497
query69	524	293	254	254
query70	1213	1065	1098	1065
query71	498	315	289	289
query72	5562	4700	4895	4700
query73	1469	667	344	344
query74	9163	9074	9054	9054
query75	3814	3256	2696	2696
query76	4195	1201	750	750
query77	635	365	275	275
query78	10138	9982	9170	9170
query79	2235	794	559	559
query80	589	515	434	434
query81	486	254	215	215
query82	464	128	95	95
query83	249	239	236	236
query84	294	99	95	95
query85	776	351	323	323
query86	389	309	301	301
query87	4429	4412	4369	4369
query88	3778	2240	2211	2211
query89	433	317	278	278
query90	1805	211	216	211
query91	144	137	111	111
query92	79	58	54	54
query93	1781	954	578	578
query94	669	406	298	298
query95	366	293	287	287
query96	492	568	278	278
query97	3123	3273	3109	3109
query98	229	202	197	197
query99	1583	1395	1252	1252
Total cold run time: 296132 ms
Total hot run time: 191505 ms

@doris-robot
Copy link

doris-robot commented May 9, 2025

ClickBench: Total hot run time: 28.71 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 44c0d0afe281b329a4ed6568ff34af0c8a1be0fd, data reload: false

query1	0.04	0.03	0.03
query2	0.12	0.10	0.11
query3	0.26	0.18	0.19
query4	1.60	0.20	0.18
query5	0.59	0.58	0.62
query6	1.16	0.72	0.74
query7	0.02	0.02	0.02
query8	0.04	0.03	0.04
query9	0.56	0.52	0.50
query10	0.56	0.56	0.55
query11	0.14	0.12	0.11
query12	0.15	0.12	0.11
query13	0.61	0.59	0.60
query14	0.78	0.79	0.80
query15	0.87	0.85	0.83
query16	0.39	0.39	0.40
query17	1.05	1.00	1.08
query18	0.21	0.19	0.20
query19	1.84	1.78	1.79
query20	0.01	0.01	0.02
query21	15.40	0.92	0.59
query22	0.77	1.17	0.64
query23	14.97	1.39	0.60
query24	7.43	1.13	0.36
query25	0.28	0.12	0.18
query26	0.68	0.17	0.15
query27	0.05	0.05	0.05
query28	8.71	0.91	0.44
query29	12.53	4.01	3.32
query30	0.25	0.09	0.06
query31	2.82	0.59	0.38
query32	3.24	0.54	0.46
query33	3.04	3.10	3.12
query34	15.72	5.11	4.49
query35	4.48	4.58	4.45
query36	0.66	0.49	0.49
query37	0.08	0.06	0.06
query38	0.06	0.04	0.04
query39	0.03	0.03	0.02
query40	0.16	0.14	0.13
query41	0.08	0.03	0.02
query42	0.03	0.03	0.02
query43	0.03	0.03	0.03
Total cold run time: 102.5 s
Total hot run time: 28.71 s

@hello-stephen
Copy link
Contributor

hello-stephen commented May 9, 2025

BE UT Coverage Report

Increment line coverage 35.71% (20/56) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 55.68% (14872/26709)
Line Coverage 44.48% (131173/294929)
Region Coverage 43.38% (66102/152366)
Branch Coverage 38.05% (33738/88676)

@hello-stephen
Copy link
Contributor

hello-stephen commented May 9, 2025

BE Regression && UT Coverage Report

Increment line coverage 92.98% (53/57) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 79.39% (20822/26228)
Line Coverage 72.58% (213884/294693)
Region Coverage 70.78% (126582/178827)
Branch Coverage 64.40% (65218/101278)

@eldenmoon eldenmoon changed the title [fix](inverted index) Support the IS NOT NULL condition in expr via inverted indexes [feature](inverted index) Support the IS NOT NULL condition in expr via inverted indexes May 13, 2025
@csun5285
Copy link
Contributor Author

csun5285 commented May 14, 2025

run buildall

@doris-robot
Copy link

doris-robot commented May 14, 2025

TPC-H: Total hot run time: 34155 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b6b2769caaf1241fc3fd92fd299fac7d48f92b7a, data reload: false

------ Round 1 ----------------------------------
q1	26756	5127	5063	5063
q2	2074	298	198	198
q3	10364	1255	686	686
q4	10227	1001	511	511
q5	7511	2478	2397	2397
q6	197	168	137	137
q7	939	786	625	625
q8	9334	1394	1123	1123
q9	6771	5115	5102	5102
q10	6827	2337	1889	1889
q11	497	300	270	270
q12	348	358	216	216
q13	17770	3692	3095	3095
q14	239	233	213	213
q15	562	490	507	490
q16	433	446	373	373
q17	599	873	363	363
q18	7976	7155	7224	7155
q19	1221	976	560	560
q20	343	336	234	234
q21	3961	3354	2449	2449
q22	1058	1062	1006	1006
Total cold run time: 116007 ms
Total hot run time: 34155 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5137	5068	5082	5068
q2	240	326	227	227
q3	2176	2687	2282	2282
q4	1309	1777	1468	1468
q5	4539	4482	4378	4378
q6	218	167	128	128
q7	1966	1922	1769	1769
q8	2639	2577	2505	2505
q9	7116	7139	7148	7139
q10	3047	3189	2747	2747
q11	573	521	509	509
q12	704	801	636	636
q13	3499	3803	3182	3182
q14	275	300	285	285
q15	541	504	500	500
q16	454	489	439	439
q17	1163	1625	1346	1346
q18	7837	7448	7483	7448
q19	855	814	935	814
q20	1958	2021	1908	1908
q21	5051	4740	4500	4500
q22	1099	1032	1013	1013
Total cold run time: 52396 ms
Total hot run time: 50291 ms

@doris-robot
Copy link

doris-robot commented May 14, 2025

TPC-DS: Total hot run time: 188195 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b6b2769caaf1241fc3fd92fd299fac7d48f92b7a, data reload: false

query1	1007	477	496	477
query2	6569	1830	1797	1797
query3	6743	239	218	218
query4	26804	23772	23466	23466
query5	4311	635	474	474
query6	294	209	192	192
query7	4619	497	290	290
query8	291	256	239	239
query9	8631	2681	2679	2679
query10	485	356	281	281
query11	15338	15083	14943	14943
query12	163	110	110	110
query13	1667	537	443	443
query14	8823	6232	6212	6212
query15	210	199	202	199
query16	7127	645	464	464
query17	1113	719	576	576
query18	1975	392	293	293
query19	194	200	163	163
query20	124	122	118	118
query21	215	122	104	104
query22	4263	4261	4219	4219
query23	34011	33160	33361	33160
query24	8533	2417	2392	2392
query25	546	468	401	401
query26	1237	271	155	155
query27	2750	514	356	356
query28	4311	2153	2121	2121
query29	798	552	438	438
query30	284	218	189	189
query31	937	854	798	798
query32	75	65	61	61
query33	568	381	316	316
query34	815	845	526	526
query35	786	800	753	753
query36	952	989	909	909
query37	117	97	74	74
query38	4157	4247	4176	4176
query39	1457	1430	1412	1412
query40	218	129	115	115
query41	64	61	63	61
query42	127	114	112	112
query43	506	521	498	498
query44	1364	849	870	849
query45	183	170	168	168
query46	876	1034	673	673
query47	1779	1804	1723	1723
query48	405	434	325	325
query49	786	545	417	417
query50	650	694	409	409
query51	4119	4273	4198	4198
query52	111	111	112	111
query53	231	255	183	183
query54	597	585	537	537
query55	88	83	88	83
query56	310	319	310	310
query57	1171	1185	1056	1056
query58	305	254	264	254
query59	2536	2791	2546	2546
query60	334	318	301	301
query61	131	124	126	124
query62	798	758	664	664
query63	238	191	187	187
query64	4382	1020	679	679
query65	4315	4260	4303	4260
query66	1160	410	321	321
query67	16106	15777	15473	15473
query68	7788	914	540	540
query69	496	315	280	280
query70	1213	1108	1098	1098
query71	406	327	298	298
query72	5843	4875	4931	4875
query73	643	607	358	358
query74	9220	8968	8892	8892
query75	3236	3256	2772	2772
query76	3196	1186	783	783
query77	503	387	306	306
query78	10700	10267	9342	9342
query79	2274	838	586	586
query80	616	518	455	455
query81	495	272	229	229
query82	443	130	98	98
query83	264	260	242	242
query84	267	125	91	91
query85	890	356	316	316
query86	377	303	281	281
query87	4513	4458	4376	4376
query88	3609	2343	2339	2339
query89	388	320	285	285
query90	1867	208	207	207
query91	143	142	111	111
query92	85	64	62	62
query93	1688	962	600	600
query94	729	408	312	312
query95	389	297	289	289
query96	502	592	286	286
query97	3154	3270	3180	3180
query98	258	212	205	205
query99	1438	1391	1270	1270
Total cold run time: 274823 ms
Total hot run time: 188195 ms

@doris-robot
Copy link

doris-robot commented May 14, 2025

ClickBench: Total hot run time: 29.41 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b6b2769caaf1241fc3fd92fd299fac7d48f92b7a, data reload: false

query1	0.04	0.04	0.03
query2	0.13	0.10	0.11
query3	0.25	0.19	0.19
query4	1.59	0.19	0.12
query5	0.57	0.55	0.56
query6	1.21	0.72	0.72
query7	0.02	0.02	0.01
query8	0.04	0.03	0.04
query9	0.57	0.54	0.52
query10	0.57	0.58	0.56
query11	0.16	0.11	0.12
query12	0.14	0.12	0.12
query13	0.62	0.60	0.60
query14	0.79	0.81	0.83
query15	0.89	0.85	0.87
query16	0.39	0.38	0.39
query17	1.07	1.06	1.06
query18	0.23	0.21	0.21
query19	1.89	1.86	1.83
query20	0.01	0.01	0.01
query21	15.52	0.88	0.56
query22	0.75	1.25	0.66
query23	14.88	1.41	0.66
query24	7.00	0.88	0.87
query25	0.48	0.27	0.07
query26	0.56	0.16	0.14
query27	0.05	0.05	0.05
query28	9.33	0.96	0.46
query29	12.56	3.93	3.35
query30	0.25	0.09	0.07
query31	2.81	0.61	0.38
query32	3.23	0.56	0.47
query33	3.10	3.04	3.09
query34	15.84	5.13	4.51
query35	4.54	4.51	4.57
query36	0.67	0.50	0.48
query37	0.09	0.06	0.06
query38	0.05	0.04	0.04
query39	0.04	0.03	0.02
query40	0.17	0.15	0.13
query41	0.08	0.03	0.02
query42	0.04	0.03	0.02
query43	0.04	0.03	0.03
Total cold run time: 103.26 s
Total hot run time: 29.41 s

@doris-robot
Copy link

doris-robot commented May 14, 2025

BE UT Coverage Report

Increment line coverage 80.21% (77/96) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 55.85% (14913/26700)
Line Coverage 44.63% (131990/295746)
Region Coverage 43.74% (66459/151932)
Branch Coverage 38.33% (34043/88812)

@hello-stephen
Copy link
Contributor

hello-stephen commented May 14, 2025

BE Regression && UT Coverage Report

Increment line coverage 95.83% (92/96) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 79.27% (20821/26266)
Line Coverage 72.49% (214354/295682)
Region Coverage 70.67% (126102/178439)
Branch Coverage 64.41% (65330/101426)

@eldenmoon
Copy link
Member

eldenmoon commented May 14, 2025

run buildall

eldenmoon
eldenmoon approved these changes May 14, 2025
View reviewed changes
Copy link
Member

@eldenmoon eldenmoon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label May 14, 2025
@github-actions
Copy link
Contributor

github-actions bot commented May 14, 2025

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

github-actions bot commented May 14, 2025

PR approved by anyone and no changes requested.

@doris-robot
Copy link

doris-robot commented May 14, 2025

TPC-H: Total hot run time: 33936 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b6b2769caaf1241fc3fd92fd299fac7d48f92b7a, data reload: false

------ Round 1 ----------------------------------
q1	26437	5069	5158	5069
q2	2102	291	189	189
q3	10378	1259	697	697
q4	10233	1014	519	519
q5	7513	2352	2364	2352
q6	183	161	133	133
q7	944	745	643	643
q8	9331	1324	1056	1056
q9	6926	5063	5064	5063
q10	6891	2309	1925	1925
q11	504	291	274	274
q12	354	359	222	222
q13	17779	3745	3091	3091
q14	241	244	211	211
q15	528	482	498	482
q16	410	434	371	371
q17	599	882	360	360
q18	7439	7218	7222	7218
q19	2086	954	562	562
q20	321	337	221	221
q21	3729	3084	2368	2368
q22	1042	1008	910	910
Total cold run time: 115970 ms
Total hot run time: 33936 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5191	5074	5150	5074
q2	243	330	231	231
q3	2151	2651	2332	2332
q4	1385	1764	1362	1362
q5	4428	4412	4424	4412
q6	220	168	131	131
q7	2004	1962	1759	1759
q8	2561	2554	2516	2516
q9	7163	7245	6976	6976
q10	3048	3159	2747	2747
q11	579	499	479	479
q12	658	769	598	598
q13	3558	3980	3322	3322
q14	285	308	271	271
q15	549	498	497	497
q16	496	472	439	439
q17	1165	1585	1388	1388
q18	7718	7534	7495	7495
q19	858	944	1006	944
q20	2003	2028	1900	1900
q21	4703	4477	4393	4393
q22	1102	1082	976	976
Total cold run time: 52068 ms
Total hot run time: 50242 ms

@doris-robot
Copy link

doris-robot commented May 14, 2025

TPC-DS: Total hot run time: 193148 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b6b2769caaf1241fc3fd92fd299fac7d48f92b7a, data reload: false

query1	1408	1109	1099	1099
query2	6137	1792	1815	1792
query3	11023	4619	4573	4573
query4	55294	26074	23029	23029
query5	5011	486	461	461
query6	341	209	223	209
query7	4885	513	299	299
query8	316	249	246	246
query9	5942	2694	2713	2694
query10	453	330	284	284
query11	14932	14989	14863	14863
query12	158	110	101	101
query13	1035	527	417	417
query14	10115	6343	6408	6343
query15	233	207	176	176
query16	7236	660	508	508
query17	1080	724	583	583
query18	1702	410	304	304
query19	198	227	162	162
query20	137	135	119	119
query21	207	125	108	108
query22	4343	4526	4280	4280
query23	34250	33418	33288	33288
query24	6626	2446	2521	2446
query25	516	475	417	417
query26	691	292	158	158
query27	2197	531	350	350
query28	2890	2201	2192	2192
query29	618	587	465	465
query30	278	219	196	196
query31	875	862	784	784
query32	77	70	68	68
query33	473	374	339	339
query34	788	878	543	543
query35	823	868	785	785
query36	946	980	911	911
query37	116	105	79	79
query38	4198	4232	4240	4232
query39	1522	1457	1519	1457
query40	251	119	107	107
query41	56	55	55	55
query42	126	113	112	112
query43	511	509	483	483
query44	1397	859	873	859
query45	181	172	169	169
query46	861	1054	683	683
query47	1844	1854	1839	1839
query48	416	438	325	325
query49	696	508	440	440
query50	671	716	415	415
query51	4265	4237	4243	4237
query52	117	116	108	108
query53	253	262	189	189
query54	632	606	528	528
query55	89	91	93	91
query56	321	310	303	303
query57	1168	1214	1128	1128
query58	267	261	270	261
query59	2565	2746	2655	2655
query60	328	347	327	327
query61	154	128	122	122
query62	730	756	686	686
query63	229	194	201	194
query64	1765	1072	704	704
query65	4375	4191	4206	4191
query66	701	402	316	316
query67	16056	15744	15328	15328
query68	8287	892	532	532
query69	557	297	285	285
query70	1193	1151	1103	1103
query71	510	314	307	307
query72	5588	4760	4985	4760
query73	1465	642	359	359
query74	9201	8842	8947	8842
query75	3781	3270	2709	2709
query76	4171	1188	753	753
query77	604	385	289	289
query78	10052	10160	9317	9317
query79	2405	823	591	591
query80	606	508	462	462
query81	490	271	222	222
query82	448	126	103	103
query83	387	248	242	242
query84	295	99	86	86
query85	803	355	310	310
query86	421	301	285	285
query87	4510	4540	4336	4336
query88	3724	2425	2365	2365
query89	401	320	282	282
query90	1815	204	221	204
query91	145	142	113	113
query92	78	62	54	54
query93	2041	961	580	580
query94	655	413	308	308
query95	368	292	289	289
query96	510	582	287	287
query97	3165	3276	3109	3109
query98	243	203	213	203
query99	1393	1362	1246	1246
Total cold run time: 301407 ms
Total hot run time: 193148 ms

@doris-robot
Copy link

doris-robot commented May 14, 2025

ClickBench: Total hot run time: 28.97 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b6b2769caaf1241fc3fd92fd299fac7d48f92b7a, data reload: false

query1	0.04	0.03	0.03
query2	0.11	0.11	0.11
query3	0.26	0.20	0.19
query4	1.59	0.20	0.20
query5	0.59	0.59	0.59
query6	1.21	0.72	0.71
query7	0.02	0.01	0.02
query8	0.04	0.04	0.03
query9	0.57	0.52	0.53
query10	0.55	0.59	0.57
query11	0.15	0.11	0.11
query12	0.15	0.12	0.12
query13	0.62	0.61	0.60
query14	0.79	0.81	0.79
query15	0.88	0.85	0.88
query16	0.38	0.38	0.38
query17	1.02	1.03	1.05
query18	0.22	0.21	0.22
query19	1.93	1.76	1.81
query20	0.01	0.01	0.01
query21	15.39	0.93	0.56
query22	0.75	1.17	0.65
query23	14.93	1.45	0.62
query24	7.18	1.61	0.50
query25	0.48	0.19	0.15
query26	0.56	0.16	0.14
query27	0.06	0.05	0.04
query28	9.31	0.91	0.47
query29	12.54	3.92	3.28
query30	0.25	0.09	0.07
query31	2.82	0.59	0.39
query32	3.23	0.55	0.47
query33	2.97	3.04	3.09
query34	15.88	5.07	4.48
query35	4.50	4.54	4.49
query36	0.67	0.49	0.48
query37	0.09	0.06	0.06
query38	0.04	0.04	0.04
query39	0.03	0.03	0.02
query40	0.17	0.14	0.13
query41	0.08	0.02	0.03
query42	0.04	0.03	0.02
query43	0.04	0.04	0.03
Total cold run time: 103.14 s
Total hot run time: 28.97 s

@hello-stephen
Copy link
Contributor

hello-stephen commented May 14, 2025

BE Regression && UT Coverage Report

Increment line coverage 95.83% (92/96) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 79.27% (20821/26266)
Line Coverage 72.49% (214354/295682)
Region Coverage 70.67% (126102/178439)
Branch Coverage 64.41% (65330/101426)

@hello-stephen
Copy link
Contributor

hello-stephen commented May 14, 2025

BE UT Coverage Report

Increment line coverage 80.21% (77/96) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 55.85% (14913/26700)
Line Coverage 44.63% (132023/295805)
Region Coverage 43.74% (66479/151976)
Branch Coverage 38.33% (34050/88834)

@hello-stephen
Copy link
Contributor

hello-stephen commented May 14, 2025

BE Regression && UT Coverage Report

Increment line coverage 95.83% (92/96) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 79.27% (20821/26266)
Line Coverage 72.49% (214354/295682)
Region Coverage 70.67% (126102/178439)
Branch Coverage 64.41% (65330/101426)

@hello-stephen
Copy link
Contributor

hello-stephen commented May 14, 2025

BE Regression && UT Coverage Report

Increment line coverage 95.83% (92/96) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 79.36% (20846/26266)
Line Coverage 72.53% (214468/295682)
Region Coverage 70.72% (126199/178439)
Branch Coverage 64.45% (65365/101426)

airborne12
airborne12 approved these changes May 15, 2025
View reviewed changes
Copy link
Member

@airborne12 airborne12 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@hello-stephen
Copy link
Contributor

hello-stephen commented May 15, 2025

BE Regression && UT Coverage Report

Increment line coverage 95.83% (92/96) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 79.36% (20844/26266)
Line Coverage 72.56% (214549/295682)
Region Coverage 70.75% (126245/178439)
Branch Coverage 64.57% (65487/101426)

@eldenmoon eldenmoon merged commit 7c49f4f into apache:master May 16, 2025
26 of 29 checks passed
csun5285 added a commit to csun5285/doris that referenced this pull request May 20, 2025
@csun5285
[feature](inverted index) Support the IS NOT NULL condition in expr v…
4984056 
…ia inverted indexes (apache#50748)

Support the IS NOT NULL condition in expr via inverted indexes
@csun5285 csun5285 mentioned this pull request May 20, 2025
Closed
koarz pushed a commit to koarz/doris that referenced this pull request Jun 4, 2025
@csun5285 @koarz
[feature](inverted index) Support the IS NOT NULL condition in expr v…
8a8b5d6 
…ia inverted indexes (apache#50748)

Support the IS NOT NULL condition in expr via inverted indexes
csun5285 added a commit to csun5285/doris that referenced this pull request Jul 2, 2025
@csun5285
[feature](inverted index) Support the IS NOT NULL condition in expr v…
67e8fc8 
…ia inverted indexes (apache#50748)

Support the IS NOT NULL condition in expr via inverted indexes
@csun5285 csun5285 mentioned this pull request Jul 2, 2025
Merged
morrySnow pushed a commit that referenced this pull request Jul 3, 2025
@csun5285
branch-3.1: [feature](inverted index) Support the IS NOT NULL conditi…
16014b8 
…on in expr via inverted indexes #50748 (#52644)

pick from master #50748
etah000 pushed a commit to etah000/doris that referenced this pull request Jul 7, 2025
@csun5285 @etah000
branch-3.1: [feature](inverted index) Support the IS NOT NULL conditi…
a81e38d 
…on in expr via inverted indexes apache#50748 (apache#52644)

pick from master apache#50748
@airborne12 airborne12 mentioned this pull request Oct 14, 2025
Merged
16 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@airborne12 airborne12 airborne12 approved these changes

@eldenmoon eldenmoon eldenmoon approved these changes

Assignees

No one assigned

Labels

approved Indicates a PR has been approved by one committer. dev/3.1.0-merged reviewed

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

6 participants

@csun5285 @hello-stephen @doris-robot @eldenmoon @airborne12 @morrySnow