Skip to content

[fix](serde)fix escaped char in serde for arr/map/struct #56208

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
amorynan wants to merge 15 commits into from
Closed

[fix](serde)fix escaped char in serde for arr/map/struct #56208

amorynan wants to merge 15 commits into from

Conversation

@amorynan
Copy link
Contributor

@amorynan amorynan commented Sep 18, 2025

What problem does this PR solve?

If we encounter some backslashes followed by some special characters that can be escaped, we should follow the json escaping behavior
Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason

  • Behavior changed:

    • No.
    • Yes.

  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@hello-stephen
Copy link
Contributor

hello-stephen commented Sep 18, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@amorynan
Copy link
Contributor Author

amorynan commented Sep 18, 2025

run buildall

@doris-robot
Copy link

doris-robot commented Sep 18, 2025

TPC-H: Total hot run time: 1522 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 77bde8487d118a87640c9f2f93dfe8bdba02035d, data reload: false

------ Round 1 ----------------------------------
q1	17645	30	19	19
q2	2612	27	26	26
q3	10712	21	16	16
q4	11157	17	16	16
q5	8112	15	14	14
q6	234	15	13	13
q7	966	23	22	22
q8	9453	15	14	14
q9	8006	24	13	13
q10	7038	12	11	11
q11	718	21	20	20
q12	356	13	11	11
q13	18645	13	11	11
q14	243	12	11	11
q15	611	13	12	12
q16	1072	1004	982	982
q17	573	13	11	11
q18	7741	12	11	11
q19	1162	13	12	12
q20	1989	405	244	244
q21	9216	22	21	21
q22	1131	13	12	12
Total cold run time: 119392 ms
Total hot run time: 1522 ms

----- Round 2, with runtime_filter_mode=off -----
q1	12	11	11	11
q2	21	20	20	20
q3	12	12	12	12
q4	13	12	12	12
q5	13	12	15	12
q6	13	11	10	10
q7	20	19	18	18
q8	11	11	12	11
q9	32	10	10	10
q10	10	9	10	9
q11	18	18	18	18
q12	10	9	10	9
q13	10	9	10	9
q14	10	10	10	10
q15	10	10	10	10
q16	1041	1092	1024	1024
q17	12	11	10	10
q18	10	11	11	11
q19	10	10	9	9
q20	1943	2060	1823	1823
q21	21	18	20	18
q22	11	10	10	10
Total cold run time: 3263 ms
Total hot run time: 3086 ms

@doris-robot
Copy link

doris-robot commented Sep 18, 2025

TPC-DS: Total hot run time: 2812 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 77bde8487d118a87640c9f2f93dfe8bdba02035d, data reload: false

query1	1083	20	12	12
query2	7131	17	15	15
query3	7629	12	12	12
query4	26837	13	12	12
query5	4414	12	11	11
query6	393	13	12	12
query7	5424	11	11	11
query8	366	20	18	18
query9	9212	12	10	10
query10	718	13	11	11
query11	16083	11	10	10
query12	182	11	10	10
query13	1738	13	11	11
query14	11013	15	15	15
query15	240	10	10	10
query16	7188	11	11	11
query17	1533	11	10	10
query18	2804	10	10	10
query19	215	10	9	9
query20	135	11	10	10
query21	225	11	11	11
query22	4033	9	9	9
query23	33844	18	15	15
query24	9257	13	12	12
query25	720	10	9	9
query26	1064	11	10	10
query27	3377	9	9	9
query28	6252	12	10	10
query29	1207	10	8	8
query30	619	13	10	10
query31	1729	10	10	10
query32	118	11	11	11
query33	1030	11	10	10
query34	1583	838	530	530
query35	905	11	10	10
query36	981	11	10	10
query37	120	10	10	10
query38	3541	11	10	10
query39	1567	723	769	723
query40	228	10	10	10
query41	84	11	10	10
query42	159	11	10	10
query43	506	10	10	10
query44	1389	10	9	9
query45	198	12	10	10
query46	975	11	9	9
query47	1785	10	8	8
query48	414	10	9	9
query49	1183	10	10	10
query50	799	10	10	10
query51	3910	11	10	10
query52	117	10	10	10
query53	249	11	10	10
query54	735	11	11	11
query55	93	10	9	9
query56	335	11	11	11
query57	1198	9	9	9
query58	320	11	11	11
query59	2634	10	9	9
query60	375	10	9	9
query61	188	10	8	8
query62	847	9	8	8
query63	290	11	11	11
query64	4093	10	10	10
query65	4124	10	8	8
query66	1104	11	10	10
query67	16749	16	12	12
query68	3542	11	8	8
query69	564	13	12	12
query70	1506	10	11	10
query71	420	371	350	350
query72	6995	10	12	10
query73	542	11	11	11
query74	9371	11	11	11
query75	3398	11	12	11
query76	2752	11	10	10
query77	1088	13	12	12
query78	9838	24	11	11
query79	1136	10	10	10
query80	859	12	17	12
query81	535	10	9	9
query82	477	10	11	10
query83	410	11	12	11
query84	417	11	10	10
query85	1719	11	9	9
query86	573	10	10	10
query87	4023	9	8	8
query88	2937	12	12	12
query89	413	11	10	10
query90	2139	9	9	9
query91	182	10	9	9
query92	79	9	9	9
query93	1121	9	8	8
query94	775	10	9	9
query95	535	11	11	11
query96	431	9	8	8
query97	3078	9	9	9
query98	230	239	235	235
query99	1497	11	10	10
Total cold run time: 285173 ms
Total hot run time: 2812 ms

@doris-robot
Copy link

doris-robot commented Sep 18, 2025

ClickBench: Total hot run time: 0.07 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 77bde8487d118a87640c9f2f93dfe8bdba02035d, data reload: false

query1	0.07	0.02	0.01
query2	0.10	0.01	0.00
query3	0.26	0.01	0.01
query4	1.75	0.00	0.01
query5	0.28	0.01	0.00
query6	1.69	0.00	0.00
query7	0.05	0.01	0.00
query8	0.06	0.00	0.00
query9	0.62	0.00	0.00
query10	0.58	0.01	0.01
query11	0.17	0.01	0.00
query12	0.16	0.01	0.01
query13	0.65	0.00	0.01
query14	1.07	0.00	0.01
query15	0.89	0.00	0.00
query16	0.40	0.00	0.01
query17	1.11	0.00	0.00
query18	0.22	0.00	0.01
query19	1.91	0.01	0.00
query20	0.02	0.01	0.00
query21	15.39	0.00	0.00
query22	5.97	0.01	0.00
query23	16.61	0.00	0.00
query24	1.33	0.00	0.01
query25	0.21	0.00	0.00
query26	0.17	0.00	0.00
query27	0.12	0.01	0.01
query28	1.12	0.01	0.00
query29	13.25	0.00	0.00
query30	0.30	0.00	0.00
query31	2.22	0.00	0.00
query32	5.86	0.00	0.00
query33	4.41	0.01	0.01
query34	7.27	0.00	0.00
query35	6.17	0.00	0.01
query36	0.70	0.00	0.01
query37	0.11	0.00	0.01
query38	0.07	0.01	0.00
query39	0.05	0.00	0.01
query40	0.18	0.01	0.01
query41	0.09	0.00	0.01
query42	0.06	0.00	0.00
query43	0.05	0.00	0.00
Total cold run time: 93.77 s
Total hot run time: 0.07 s

@amorynan amorynan force-pushed the fix-serde-with-excaped-char branch from 77bde84 to 665f688 Compare September 19, 2025 02:42
@amorynan
Copy link
Contributor Author

amorynan commented Sep 19, 2025

run buildall

@doris-robot
Copy link

doris-robot commented Sep 19, 2025

TPC-H: Total hot run time: 1482 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 49c49a89050d419533b766ebbc99a45c961fea4d, data reload: false

------ Round 1 ----------------------------------
q1	17614	37	19	19
q2	2633	26	25	25
q3	10722	17	15	15
q4	11202	19	17	17
q5	8107	15	15	15
q6	235	24	14	14
q7	979	25	23	23
q8	9623	13	11	11
q9	9875	15	11	11
q10	7009	12	12	12
q11	714	22	20	20
q12	689	12	10	10
q13	18672	12	11	11
q14	264	12	10	10
q15	626	12	11	11
q16	1082	987	943	943
q17	576	12	11	11
q18	7946	13	13	13
q19	1246	13	11	11
q20	1979	379	249	249
q21	9088	21	21	21
q22	1115	12	10	10
Total cold run time: 121996 ms
Total hot run time: 1482 ms

----- Round 2, with runtime_filter_mode=off -----
q1	12	11	10	10
q2	20	22	20	20
q3	11	11	11	11
q4	13	10	10	10
q5	11	10	10	10
q6	11	10	10	10
q7	19	20	20	20
q8	11	11	11	11
q9	11	11	11	11
q10	11	11	12	11
q11	20	22	20	20
q12	12	12	11	11
q13	12	9	10	9
q14	9	9	11	9
q15	10	11	11	11
q16	1082	1089	1019	1019
q17	12	10	9	9
q18	10	11	9	9
q19	10	11	10	10
q20	1955	1943	1854	1854
q21	21	19	18	18
q22	11	10	10	10
Total cold run time: 3294 ms
Total hot run time: 3113 ms

@doris-robot
Copy link

doris-robot commented Sep 19, 2025

TPC-DS: Total hot run time: 2743 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 49c49a89050d419533b766ebbc99a45c961fea4d, data reload: false

query1	1087	19	11	11
query2	7142	16	16	16
query3	7639	13	11	11
query4	26758	12	12	12
query5	4413	13	11	11
query6	376	11	10	10
query7	5449	13	10	10
query8	351	18	17	17
query9	9238	11	11	11
query10	721	11	10	10
query11	16100	11	11	11
query12	179	10	10	10
query13	1697	12	9	9
query14	10735	14	12	12
query15	227	12	10	10
query16	7159	12	11	11
query17	1531	11	35	11
query18	2773	10	9	9
query19	199	10	9	9
query20	133	12	11	11
query21	221	9	9	9
query22	3988	10	8	8
query23	33428	26	14	14
query24	9274	11	13	11
query25	718	9	7	7
query26	1062	10	9	9
query27	3414	10	9	9
query28	6252	11	10	10
query29	1224	10	10	10
query30	667	11	10	10
query31	1759	10	10	10
query32	117	11	10	10
query33	1063	10	9	9
query34	1606	815	517	517
query35	937	9	10	9
query36	984	10	9	9
query37	120	10	8	8
query38	3518	10	9	9
query39	1514	746	756	746
query40	227	11	9	9
query41	87	11	11	11
query42	149	10	9	9
query43	494	11	10	10
query44	1317	10	9	9
query45	189	10	10	10
query46	899	10	10	10
query47	1795	10	9	9
query48	404	10	10	10
query49	1145	11	11	11
query50	754	10	10	10
query51	3935	11	9	9
query52	121	10	9	9
query53	242	10	12	10
query54	710	9	10	9
query55	96	11	9	9
query56	321	11	11	11
query57	1183	9	8	8
query58	317	11	10	10
query59	2720	9	9	9
query60	369	10	9	9
query61	227	9	8	8
query62	836	10	10	10
query63	268	10	9	9
query64	3889	9	9	9
query65	4150	11	10	10
query66	1120	12	13	12
query67	16848	19	11	11
query68	3570	8	9	8
query69	558	9	44	9
query70	1444	10	9	9
query71	410	344	326	326
query72	7361	9	8	8
query73	524	9	8	8
query74	9595	10	9	9
query75	3384	10	8	8
query76	2508	10	9	9
query77	982	9	8	8
query78	9657	12	12	12
query79	1018	10	10	10
query80	713	13	13	13
query81	902	11	10	10
query82	207	10	11	10
query83	316	11	10	10
query84	1175	11	10	10
query85	1272	10	9	9
query86	374	10	10	10
query87	3914	9	8	8
query88	2862	15	11	11
query89	408	10	12	10
query90	2108	10	9	9
query91	235	9	7	7
query92	81	9	8	8
query93	1078	8	8	8
query94	778	10	9	9
query95	531	13	10	10
query96	446	9	9	9
query97	3059	9	8	8
query98	221	235	225	225
query99	1471	10	9	9
Total cold run time: 283747 ms
Total hot run time: 2743 ms

@doris-robot
Copy link

doris-robot commented Sep 19, 2025

ClickBench: Total hot run time: 0.08 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 49c49a89050d419533b766ebbc99a45c961fea4d, data reload: false

query1	0.07	0.02	0.01
query2	0.10	0.01	0.01
query3	0.27	0.01	0.01
query4	1.74	0.01	0.01
query5	0.29	0.00	0.00
query6	1.66	0.01	0.00
query7	0.05	0.01	0.00
query8	0.07	0.01	0.01
query9	0.61	0.00	0.01
query10	0.60	0.01	0.00
query11	0.19	0.01	0.00
query12	0.17	0.01	0.00
query13	0.63	0.00	0.00
query14	1.06	0.01	0.00
query15	0.87	0.00	0.00
query16	0.40	0.00	0.00
query17	1.07	0.01	0.00
query18	0.22	0.01	0.01
query19	1.93	0.00	0.01
query20	0.02	0.00	0.00
query21	15.40	0.00	0.00
query22	5.82	0.00	0.00
query23	16.66	0.00	0.00
query24	1.42	0.00	0.00
query25	0.21	0.00	0.01
query26	0.18	0.00	0.01
query27	0.10	0.01	0.00
query28	1.07	0.01	0.00
query29	13.27	0.00	0.00
query30	0.31	0.00	0.01
query31	2.25	0.00	0.00
query32	5.90	0.01	0.01
query33	4.36	0.00	0.01
query34	7.15	0.00	0.01
query35	6.19	0.01	0.00
query36	0.70	0.00	0.01
query37	0.11	0.00	0.00
query38	0.08	0.00	0.00
query39	0.04	0.01	0.01
query40	0.18	0.00	0.01
query41	0.09	0.00	0.01
query42	0.07	0.00	0.00
query43	0.05	0.01	0.00
Total cold run time: 93.63 s
Total hot run time: 0.08 s

@hello-stephen
Copy link
Contributor

hello-stephen commented Sep 19, 2025

BE UT Coverage Report

Increment line coverage 49.06% (26/53) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 52.34% (17596/33616)
Line Coverage 37.55% (159663/425158)
Region Coverage 32.11% (121666/378882)
Branch Coverage 33.43% (53303/159434)

@eldenmoon eldenmoon added the usercase Important user case type label label Sep 19, 2025
@hello-stephen
Copy link
Contributor

hello-stephen commented Sep 19, 2025

BE Regression && UT Coverage Report

Increment line coverage 84.91% (45/53) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 71.05% (23344/32857)
Line Coverage 57.42% (243637/424287)
Region Coverage 52.92% (203264/384076)
Branch Coverage 54.49% (87259/160137)

@amorynan
Copy link
Contributor Author

amorynan commented Sep 23, 2025

run buildall

@eldenmoon
Copy link
Member

eldenmoon commented Sep 29, 2025

run buildall

@amorynan
Copy link
Contributor Author

amorynan commented Oct 9, 2025

run buildall

@doris-robot
Copy link

doris-robot commented Oct 9, 2025

ClickBench: Total hot run time: 30.99 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 99dbcfa98b58d6bce0e18a66574df2df1d737aff, data reload: false

query1	0.06	0.05	0.04
query2	0.09	0.05	0.06
query3	0.25	0.08	0.08
query4	1.61	0.11	0.11
query5	0.27	0.25	0.25
query6	1.17	0.65	0.64
query7	0.03	0.02	0.02
query8	0.06	0.05	0.04
query9	0.63	0.53	0.53
query10	0.57	0.58	0.60
query11	0.17	0.12	0.11
query12	0.16	0.12	0.13
query13	0.64	0.63	0.62
query14	1.05	1.04	1.02
query15	0.87	0.85	0.86
query16	0.41	0.39	0.40
query17	1.06	1.03	1.07
query18	0.22	0.20	0.20
query19	1.93	1.88	1.86
query20	0.01	0.01	0.02
query21	15.43	0.93	0.58
query22	0.76	1.31	0.75
query23	14.74	1.37	0.70
query24	7.22	1.24	1.28
query25	0.54	0.19	0.08
query26	0.52	0.16	0.15
query27	0.07	0.06	0.06
query28	9.76	1.37	0.93
query29	12.59	3.90	3.21
query30	0.27	0.15	0.13
query31	2.82	0.61	0.40
query32	3.24	0.56	0.48
query33	3.13	3.04	3.11
query34	16.13	5.47	4.86
query35	5.02	4.99	4.95
query36	0.71	0.53	0.50
query37	0.10	0.08	0.07
query38	0.07	0.05	0.05
query39	0.04	0.03	0.03
query40	0.19	0.16	0.14
query41	0.09	0.04	0.03
query42	0.04	0.04	0.03
query43	0.04	0.04	0.03
Total cold run time: 104.78 s
Total hot run time: 30.99 s

@hello-stephen
Copy link
Contributor

hello-stephen commented Oct 9, 2025

BE UT Coverage Report

Increment line coverage 60.00% (12/20) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 52.49% (17708/33739)
Line Coverage 37.66% (160755/426876)
Region Coverage 32.17% (122889/381958)
Branch Coverage 33.55% (53856/160541)

@hello-stephen
Copy link
Contributor

hello-stephen commented Oct 9, 2025

BE Regression && UT Coverage Report

Increment line coverage 60.00% (12/20) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 57.25% (18924/33057)
Line Coverage 42.51% (181269/426445)
Region Coverage 37.30% (144290/386786)
Branch Coverage 38.22% (61664/161352)

@amorynan
Copy link
Contributor Author

amorynan commented Oct 9, 2025

run p0

@amorynan
Copy link
Contributor Author

amorynan commented Oct 9, 2025

run cloud_p0

@hello-stephen
Copy link
Contributor

hello-stephen commented Oct 9, 2025

BE Regression && UT Coverage Report

Increment line coverage 60.00% (12/20) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 57.25% (18924/33057)
Line Coverage 42.51% (181269/426445)
Region Coverage 37.30% (144290/386786)
Branch Coverage 38.22% (61664/161352)

@hello-stephen
Copy link
Contributor

hello-stephen commented Oct 9, 2025

BE Regression && UT Coverage Report

Increment line coverage 60.00% (12/20) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 57.76% (19095/33057)
Line Coverage 42.96% (183206/426445)
Region Coverage 37.73% (145946/386786)
Branch Coverage 38.65% (62370/161352)

@amorynan
Copy link
Contributor Author

amorynan commented Oct 13, 2025

run buildall

@doris-robot
Copy link

doris-robot commented Oct 13, 2025

TPC-DS: Total hot run time: 190039 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 135667bfc9f1fbe44c2a0c3401d0ef6ceebf1277, data reload: false

query1	1090	452	423	423
query2	4791	1709	1732	1709
query3	4441	224	220	220
query4	25661	23926	23587	23587
query5	1826	607	509	509
query6	298	283	248	248
query7	570	511	317	317
query8	303	276	285	276
query9	2990	2630	2590	2590
query10	382	356	317	317
query11	15121	15325	14953	14953
query12	173	126	120	120
query13	579	589	452	452
query14	10021	9591	9494	9494
query15	196	201	186	186
query16	6001	699	487	487
query17	1530	781	654	654
query18	2113	440	382	382
query19	213	207	174	174
query20	144	138	131	131
query21	235	135	123	123
query22	4118	4177	4095	4095
query23	34308	33172	33083	33083
query24	7896	2467	2448	2448
query25	634	514	459	459
query26	1285	271	161	161
query27	2746	508	364	364
query28	4439	2195	2166	2166
query29	875	610	501	501
query30	313	230	219	219
query31	890	802	713	713
query32	88	81	73	73
query33	576	379	347	347
query34	834	856	540	540
query35	820	856	771	771
query36	971	1036	949	949
query37	136	112	95	95
query38	3693	3667	3574	3574
query39	1504	1467	1454	1454
query40	224	136	126	126
query41	66	63	63	63
query42	134	113	111	111
query43	496	511	482	482
query44	1379	868	832	832
query45	192	184	177	177
query46	847	1053	671	671
query47	1790	1791	1705	1705
query48	393	426	321	321
query49	783	504	415	415
query50	652	701	415	415
query51	3992	3997	3921	3921
query52	117	119	107	107
query53	262	291	198	198
query54	648	612	535	535
query55	93	88	89	88
query56	333	321	316	316
query57	1190	1190	1108	1108
query58	294	291	291	291
query59	2522	2697	2573	2573
query60	360	364	338	338
query61	164	157	165	157
query62	802	768	675	675
query63	246	210	215	210
query64	4828	1185	855	855
query65	4087	3970	3996	3970
query66	1234	510	328	328
query67	15584	15383	15079	15079
query68	8318	949	606	606
query69	505	327	292	292
query70	1413	1341	1325	1325
query71	526	352	327	327
query72	6003	4850	4752	4752
query73	693	567	374	374
query74	8861	9151	8857	8857
query75	4064	3337	2900	2900
query76	4138	1156	737	737
query77	858	418	330	330
query78	9632	9906	8808	8808
query79	2433	830	588	588
query80	619	565	502	502
query81	514	270	243	243
query82	478	170	139	139
query83	280	270	254	254
query84	253	112	95	95
query85	897	502	431	431
query86	427	325	316	316
query87	3813	3757	3732	3732
query88	3634	2255	2243	2243
query89	392	341	314	314
query90	1835	230	225	225
query91	171	168	139	139
query92	86	71	71	71
query93	1802	985	660	660
query94	691	447	328	328
query95	415	323	315	315
query96	486	571	283	283
query97	2947	2975	2904	2904
query98	241	216	209	209
query99	1365	1436	1309	1309
Total cold run time: 257306 ms
Total hot run time: 190039 ms

@doris-robot
Copy link

doris-robot commented Oct 13, 2025

ClickBench: Total hot run time: 30.1 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 135667bfc9f1fbe44c2a0c3401d0ef6ceebf1277, data reload: false

query1	0.06	0.05	0.04
query2	0.09	0.05	0.05
query3	0.25	0.08	0.08
query4	1.61	0.12	0.12
query5	0.28	0.26	0.24
query6	1.18	0.66	0.67
query7	0.03	0.03	0.02
query8	0.05	0.04	0.04
query9	0.66	0.53	0.51
query10	0.58	0.58	0.58
query11	0.17	0.11	0.11
query12	0.15	0.11	0.13
query13	0.63	0.62	0.62
query14	1.07	1.04	1.03
query15	0.87	0.86	0.88
query16	0.40	0.39	0.39
query17	1.05	1.08	1.04
query18	0.21	0.20	0.20
query19	1.99	1.86	1.81
query20	0.02	0.01	0.02
query21	15.42	0.93	0.56
query22	0.76	1.20	0.69
query23	14.92	1.40	0.67
query24	7.56	0.90	0.32
query25	0.31	0.08	0.11
query26	0.52	0.17	0.13
query27	0.06	0.06	0.06
query28	8.88	1.42	0.92
query29	12.59	4.04	3.39
query30	0.29	0.13	0.10
query31	2.84	0.61	0.38
query32	3.24	0.57	0.48
query33	3.04	3.21	3.20
query34	16.24	5.48	4.82
query35	5.00	4.88	4.96
query36	0.70	0.52	0.51
query37	0.10	0.08	0.07
query38	0.07	0.05	0.05
query39	0.04	0.03	0.03
query40	0.18	0.15	0.14
query41	0.08	0.04	0.04
query42	0.04	0.03	0.03
query43	0.04	0.03	0.04
Total cold run time: 104.27 s
Total hot run time: 30.1 s

@doris-robot
Copy link

doris-robot commented Oct 13, 2025

BE UT Coverage Report

Increment line coverage 60.00% (12/20) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 52.53% (17750/33793)
Line Coverage 37.71% (161188/427458)
Region Coverage 32.18% (123055/382416)
Branch Coverage 33.58% (53981/160761)

@hello-stephen
Copy link
Contributor

hello-stephen commented Oct 13, 2025

BE Regression && UT Coverage Report

Increment line coverage 60.00% (12/20) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 57.55% (19057/33111)
Line Coverage 42.76% (182596/427048)
Region Coverage 37.41% (144886/387248)
Branch Coverage 38.36% (61988/161576)

@amorynan
Copy link
Contributor Author

amorynan commented Oct 17, 2025

run buildall

@doris-robot
Copy link

doris-robot commented Oct 17, 2025

ClickBench: Total hot run time: 30.04 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 634dbdb8f1619b217078cc3b47ed1fc588089a8c, data reload: false

query1	0.06	0.05	0.05
query2	0.10	0.05	0.06
query3	0.25	0.09	0.08
query4	1.61	0.12	0.12
query5	0.28	0.26	0.26
query6	1.16	0.65	0.66
query7	0.03	0.03	0.03
query8	0.05	0.04	0.04
query9	0.65	0.54	0.53
query10	0.58	0.58	0.58
query11	0.17	0.11	0.12
query12	0.15	0.13	0.12
query13	0.63	0.63	0.62
query14	1.03	1.02	1.02
query15	0.88	0.88	0.86
query16	0.40	0.41	0.40
query17	1.05	1.06	1.08
query18	0.22	0.21	0.20
query19	1.99	1.87	1.95
query20	0.02	0.01	0.02
query21	15.46	0.94	0.58
query22	0.76	1.26	0.64
query23	14.88	1.40	0.67
query24	7.14	1.17	0.32
query25	0.28	0.12	0.09
query26	0.61	0.17	0.14
query27	0.06	0.06	0.05
query28	8.96	1.41	0.93
query29	12.62	3.92	3.26
query30	0.30	0.16	0.12
query31	2.84	0.60	0.39
query32	3.24	0.56	0.48
query33	3.02	3.11	3.09
query34	16.13	5.46	4.84
query35	4.92	4.96	4.88
query36	0.71	0.52	0.51
query37	0.12	0.07	0.08
query38	0.07	0.05	0.05
query39	0.04	0.02	0.03
query40	0.19	0.16	0.15
query41	0.09	0.03	0.04
query42	0.04	0.03	0.03
query43	0.04	0.04	0.04
Total cold run time: 103.83 s
Total hot run time: 30.04 s

@doris-robot
Copy link

doris-robot commented Oct 17, 2025

BE UT Coverage Report

Increment line coverage 60.00% (12/20) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 52.54% (17820/33916)
Line Coverage 37.74% (161909/429016)
Region Coverage 32.19% (123468/383533)
Branch Coverage 33.60% (54211/161340)

@hello-stephen
Copy link
Contributor

hello-stephen commented Oct 17, 2025

BE Regression && UT Coverage Report

Increment line coverage 70.00% (14/20) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 71.24% (23686/33249)
Line Coverage 57.65% (247167/428712)
Region Coverage 52.75% (204898/388463)
Branch Coverage 54.53% (88465/162217)

@amorynan
Copy link
Contributor Author

amorynan commented Oct 31, 2025

run buildall

@doris-robot
Copy link

doris-robot commented Oct 31, 2025

TPC-DS: Total hot run time: 188324 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit d86bac639a736143ee8850775185e345ebc378be, data reload: false

query1	897	425	401	401
query2	2912	1709	1712	1709
query3	4408	225	221	221
query4	25208	23726	23546	23546
query5	1425	601	448	448
query6	277	249	241	241
query7	3249	516	296	296
query8	284	276	259	259
query9	4157	2596	2602	2596
query10	394	338	293	293
query11	15862	15198	14883	14883
query12	187	119	117	117
query13	1512	573	451	451
query14	9977	9277	9207	9207
query15	195	190	171	171
query16	6610	686	545	545
query17	799	795	632	632
query18	1926	439	334	334
query19	219	211	187	187
query20	129	129	126	126
query21	188	137	118	118
query22	4029	4211	4113	4113
query23	34119	33148	33167	33148
query24	9395	2415	2412	2412
query25	728	517	439	439
query26	1144	271	159	159
query27	2745	493	349	349
query28	4063	2198	2181	2181
query29	1003	615	493	493
query30	353	259	188	188
query31	915	818	740	740
query32	86	76	68	68
query33	678	371	326	326
query34	840	838	522	522
query35	841	834	765	765
query36	957	1015	929	929
query37	128	114	85	85
query38	3583	3539	3534	3534
query39	1498	1465	1424	1424
query40	286	126	117	117
query41	63	60	61	60
query42	129	116	105	105
query43	499	487	475	475
query44	1243	739	737	737
query45	186	183	173	173
query46	890	990	645	645
query47	1779	1817	1722	1722
query48	393	424	311	311
query49	1046	514	423	423
query50	640	704	400	400
query51	3996	3992	3878	3878
query52	112	110	108	108
query53	249	276	201	201
query54	358	293	294	293
query55	92	93	90	90
query56	318	333	304	304
query57	1166	1211	1120	1120
query58	286	277	274	274
query59	2552	2693	2632	2632
query60	345	354	332	332
query61	163	160	160	160
query62	792	701	675	675
query63	221	196	204	196
query64	3830	1202	875	875
query65	4058	3954	3946	3946
query66	1069	479	355	355
query67	15403	15246	15105	15105
query68	7695	921	594	594
query69	471	361	282	282
query70	1276	1228	1277	1228
query71	465	345	319	319
query72	5698	4789	4919	4789
query73	661	573	364	364
query74	8928	9173	8610	8610
query75	3530	3311	2781	2781
query76	3889	1156	734	734
query77	497	403	319	319
query78	9613	9499	8864	8864
query79	1141	835	589	589
query80	666	565	508	508
query81	503	266	229	229
query82	239	161	131	131
query83	279	264	249	249
query84	271	111	96	96
query85	883	474	438	438
query86	371	303	285	285
query87	3746	3723	3651	3651
query88	3593	2232	2236	2232
query89	388	326	299	299
query90	2058	211	206	206
query91	167	178	136	136
query92	84	64	64	64
query93	2018	947	633	633
query94	717	443	343	343
query95	404	325	304	304
query96	487	580	276	276
query97	2941	2953	2875	2875
query98	243	214	210	210
query99	1585	1406	1318	1318
Total cold run time: 255591 ms
Total hot run time: 188324 ms

@doris-robot
Copy link

doris-robot commented Oct 31, 2025

ClickBench: Total hot run time: 27.71 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit d86bac639a736143ee8850775185e345ebc378be, data reload: false

query1	0.05	0.04	0.04
query2	0.10	0.04	0.05
query3	0.25	0.08	0.08
query4	1.60	0.12	0.12
query5	0.27	0.26	0.25
query6	1.18	0.63	0.65
query7	0.03	0.02	0.03
query8	0.06	0.05	0.04
query9	0.61	0.53	0.52
query10	0.58	0.59	0.58
query11	0.16	0.10	0.11
query12	0.15	0.11	0.12
query13	0.62	0.61	0.60
query14	1.00	0.99	1.00
query15	0.85	0.84	0.83
query16	0.38	0.38	0.39
query17	1.04	1.01	1.03
query18	0.22	0.20	0.20
query19	1.89	1.82	1.81
query20	0.02	0.01	0.02
query21	15.43	0.16	0.12
query22	5.13	0.07	0.05
query23	15.70	0.26	0.09
query24	2.57	0.84	0.66
query25	0.07	0.07	0.06
query26	0.14	0.14	0.14
query27	0.06	0.05	0.05
query28	4.71	1.12	0.93
query29	12.55	3.95	3.32
query30	0.29	0.13	0.11
query31	2.81	0.59	0.37
query32	3.23	0.56	0.47
query33	3.03	3.02	3.06
query34	15.99	5.15	4.57
query35	4.57	4.53	4.58
query36	0.66	0.50	0.50
query37	0.10	0.07	0.07
query38	0.07	0.04	0.04
query39	0.03	0.03	0.03
query40	0.17	0.14	0.14
query41	0.09	0.03	0.03
query42	0.04	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 98.54 s
Total hot run time: 27.71 s

@hello-stephen
Copy link
Contributor

hello-stephen commented Oct 31, 2025

BE UT Coverage Report

Increment line coverage 55.32% (26/47) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 52.69% (18042/34244)
Line Coverage 37.95% (163849/431767)
Region Coverage 32.30% (124973/386911)
Branch Coverage 33.69% (54623/162155)

@hello-stephen
Copy link
Contributor

hello-stephen commented Oct 31, 2025

BE Regression && UT Coverage Report

Increment line coverage 87.23% (41/47) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 72.27% (24321/33653)
Line Coverage 59.09% (255523/432456)
Region Coverage 54.82% (215147/392465)
Branch Coverage 56.23% (91791/163256)

@eldenmoon eldenmoon closed this Dec 18, 2025
w41ter pushed a commit to w41ter/incubator-doris that referenced this pull request Dec 26, 2025
[fix](serde)fix escaped char in serde for arr apache#56208 (apache#5109)
0d3e109 
pick from apache#56208
w41ter pushed a commit to w41ter/incubator-doris that referenced this pull request Dec 26, 2025
@liaoxin01
Revert "[fix](serde)fix escaped char in serde for arr apache#56208" (a…
85bea80 
…pache#5181)

Reverts selectdb/selectdb-core#5109
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@eldenmoon eldenmoon eldenmoon left review comments

Assignees

No one assigned

Labels

dev/3.0.x dev/3.1.x dev/4.0.x usercase Important user case type label

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@amorynan @hello-stephen @doris-robot @eldenmoon