Skip to content

[GLUTEN-1632][CH]Daily Update Clickhouse Version (20240920)#7299

Merged
baibaichen merged 4 commits intoapache:mainfrom
Kyligence:rebase_ch/20240920
Sep 20, 2024
Merged

[GLUTEN-1632][CH]Daily Update Clickhouse Version (20240920)#7299
baibaichen merged 4 commits intoapache:mainfrom
Kyligence:rebase_ch/20240920

Conversation

@kyligence-git
Copy link
Copy Markdown
Contributor

@kyligence-git kyligence-git commented Sep 20, 2024

Auto commit by gluten daily build, please check the build status and merge it if it's green.

@github-actions
Copy link
Copy Markdown

github-actions bot commented Sep 20, 2024

#1632

@github-actions
Copy link
Copy Markdown

github-actions bot commented Sep 20, 2024

Run Gluten Clickhouse CI

@baibaichen
Fix build due to ClickHouse/ClickHouse#69213
f119d27 
(cherry picked from commit ee116b28b6d8f39cab22d3b6a589a69594d3ccfd)
@baibaichen
Fix build due to ClickHouse/ClickHouse#69213
8fd85e1 
(cherry picked from commit 77a02cd273b572672532ca99ee179fd66a6c2e4c)
@github-actions
Copy link
Copy Markdown

github-actions bot commented Sep 20, 2024

Run Gluten Clickhouse CI

@github-actions
Copy link
Copy Markdown

github-actions bot commented Sep 20, 2024

Run Gluten Clickhouse CI

baibaichen
baibaichen approved these changes Sep 20, 2024
View reviewed changes
Copy link
Copy Markdown
Contributor

@baibaichen baibaichen left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@baibaichen baibaichen merged commit c5af284 into apache:main Sep 20, 2024
@GlutenPerfBot
Copy link
Copy Markdown
Contributor

GlutenPerfBot commented Sep 20, 2024

===== Performance report for TPCDS SF2000 with Velox backend, for reference only ====

query log/native_master_09_20_2024_time.csv log/native_master_09_19_2024_4e30ed1a09_time.csv difference percentage
q1 13.70 13.43 -0.271 98.02%
q2 15.30 15.77 0.466 103.05%
q3 2.99 5.18 2.186 173.00%
q4 71.62 71.65 0.034 100.05%
q5 10.47 8.45 -2.021 80.70%
q6 2.36 2.07 -0.290 87.71%
q7 8.33 7.30 -1.028 87.66%
q8 5.03 3.31 -1.725 65.71%
q9 23.94 24.61 0.669 102.79%
q10 9.25 9.33 0.081 100.87%
q11 36.61 37.83 1.221 103.34%
q12 1.40 1.40 0.001 100.09%
q13 6.37 6.49 0.120 101.89%
q14a 47.26 47.99 0.738 101.56%
q14b 41.89 40.67 -1.218 97.09%
q15 2.58 2.65 0.076 102.94%
q16 47.22 48.44 1.221 102.59%
q17 4.77 4.87 0.096 102.02%
q18 6.78 7.04 0.264 103.90%
q19 2.87 2.12 -0.750 73.86%
q20 1.52 1.48 -0.044 97.08%
q21 1.19 1.13 -0.054 95.41%
q22 7.74 7.85 0.109 101.40%
q23a 109.22 104.40 -4.819 95.59%
q23b 128.62 128.59 -0.026 99.98%
q24a 113.97 104.00 -9.968 91.25%
q24b 107.10 106.38 -0.719 99.33%
q25 4.02 4.27 0.250 106.22%
q26 4.09 3.94 -0.145 96.45%
q27 4.05 4.97 0.916 122.60%
q28 30.53 30.99 0.456 101.49%
q29 9.60 10.75 1.148 111.96%
q30 5.02 4.80 -0.218 95.65%
q31 7.10 7.15 0.055 100.77%
q32 1.18 1.22 0.038 103.22%
q33 4.87 4.24 -0.632 87.02%
q34 3.61 3.90 0.288 107.96%
q35 8.35 7.96 -0.380 95.44%
q36 5.53 5.39 -0.139 97.49%
q37 4.93 6.01 1.077 121.86%
q38 14.24 14.19 -0.045 99.68%
q39a 3.47 3.14 -0.330 90.51%
q39b 3.20 2.90 -0.298 90.69%
q40 4.02 4.06 0.037 100.92%
q41 0.74 0.64 -0.101 86.36%
q42 0.87 0.96 0.093 110.72%
q43 4.60 4.54 -0.060 98.70%
q44 8.36 9.23 0.871 110.41%
q45 3.25 3.31 0.057 101.74%
q46 3.58 3.75 0.167 104.67%
q47 17.47 17.70 0.231 101.32%
q48 4.97 4.84 -0.136 97.26%
q49 6.62 7.38 0.762 111.52%
q50 20.91 21.55 0.642 103.07%
q51 9.91 9.70 -0.212 97.87%
q52 1.03 1.06 0.021 102.04%
q53 2.13 2.17 0.037 101.73%
q54 3.76 3.75 -0.014 99.63%
q55 1.02 1.04 0.017 101.67%
q56 4.09 4.10 0.006 100.14%
q57 10.36 10.44 0.079 100.76%
q58 2.43 2.52 0.090 103.72%
q59 10.49 10.55 0.058 100.55%
q60 4.00 4.06 0.059 101.49%
q61 3.95 3.94 -0.007 99.82%
q62 4.88 4.48 -0.391 91.97%
q63 2.06 2.16 0.102 104.95%
q64 63.15 62.97 -0.179 99.72%
q65 18.48 18.05 -0.430 97.67%
q66 4.34 4.41 0.071 101.63%
q67 384.28 396.63 12.349 103.21%
q68 4.60 4.07 -0.532 88.43%
q69 4.99 5.47 0.482 109.65%
q70 11.30 12.82 1.522 113.47%
q71 2.83 2.33 -0.497 82.42%
q72 220.91 213.99 -6.917 96.87%
q73 2.39 2.27 -0.116 95.15%
q74 23.50 22.88 -0.621 97.36%
q75 27.56 26.57 -0.985 96.42%
q76 12.78 12.76 -0.019 99.85%
q77 2.13 2.24 0.110 105.16%
q78 49.57 49.17 -0.400 99.19%
q79 4.00 3.87 -0.137 96.59%
q80 11.48 11.10 -0.380 96.69%
q81 4.55 4.47 -0.073 98.39%
q82 7.15 6.53 -0.625 91.26%
q83 1.64 1.50 -0.143 91.27%
q84 2.72 2.83 0.116 104.28%
q85 7.61 7.41 -0.197 97.41%
q86 4.26 4.15 -0.105 97.54%
q87 15.99 13.95 -2.034 87.28%
q88 16.91 16.79 -0.122 99.28%
q89 3.54 3.13 -0.412 88.37%
q90 2.80 2.80 0.004 100.14%
q91 2.87 2.37 -0.500 82.61%
q92 1.30 1.32 0.018 101.37%
q93 41.59 40.66 -0.928 97.77%
q94 25.58 26.28 0.700 102.74%
q9 89.37 89.68 0.310 100.35%
q5 2.90 2.70 -0.199 93.14%
q96 18.19 18.01 -0.181 99.01%
q97 2.02 1.86 -0.162 91.97%
q98 11.10 10.95 -0.147 98.67%
q99 11.10 10.95 -0.147 98.67%
total 2189.75 2177.18 -12.567 99.43%

@GlutenPerfBot
Copy link
Copy Markdown
Contributor

GlutenPerfBot commented Sep 20, 2024

===== Performance report for TPCH SF2000 with Velox backend, for reference only ====

query log/native_master_09_20_2024_time.csv log/native_master_09_19_2024_4e30ed1a09_time.csv difference percentage
q1 53.92 52.97 -0.948 98.24%
q2 30.44 29.76 -0.688 97.74%
q3 51.55 53.52 1.969 103.82%
q4 41.96 41.89 -0.075 99.82%
q5 107.79 105.69 -2.105 98.05%
q6 11.75 12.00 0.249 102.12%
q7 110.86 112.13 1.264 101.14%
q8 117.79 116.72 -1.075 99.09%
q9 172.17 172.75 0.581 100.34%
q10 67.03 67.80 0.778 101.16%
q11 28.61 27.88 -0.731 97.45%
q12 32.40 31.38 -1.027 96.83%
q13 53.19 53.54 0.349 100.66%
q14 23.93 24.32 0.385 101.61%
q15 50.16 50.33 0.175 100.35%
q16 18.63 17.24 -1.382 92.58%
q17 125.35 126.55 1.200 100.96%
q18 199.60 199.39 -0.219 99.89%
q19 33.51 28.16 -5.350 84.04%
q20 43.78 42.03 -1.746 96.01%
q21 326.50 328.91 2.409 100.74%
q22 15.99 15.72 -0.271 98.31%
total 1716.92 1710.66 -6.256 99.64%

@GlutenPerfBot
Copy link
Copy Markdown
Contributor

GlutenPerfBot commented Sep 21, 2024

===== Performance report for TPCDS SF2000 with Velox backend, for reference only ====

query log/native_master_09_21_2024_time.csv log/native_master_09_20_2024_c5af284db5_time.csv difference percentage
q1 14.53 13.70 -0.829 94.29%
q2 14.65 15.30 0.655 104.47%
q3 5.06 2.99 -2.067 59.17%
q4 71.65 71.62 -0.027 99.96%
q5 8.87 10.47 1.606 118.11%
q6 2.38 2.36 -0.017 99.30%
q7 7.65 8.33 0.678 108.85%
q8 4.83 5.03 0.204 104.22%
q9 25.25 23.94 -1.307 94.83%
q10 8.75 9.25 0.500 105.72%
q11 36.88 36.61 -0.275 99.25%
q12 1.32 1.40 0.073 105.50%
q13 6.38 6.37 -0.013 99.80%
q14a 50.06 47.26 -2.799 94.41%
q14b 41.15 41.89 0.742 101.80%
q15 3.30 2.58 -0.724 78.07%
q16 47.37 47.22 -0.145 99.69%
q17 4.65 4.77 0.122 102.62%
q18 6.55 6.78 0.231 103.53%
q19 2.00 2.87 0.872 143.65%
q20 2.86 1.52 -1.337 53.26%
q21 1.27 1.19 -0.086 93.24%
q22 7.65 7.74 0.087 101.13%
q23a 103.49 109.22 5.734 105.54%
q23b 125.34 128.62 3.274 102.61%
q24a 111.89 113.97 2.080 101.86%
q24b 112.56 107.10 -5.460 95.15%
q25 4.23 4.02 -0.208 95.07%
q26 4.12 4.09 -0.038 99.08%
q27 4.90 4.05 -0.851 82.63%
q28 30.43 30.53 0.105 100.34%
q29 10.28 9.60 -0.677 93.41%
q30 5.33 5.02 -0.313 94.13%
q31 7.24 7.10 -0.137 98.10%
q32 1.19 1.18 -0.013 98.88%
q33 4.19 4.87 0.682 116.29%
q34 3.99 3.61 -0.377 90.55%
q35 7.67 8.35 0.679 108.86%
q36 5.23 5.53 0.304 105.81%
q37 4.94 4.93 -0.016 99.67%
q38 13.39 14.24 0.845 106.31%
q39a 3.08 3.47 0.397 112.88%
q39b 2.83 3.20 0.371 113.13%
q40 4.00 4.02 0.024 100.61%
q41 1.23 0.74 -0.494 59.89%
q42 0.88 0.87 -0.011 98.75%
q43 4.63 4.60 -0.027 99.43%
q44 9.39 8.36 -1.022 89.11%
q45 3.34 3.25 -0.089 97.32%
q46 3.74 3.58 -0.163 95.65%
q47 17.59 17.47 -0.117 99.34%
q48 4.94 4.97 0.029 100.58%
q49 6.73 6.62 -0.112 98.34%
q50 22.09 20.91 -1.177 94.67%
q51 9.89 9.91 0.020 100.20%
q52 1.05 1.03 -0.014 98.67%
q53 2.12 2.13 0.005 100.25%
q54 3.63 3.76 0.133 103.66%
q55 0.97 1.02 0.048 104.88%
q56 3.95 4.09 0.140 103.55%
q57 10.43 10.36 -0.068 99.35%
q58 2.46 2.43 -0.033 98.66%
q59 10.49 10.49 0.004 100.04%
q60 4.11 4.00 -0.103 97.49%
q61 3.99 3.95 -0.044 98.91%
q62 4.58 4.88 0.299 106.54%
q63 2.36 2.06 -0.299 87.31%
q64 59.29 63.15 3.860 106.51%
q65 19.01 18.48 -0.536 97.18%
q66 4.50 4.34 -0.164 96.35%
q67 393.68 384.28 -9.405 97.61%
q68 3.76 4.60 0.836 122.20%
q69 7.36 4.99 -2.368 67.81%
q70 10.67 11.30 0.630 105.91%
q71 2.47 2.83 0.360 114.59%
q72 219.90 220.91 1.005 100.46%
q73 2.40 2.39 -0.012 99.50%
q74 22.75 23.50 0.746 103.28%
q75 27.04 27.56 0.514 101.90%
q76 14.14 12.78 -1.368 90.33%
q77 2.33 2.13 -0.201 91.37%
q78 49.56 49.57 0.013 100.03%
q79 3.98 4.00 0.026 100.66%
q80 11.19 11.48 0.294 102.63%
q81 4.38 4.55 0.166 103.78%
q82 6.58 7.15 0.566 108.60%
q83 1.62 1.64 0.018 101.10%
q84 2.78 2.72 -0.066 97.63%
q85 6.76 7.61 0.855 112.65%
q86 4.25 4.26 0.011 100.27%
q87 14.33 15.99 1.657 111.56%
q88 17.34 16.91 -0.426 97.54%
q89 3.40 3.54 0.147 104.33%
q90 2.78 2.80 0.018 100.65%
q91 2.34 2.87 0.531 122.66%
q92 1.39 1.30 -0.088 93.69%
q93 41.78 41.59 -0.192 99.54%
q94 26.31 25.58 -0.723 97.25%
q9 86.92 89.37 2.454 102.82%
q5 2.38 2.90 0.519 121.78%
q96 18.29 18.19 -0.105 99.43%
q97 1.89 2.02 0.133 107.02%
q98 11.21 11.10 -0.111 99.01%
q99 11.21 11.10 -0.111 99.01%
total 2190.70 2189.75 -0.953 99.96%

@GlutenPerfBot
Copy link
Copy Markdown
Contributor

GlutenPerfBot commented Sep 22, 2024

===== Performance report for TPCDS SF2000 with Velox backend, for reference only ====

query log/native_master_09_22_2024_time.csv log/native_master_09_21_2024_c5af284db5_time.csv difference percentage
q1 14.69 14.53 -0.159 98.92%
q2 14.96 14.65 -0.311 97.92%
q3 2.95 5.06 2.116 171.84%
q4 70.29 71.65 1.353 101.93%
q5 9.96 8.87 -1.096 89.00%
q6 3.80 2.38 -1.423 62.54%
q7 6.21 7.65 1.449 123.34%
q8 3.54 4.83 1.290 136.49%
q9 25.95 25.25 -0.697 97.31%
q10 8.79 8.75 -0.042 99.52%
q11 38.07 36.88 -1.188 96.88%
q12 1.41 1.32 -0.086 93.88%
q13 6.45 6.38 -0.066 98.98%
q14a 47.48 50.06 2.576 105.43%
q14b 42.52 41.15 -1.375 96.77%
q15 2.53 3.30 0.770 130.43%
q16 47.87 47.37 -0.501 98.95%
q17 5.79 4.65 -1.139 80.32%
q18 6.89 6.55 -0.338 95.09%
q19 2.36 2.00 -0.364 84.61%
q20 1.49 2.86 1.368 191.72%
q21 1.20 1.27 0.075 106.29%
q22 8.76 7.65 -1.110 87.33%
q23a 104.35 103.49 -0.868 99.17%
q23b 128.63 125.34 -3.289 97.44%
q24a 111.52 111.89 0.372 100.33%
q24b 105.20 112.56 7.363 107.00%
q25 4.11 4.23 0.116 102.82%
q26 4.05 4.12 0.076 101.87%
q27 4.83 4.90 0.072 101.50%
q28 33.38 30.43 -2.954 91.15%
q29 11.21 10.28 -0.931 91.70%
q30 4.72 5.33 0.605 112.79%
q31 8.40 7.24 -1.160 86.18%
q32 1.39 1.19 -0.193 86.07%
q33 4.27 4.19 -0.078 98.16%
q34 3.74 3.99 0.250 106.69%
q35 7.66 7.67 0.005 100.06%
q36 4.92 5.23 0.311 106.33%
q37 4.86 4.94 0.086 101.77%
q38 14.23 13.39 -0.836 94.12%
q39a 3.44 3.08 -0.360 89.53%
q39b 3.32 2.83 -0.491 85.22%
q40 3.96 4.00 0.040 101.01%
q41 0.64 1.23 0.589 191.86%
q42 0.93 0.88 -0.046 95.03%
q43 4.64 4.63 -0.010 99.78%
q44 9.15 9.39 0.233 102.55%
q45 3.19 3.34 0.149 104.67%
q46 3.88 3.74 -0.132 96.60%
q47 18.41 17.59 -0.821 95.54%
q48 5.06 4.94 -0.119 97.64%
q49 6.75 6.73 -0.020 99.70%
q50 21.84 22.09 0.246 101.13%
q51 9.86 9.89 0.029 100.29%
q52 0.97 1.05 0.077 107.90%
q53 2.58 2.12 -0.452 82.45%
q54 3.66 3.63 -0.030 99.19%
q55 0.98 0.97 -0.008 99.16%
q56 4.06 3.95 -0.108 97.34%
q57 10.57 10.43 -0.135 98.72%
q58 2.42 2.46 0.035 101.45%
q59 10.78 10.49 -0.287 97.34%
q60 4.02 4.11 0.085 102.11%
q61 4.06 3.99 -0.070 98.27%
q62 4.66 4.58 -0.083 98.22%
q63 2.16 2.36 0.196 109.07%
q64 61.37 59.29 -2.075 96.62%
q65 17.54 19.01 1.473 108.40%
q66 6.17 4.50 -1.667 72.97%
q67 385.20 393.68 8.482 102.20%
q68 3.65 3.76 0.116 103.17%
q69 5.08 7.36 2.276 144.81%
q70 10.73 10.67 -0.057 99.47%
q71 2.52 2.47 -0.051 97.96%
q72 211.18 219.90 8.725 104.13%
q73 2.27 2.40 0.134 105.91%
q74 24.21 22.75 -1.461 93.96%
q75 26.22 27.04 0.818 103.12%
q76 11.53 14.14 2.612 122.65%
q77 2.02 2.33 0.307 115.20%
q78 49.00 49.56 0.556 101.13%
q79 3.84 3.98 0.138 103.58%
q80 11.39 11.19 -0.207 98.19%
q81 4.65 4.38 -0.265 94.29%
q82 6.94 6.58 -0.355 94.88%
q83 1.75 1.62 -0.127 92.71%
q84 2.85 2.78 -0.070 97.55%
q85 7.72 6.76 -0.965 87.50%
q86 4.73 4.25 -0.489 89.67%
q87 15.11 14.33 -0.782 94.83%
q88 17.21 17.34 0.129 100.75%
q89 3.21 3.40 0.182 105.67%
q90 2.81 2.78 -0.030 98.94%
q91 2.34 2.34 0.004 100.17%
q92 1.17 1.39 0.218 118.63%
q93 38.89 41.78 2.893 107.44%
q94 26.60 26.31 -0.296 98.89%
q9 86.83 86.92 0.084 100.10%
q5 2.79 2.38 -0.403 85.55%
q96 17.84 18.29 0.451 102.53%
q97 2.00 1.89 -0.107 94.65%
q98 9.41 11.21 1.805 119.19%
q99 9.41 11.21 1.805 119.19%
total 2170.15 2190.70 20.553 100.95%

@GlutenPerfBot
Copy link
Copy Markdown
Contributor

GlutenPerfBot commented Sep 22, 2024

===== Performance report for TPCH SF2000 with Velox backend, for reference only ====

query log/native_master_09_22_2024_time.csv log/native_master_09_20_2024_c5af284db5_time.csv difference percentage
q1 54.51 53.92 -0.596 98.91%
q2 30.49 30.44 -0.046 99.85%
q3 53.79 51.55 -2.240 95.84%
q4 42.96 41.96 -0.992 97.69%
q5 104.13 107.79 3.663 103.52%
q6 13.64 11.75 -1.890 86.14%
q7 114.15 110.86 -3.286 97.12%
q8 117.97 117.79 -0.174 99.85%
q9 169.69 172.17 2.479 101.46%
q10 67.14 67.03 -0.115 99.83%
q11 30.09 28.61 -1.481 95.08%
q12 31.26 32.40 1.149 103.68%
q13 52.22 53.19 0.975 101.87%
q14 25.00 23.93 -1.067 95.73%
q15 49.55 50.16 0.605 101.22%
q16 17.40 18.63 1.227 107.05%
q17 128.35 125.35 -3.002 97.66%
q18 200.09 199.60 -0.482 99.76%
q19 31.25 33.51 2.262 107.24%
q20 42.50 43.78 1.276 103.00%
q21 341.03 326.50 -14.529 95.74%
q22 15.51 15.99 0.486 103.13%
total 1732.69 1716.92 -15.778 99.09%

sharkdtu pushed a commit to sharkdtu/gluten that referenced this pull request Nov 11, 2024
@kyligence-git @baibaichen
[GLUTEN-1632][CH]Daily Update Clickhouse Version (20240920) (apache#7299
1ded58f 
)

* [GLUTEN-1632][CH]Daily Update Clickhouse Version (20240920)

* Fix build due to ClickHouse/ClickHouse#69213
---------

Co-authored-by: kyligence-git <gluten@kyligence.io>
Co-authored-by: Chang Chen <baibaichen@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@baibaichen baibaichen baibaichen approved these changes

Assignees

No one assigned

Labels

CLICKHOUSE

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@kyligence-git @GlutenPerfBot @baibaichen