Skip to content

[GLUTEN-6067][CH][MINOR][UT] Followup 6623, fix backends-clickhouse ut issse in CI#6891

Merged
baibaichen merged 8 commits intoapache:mainfrom
baibaichen:feature/spark35ci1
Aug 17, 2024
Merged

[GLUTEN-6067][CH][MINOR][UT] Followup 6623, fix backends-clickhouse ut issse in CI#6891
baibaichen merged 8 commits intoapache:mainfrom
baibaichen:feature/spark35ci1

Conversation

@baibaichen
Copy link
Copy Markdown
Contributor

@baibaichen baibaichen commented Aug 16, 2024

What changes were proposed in this pull request?

Before this PR, we only run GlutenClickHouseNativeWriteTableSuite, tpcds parquet and tpch parquet, after this PR, we can run full backends-clickhouse UTs

(Fixes: #6067)

How was this patch tested?

existed UT

@github-actions github-actions bot added CORE works for Gluten Core CLICKHOUSE labels Aug 16, 2024
@github-actions
Copy link
Copy Markdown

#6067

@github-actions
Copy link
Copy Markdown

Run Gluten Clickhouse CI

@github-actions
Copy link
Copy Markdown

Run Gluten Clickhouse CI

@github-actions
Copy link
Copy Markdown

Run Gluten Clickhouse CI

@github-actions github-actions bot added the RSS label Aug 16, 2024
@github-actions
Copy link
Copy Markdown

Run Gluten Clickhouse CI

@github-actions
Copy link
Copy Markdown

Run Gluten Clickhouse CI

@github-actions
Copy link
Copy Markdown

Run Gluten Clickhouse CI

@baibaichen
Copy link
Copy Markdown
Contributor Author

baibaichen commented Aug 17, 2024

This PR with currnet CI pipeline:

image

This PR with new CI Pipeline:

image

Detail infos:

[2024-08-17T08:29:19.812Z] Run completed in 42 minutes, 24 seconds.
[2024-08-17T08:29:19.812Z] Total number of tests run: 1832
[2024-08-17T08:29:19.812Z] Suites: completed 56, aborted 0
[2024-08-17T08:29:19.812Z] Tests: succeeded 1832, failed 0, canceled 0, ignored 49, pending 0

....


[2024-08-17T08:31:28.397Z] [INFO] ------------------------------------------------------------------------
[2024-08-17T08:31:28.397Z] [INFO] Reactor Summary for Gluten Parent Pom 1.3.0-SNAPSHOT:
[2024-08-17T08:31:28.397Z] [INFO] 
[2024-08-17T08:31:28.397Z] [INFO] Gluten Parent Pom .................................. SUCCESS [  1.011 s]
[2024-08-17T08:31:28.397Z] [INFO] Gluten UI .......................................... SUCCESS [ 12.420 s]
[2024-08-17T08:31:28.397Z] [INFO] Gluten Shims ....................................... SUCCESS [  2.542 s]
[2024-08-17T08:31:28.397Z] [INFO] Gluten Shims Common ................................ SUCCESS [ 13.745 s]
[2024-08-17T08:31:28.397Z] [INFO] Gluten Shims for Spark 3.5 ......................... SUCCESS [ 10.904 s]
[2024-08-17T08:31:28.397Z] [INFO] Gluten Ras ......................................... SUCCESS [  1.013 s]
[2024-08-17T08:31:28.397Z] [INFO] Gluten Ras Common .................................. SUCCESS [ 30.916 s]
[2024-08-17T08:31:28.397Z] [INFO] Gluten Core ........................................ SUCCESS [ 49.873 s]
[2024-08-17T08:31:28.397Z] [INFO] Gluten Backends ClickHouse ......................... SUCCESS [43:16 min]
[2024-08-17T08:31:28.397Z] [INFO] Gluten Celeborn .................................... SUCCESS [  0.491 s]
[2024-08-17T08:31:28.397Z] [INFO] Gluten Celeborn Common ............................. SUCCESS [  3.884 s]
[2024-08-17T08:31:28.397Z] [INFO] Gluten Celeborn Clickhouse ......................... SUCCESS [01:18 min]
[2024-08-17T08:31:28.397Z] [INFO] Gluten Celeborn Package ............................ SUCCESS [  0.331 s]
[2024-08-17T08:31:28.397Z] [INFO] Gluten Package ..................................... SUCCESS [  3.139 s]
[2024-08-17T08:31:28.397Z] [INFO] Gluten Ras Planner ................................. SUCCESS [  0.999 s]
[2024-08-17T08:31:28.397Z] [INFO] Gluten Unit Test Parent ............................ SUCCESS [  0.380 s]
[2024-08-17T08:31:28.397Z] [INFO] Gluten Unit Test Common ............................ SUCCESS [  6.950 s]
[2024-08-17T08:31:28.397Z] [INFO] Gluten Unit Test ................................... SUCCESS [ 12.160 s]
[2024-08-17T08:31:28.397Z] [INFO] Gluten Unit Test Spark35 ........................... SUCCESS [ 21.036 s]

Copy link
Copy Markdown
Contributor

@taiyang-li taiyang-li left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@baibaichen baibaichen merged commit f41129e into apache:main Aug 17, 2024
@baibaichen baibaichen deleted the feature/spark35ci1 branch August 17, 2024 10:33
sharkdtu pushed a commit to sharkdtu/gluten that referenced this pull request Nov 11, 2024
…t issse in CI (apache#6891)

* fix fallback in spark 3.5

* Remove hive support in GlutenClickhouseFunctionSuite

* Move Hive related suite into hive package

* fix ut for spark 35

* fix celeborn ut for spark 35

* fix gluten ut for spark 35

* remove duplicated dependency

* fix dependency for spark 3.5 ut
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLICKHOUSE CORE works for Gluten Core RSS

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[CH] Support CH backend with Spark 3.5.x

3 participants