Feature Request

For English only, other languages will not accept.

Please pay attention on issues you submitted, because we maybe need more details.
If no response anymore and we cannot make decision by current information, we will close it.

Please answer these questions before submitting your issue. Thanks!

Is your feature request related to a problem?

• Yes. Refer to Build GraalVM Native Image nightly for ShardingSphere Proxy #21051 and Graalvm native image cause with Groovy 4 #17779 .

Describe the feature you would like.

• There is currently a nightly build of ShardingSphere Proxy at https://github.com/orgs/apache/packages/container/package/shardingsphere-proxy-native. But it didn't reach usable status because it wasn't ready yet. For some related error logs, please refer to the logs of https://github.com/apache/shardingsphere/actions/runs/3185102779/jobs/5194279014 .

• This issue aims to do the following to bring the nightly build to a usable state.

• Add nightly builds of GitHub Action Job and corresponding documentation.

• Introduces JUnit Platform and JUnit Vintage to replace JUnit 4 to provide the ability to unit test inside GraalVM Native Image. Reference Support JUnit 4 via the VintageTestEngine graalvm/native-build-tools#53 . This issue may need to wait for Migrate certain aspects of JUnit support to the JUnit 5 project graalvm/native-build-tools#313 to be closed before it is actually resolved.

• Update most of the dependencies to match the metadata provided by https://github.com/oracle/graalvm-reachability-metadata , including but not limited to com.zaxxer:HikariCP:3.4.2. This also involves submitting metadata for new third-party dependencies to https://github.com/oracle/graalvm-reachability-metadata . Of course, this problem may also be alleviated by Introduce a default-for attribute oracle/graalvm-reachability-metadata#62 .

• Introduce GraalVM Agent in GraalVM Native Build Tools. I hope to wait for Add agent modes to Maven plugin graalvm/native-build-tools#260 to be resolved. But if the problem mentioned in Maven agent modes support work graalvm/native-build-tools#315 is still not solved, I will follow what I mentioned in https://twitter.com/linghengqian/status/1575865141198934016?s=20&t=iVsRyWdOhmXeAMt_bnXRyg operation to introduce it.

• Update the GraalVM CE version used by GitHub Actions to 22.3.0 or higher to resolve an issue involving server.yaml in ShardingSphere Proxy not being scanned from the classpath. Refer to Cannot resolve FileSystem root resource in Native Image oracle/graal#5020 and Native Image FileSystem is trailing slash sensitive oracle/graal#5080 .

• Works with Groovy 4 specific issues. Its GraalVM Reachability Metadata seems very special that we shouldn't commit metadata to Oracle's Git repository. It's metadata looks like what is mentioned in Update Groovy version to fix the problem about IndyInterface #18175 and Can't build Groovy Application graalvm/native-build-tools#324 (comment) dynamically.

• Working on a fix for Apache Calcite, due to [CALCITE-4882] Introduce new Lambda-based Metadata framework calcite#2603 being closed, may need to be introduced in a unique way https://twitter.com/intjesus/status/1567276748257259520?s=20&t=nUlN7LI8e9_2KO9lPwCqaw, Implement Calcite native library that parses sql and returns a binary substrait representation substrait-io/substrait#21 and a component of https://github.com/substrait-io/substrait-java/tree/main/isthmus . This allowed us to finally get rid of https://github.com/apache/calcite/blob/master/core/src/main/java/org/apache/calcite/util/javac/JaninoCompiler.java like this, Janino related classes .

• The PRs involved in this issue are as follows:

  • Update Mockito and ByteBuddy to help with GraalVM integration #17665
  • Update Groovy version to fix the problem about IndyInterface #18175
  • Update Apache Calcite to 1.30.0 to improve GraalVM support #19737
  • Update H2DataBase to 2.x and drop support for H2Database 1.x #19964
  • Update Junit to 4.13.2 and migrate deprecated APIs to Hamcrest #20937
  • Update CODE_OF_CONDUCT about assertThat #21046
  • Build GraalVM Native Image nightly for ShardingSphere Proxy #21109
  • Fixes documentation for building GraalVM Native Image #21341
  • Update library to serve building GraalVM Native Image #21571
  • Add Release Profile for distribution/proxy-native #21657
  • Fix nightly builds of GraalVM Native Image #21688
  • Upgrade dependent versions and fix plugin settings for building GraalVM Native Image #22169
  • Add support for com.github.luben:zstd-jni:1.5.2-5 oracle/graalvm-reachability-metadata#121
  • Add support for java.sql.Date in IntervalShardingAlgorithm #22495
  • Add support for com.google.protobuf:protobuf-java-util:3.21.12 oracle/graalvm-reachability-metadata#167
  • Add support for org.opengauss:opengauss-jdbc:3.1.0-og oracle/graalvm-reachability-metadata#168
  • Add support for com.hazelcast:hazelcast:5.2.1 oracle/graalvm-reachability-metadata#169
  • Add support for io.etcd:jetcd-core:0.7.5 oracle/graalvm-reachability-metadata#170
  • Add user-code-filter.json for unit tests of org.opengauss:opengauss-jdbc oracle/graalvm-reachability-metadata#174
  • Add support for javax.cache:cache-api:1.1.1 oracle/graalvm-reachability-metadata#176
  • Add support for com.github.ben-manes.caffeine:caffeine:3.1.2 oracle/graalvm-reachability-metadata#193
  • Use GraalVM CE 22.3.1 to fix Nightly Build #23728
  • Remove when entries for mockito that are not used in unit tests shardingsphere-elasticjob#2179
  • Introduce Truffle Espresso to make GroovyShell available under GraalVM Native Image #23873
  • Fix nightly builds and release profile of ShardingSphere Proxy Native #23957
  • Update the project's Junit and GraalVM Native Build Tools versions oracle/graalvm-reachability-metadata#218
  • Update seata-all to handle cglib breaking unit test execution with GraalVM Tracing Agent #24177
  • Initialize the generateStandardMetadata Maven Profile of all module #24271
  • Fix wrong classpath in Espresso context #24912
  • Update seata-all and netty to fix nativeTest in GraalVM Native Build Tools #24929
  • Supports compilation through OpenJDK 20 and its downstream distributions #25181
  • Re-design for ShardingSphere groovy expr #25509
  • Restrict Espresso API to only detect JAVA_HOME under Native Image #25515
  • Remove deleted module from the infra-util module POM #25523
  • Fix build-proxy-native-image job on Nightly Build #25632
  • Update the version of GraalVM CE used by ShardingSphere Proxy Native to 23.0.1 #27487
  • Relax time limits for nightly builds involving test with GraalVM Tracing Agent #28060
  • Disable the implementation of Etcd during the build of ShardingSphere Proxy Native #28194
  • Fixes OutOfMemoryError unique to building GraalVM Native Image on Github Actions devices #28213
  • Refactor shardingsphere-infra-expr to expose the use of Row Value Expressions SPI #28340
  • Add support for org.apache.commons:commons-dbcp2:2.9.0 oracle/graalvm-reachability-metadata#380
  • Add support for com.github.ben-manes.caffeine:caffeine:2.9.3 oracle/graalvm-reachability-metadata#388
  • Support org.junit.jupiter.api.condition.EnabledOnOs in NativeTest graalvm/native-build-tools#504
  • Add support for org.apache.shardingsphere.elasticjob:elasticjob-lite-core:3.0.3 oracle/graalvm-reachability-metadata#390
  • Support for building with OpenJDK 21 #28326
  • Update the infra-expr-espresso module related GraalVM CE version to 23.1.1 #28609
  • Add documentation about the infra-expr-espresso module #28610
  • Explicitly declare dependencies for plexus-xml and plexus-utils graalvm/native-build-tools#484
  • Support org.junit.jupiter.api.condition.EnabledOnOs in NativeTest graalvm/native-build-tools#504
  • Provides built-in GraalVM Reachability Metadata for core features of ShardingSphere JDBC and adds nativeTest-related unit test subsets #29000
  • Open the resource:/ related FileSystem for JDBCRepositorySQLLoader in the GraalVM Native Image environment #29009
  • Migrate JAXB Runtime from com.sun.xml.bind:jaxb-impl to org.glassfish.jaxb:jaxb-runtime #29013
  • Make JDBCRepositorySQLLoader avoid using Path#toFile in GraalVM Native Image #29014
  • Declare in the document that ReadWriteSplitting Config is parsed by GroovyShell by default and adds corresponding unit tests #29034