Skip to content

[SPARK-54100][BUILD] Remove ignore.symbol.file Javac option#52802

Closed
dongjoon-hyun wants to merge 1 commit intoapache:masterfrom
dongjoon-hyun:SPARK-54100
Closed

[SPARK-54100][BUILD] Remove ignore.symbol.file Javac option#52802
dongjoon-hyun wants to merge 1 commit intoapache:masterfrom
dongjoon-hyun:SPARK-54100

Conversation

@dongjoon-hyun
Copy link
Member

@dongjoon-hyun dongjoon-hyun commented Oct 30, 2025

What changes were proposed in this pull request?

This PR aims to remove ignore.symbol.file Javac option.

Why are the changes needed?

Since Apache Spark 4.0.0, we are building with -release which means Javac always uses ct.sym, a stripped-down version of the standard library (like rt.jar in older JDKs) containing only the necessary class stubs and signature data for the documented APIs of a specific Java release. In other words, ignore.symbol.file option is ignored now and we can remove it safely.

Does this PR introduce any user-facing change?

No behavior change.

How was this patch tested?

Pass the CIs.

BEFORE

$ git grep ignore.symbol.file | wc -l
       4

AFTER

$ git grep ignore.symbol.file | wc -l
       0

Was this patch authored or co-authored using generative AI tooling?

No.

@dongjoon-hyun
Copy link
Member Author

Could you review this PR when you have some time, @LuciferYang ?

@dongjoon-hyun
Copy link
Member Author

Thank you, @HyukjinKwon !

@dongjoon-hyun
Copy link
Member Author

Merged to master.

@dongjoon-hyun dongjoon-hyun deleted the SPARK-54100 branch October 31, 2025 00:58
@LuciferYang
Copy link
Contributor

late LGTM

@dongjoon-hyun
Copy link
Member Author

Thank you, @LuciferYang .

huangxiaopingRD pushed a commit to huangxiaopingRD/spark that referenced this pull request Nov 25, 2025
### What changes were proposed in this pull request?

This PR aims to remove `ignore.symbol.file` Javac option.

### Why are the changes needed?

Since Apache Spark 4.0.0, we are building with `-release` which means `Javac` always uses `ct.sym`, a stripped-down version of the standard library (like rt.jar in older JDKs) containing only the necessary class stubs and signature data for the documented APIs of a specific Java release. In other words, `ignore.symbol.file` option is ignored now and we can remove it safely.
- apache#45716

### Does this PR introduce _any_ user-facing change?

No behavior change.

### How was this patch tested?

Pass the CIs.

**BEFORE**

```
$ git grep ignore.symbol.file | wc -l
       4
```

**AFTER**

```
$ git grep ignore.symbol.file | wc -l
       0
```

### Was this patch authored or co-authored using generative AI tooling?

No.

Closes apache#52802 from dongjoon-hyun/SPARK-54100.

Authored-by: Dongjoon Hyun <dongjoon@apache.org>
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants