Skip to content

GH-33800: [Packaging] Drop support for Ubuntu 18.04#34020

Merged
kou merged 1 commit intoapache:mainfrom
kou:drop-ubuntu-18.04
Mar 27, 2023
Merged

GH-33800: [Packaging] Drop support for Ubuntu 18.04#34020
kou merged 1 commit intoapache:mainfrom
kou:drop-ubuntu-18.04

Conversation

@kou
Copy link
Copy Markdown
Member

@kou kou commented Feb 3, 2023

Rationale for this change

Ubuntu 18.04 will reach End of Standard Support on 2023-04: https://wiki.ubuntu.com/Releases

Version Code name Docs Release End of Standard Support End of Life
Ubuntu 18.04.6 LTS Bionic Beaver Changes September 17.2021 April 2023 April 2028

What changes are included in this PR?

Remove Ubuntu 18.04 related things.

Are these changes tested?

Yes.

Are there any user-facing changes?

Yes.

@kou kou requested review from assignUser and raulcd as code owners February 3, 2023 08:11
@github-actions
Copy link
Copy Markdown

github-actions bot commented Feb 3, 2023

@github-actions
Copy link
Copy Markdown

github-actions bot commented Feb 3, 2023

⚠️ GitHub issue #33800 has been automatically assigned in GitHub to PR creator.

@kou
Copy link
Copy Markdown
Member Author

kou commented Feb 3, 2023

@github-actions crossbow submit -g nightly-tests -g nightly-packaging -g nightly-release

@github-actions

This comment was marked as outdated.

@kou
Copy link
Copy Markdown
Member Author

kou commented Feb 4, 2023

@github-actions crossbow submit r-binary-packages

@github-actions

This comment was marked as outdated.

@kou
Copy link
Copy Markdown
Member Author

kou commented Feb 4, 2023

@github-actions crossbow submit r-binary-packages

@github-actions

This comment was marked as outdated.

@kou
Copy link
Copy Markdown
Member Author

kou commented Feb 4, 2023

@github-actions crossbow submit r-binary-packages

@github-actions

This comment was marked as outdated.

@assignUser
Copy link
Copy Markdown
Member

Please don't merge the changes to r-binary-packages yet as I am fairly sure we need that version due to compiler versions etc. and can't replace it with 20.04. But can't check nixlibs.R right now. Right @nealrichardson ?

@kou
Copy link
Copy Markdown
Member Author

kou commented Feb 5, 2023

Do we need to support R 3.6?
Do we need to support Debian buster?

If we can drop support for them, we can replace ubuntu-18.04 binaries with binaries built on Ubuntu 20.04.

@nealrichardson
Copy link
Copy Markdown
Member

Do we need to support R 3.6?

Yes, but that shouldn't matter for the libarrow binaries we build.

Do we need to support Debian buster?

The libarrow binaries we build are optional. As long as arrow compiles everywhere it should, it's ok if we don't provide binaries that work there, they're just an installation speedup.

If we can drop support for them, we can replace ubuntu-18.04 binaries with binaries built on Ubuntu 20.04.

#32292 and #33091 should let us switch to using binaries built on CentOS 7, IIUC, so this would be moot. We'll basically have two versions of libarrow binaries: one built against openssl 1 and the other against openssl 3.

I would prefer to leave the r-binary-packages jobs unmodified here and remove the ubuntu-18.04 from it by addressing those other issues.

@kou
Copy link
Copy Markdown
Member Author

kou commented Feb 6, 2023

OK. Then I work on #32292 and #33091 before this.

@kou
Copy link
Copy Markdown
Member Author

kou commented Feb 6, 2023

#34048 is for #32292 and #33091.

@kou kou force-pushed the drop-ubuntu-18.04 branch from c04d073 to 1a36245 Compare March 22, 2023 07:18
@github-actions github-actions bot added awaiting review Awaiting review and removed Component: R labels Mar 22, 2023
@kou
Copy link
Copy Markdown
Member Author

kou commented Mar 22, 2023

@github-actions crossbow submit -g nightly-release -g nightly-tests -g nightly-packaging

@github-actions
Copy link
Copy Markdown

Revision: 1a36245

Submitted crossbow builds: ursacomputing/crossbow @ actions-e1300a7316

Task Status
almalinux-8-amd64 Github Actions
almalinux-8-arm64 Travis CI
almalinux-9-amd64 Github Actions
almalinux-9-arm64 Travis CI
amazon-linux-2-amd64 Github Actions
amazon-linux-2-arm64 Travis CI
centos-7-amd64 Github Actions
centos-8-stream-amd64 Github Actions
centos-8-stream-arm64 Travis CI
centos-9-stream-amd64 Github Actions
centos-9-stream-arm64 Travis CI
conan-maximum Github Actions
conan-minimum Github Actions
conda-clean Azure
conda-linux-aarch64-cpu-py3 Azure
conda-linux-aarch64-cpu-r41 Azure
conda-linux-aarch64-cpu-r42 Azure
conda-linux-ppc64le-cpu-py3 Azure
conda-linux-x64-cpu-py3 Azure
conda-linux-x64-cpu-r41 Azure
conda-linux-x64-cpu-r42 Azure
conda-linux-x64-cuda-py3 Azure
conda-osx-arm64-cpu-py3 Azure
conda-osx-arm64-cpu-r41 Azure
conda-osx-arm64-cpu-r42 Azure
conda-osx-x64-cpu-py3 Azure
conda-osx-x64-cpu-r41 Azure
conda-osx-x64-cpu-r42 Azure
conda-win-x64-cpu-py3 Azure
conda-win-x64-cpu-r41 Azure
conda-win-x64-cuda-py3 Azure
debian-bookworm-amd64 Github Actions
debian-bookworm-arm64 Travis CI
debian-bullseye-amd64 Github Actions
debian-bullseye-arm64 Travis CI
example-cpp-minimal-build-static Github Actions
example-cpp-minimal-build-static-system-dependency Github Actions
example-python-minimal-build-fedora-conda Github Actions
example-python-minimal-build-ubuntu-venv Github Actions
homebrew-cpp Github Actions
homebrew-r-autobrew Github Actions
homebrew-r-brew Github Actions
java-jars Github Actions
nuget Github Actions
python-sdist Github Actions
r-binary-packages Github Actions
test-alpine-linux-cpp Github Actions
test-build-cpp-fuzz Github Actions
test-build-vcpkg-win Github Actions
test-conda-cpp Github Actions
test-conda-cpp-valgrind Azure
test-conda-python-3.10 Github Actions
test-conda-python-3.11 Github Actions
test-conda-python-3.7 Github Actions
test-conda-python-3.7-hdfs-2.9.2 Github Actions
test-conda-python-3.7-hdfs-3.2.1 Github Actions
test-conda-python-3.7-pandas-1.0 Github Actions
test-conda-python-3.7-pandas-latest Github Actions
test-conda-python-3.7-spark-v3.1.2 Github Actions
test-conda-python-3.8 Github Actions
test-conda-python-3.8-hypothesis Github Actions
test-conda-python-3.8-pandas-latest Github Actions
test-conda-python-3.8-pandas-nightly Github Actions
test-conda-python-3.8-spark-v3.2.0 Github Actions
test-conda-python-3.9 Github Actions
test-conda-python-3.9-dask-latest Github Actions
test-conda-python-3.9-dask-upstream_devel Github Actions
test-conda-python-3.9-pandas-upstream_devel Github Actions
test-conda-python-3.9-spark-master Github Actions
test-conda-python-3.9-substrait Github Actions
test-cuda-cpp Github Actions
test-cuda-python Github Actions
test-debian-10-cpp-amd64 Github Actions
test-debian-10-cpp-i386 Github Actions
test-debian-11-cpp-amd64 Github Actions
test-debian-11-cpp-i386 Github Actions
test-debian-11-go-1.17 Azure
test-debian-11-python-3 Azure
test-debian-c-glib Github Actions
test-debian-ruby Github Actions
test-fedora-35-cpp Github Actions
test-fedora-35-python-3 Azure
test-fedora-r-clang-sanitizer Azure
test-r-arrow-backwards-compatibility Github Actions
test-r-depsource-bundled Azure
test-r-depsource-system Github Actions
test-r-dev-duckdb Github Actions
test-r-devdocs Github Actions
test-r-gcc-11 Github Actions
test-r-gcc-12 Github Actions
test-r-install-local Github Actions
test-r-install-local-minsizerel Github Actions
test-r-library-r-base-latest Azure
test-r-linux-as-cran Github Actions
test-r-linux-rchk Github Actions
test-r-linux-valgrind Azure
test-r-minimal-build Azure
test-r-offline-maximal Github Actions
test-r-offline-minimal Azure
test-r-rhub-debian-gcc-devel-lto-latest Azure
test-r-rhub-debian-gcc-release-custom-ccache Azure
test-r-rhub-ubuntu-gcc-release-latest Azure
test-r-rstudio-r-base-4.1-opensuse153 Azure
test-r-rstudio-r-base-4.2-centos7-devtoolset-8 Azure
test-r-rstudio-r-base-4.2-focal Azure
test-r-ubuntu-22.04 Github Actions
test-r-versions Github Actions
test-skyhook-integration Github Actions
test-ubuntu-20.04-cpp Github Actions
test-ubuntu-20.04-cpp-20 Github Actions
test-ubuntu-20.04-cpp-bundled Github Actions
test-ubuntu-20.04-cpp-thread-sanitizer Github Actions
test-ubuntu-20.04-python-3 Azure
test-ubuntu-22.04-cpp Github Actions
test-ubuntu-c-glib Github Actions
test-ubuntu-default-docs Azure
test-ubuntu-r-sanitizer Azure
test-ubuntu-ruby Github Actions
ubuntu-focal-amd64 Github Actions
ubuntu-focal-arm64 Travis CI
ubuntu-jammy-amd64 Github Actions
ubuntu-jammy-arm64 Travis CI
ubuntu-kinetic-amd64 Github Actions
ubuntu-kinetic-arm64 Travis CI
verify-rc-source-cpp-linux-almalinux-8-amd64 Github Actions
verify-rc-source-cpp-linux-conda-latest-amd64 Github Actions
verify-rc-source-cpp-linux-ubuntu-20.04-amd64 Github Actions
verify-rc-source-cpp-linux-ubuntu-22.04-amd64 Github Actions
verify-rc-source-cpp-macos-amd64 Github Actions
verify-rc-source-cpp-macos-arm64 Github Actions
verify-rc-source-cpp-macos-conda-amd64 Github Actions
verify-rc-source-csharp-linux-almalinux-8-amd64 Github Actions
verify-rc-source-csharp-linux-conda-latest-amd64 Github Actions
verify-rc-source-csharp-linux-ubuntu-20.04-amd64 Github Actions
verify-rc-source-csharp-linux-ubuntu-22.04-amd64 Github Actions
verify-rc-source-csharp-macos-amd64 Github Actions
verify-rc-source-csharp-macos-arm64 Github Actions
verify-rc-source-go-linux-almalinux-8-amd64 Github Actions
verify-rc-source-go-linux-conda-latest-amd64 Github Actions
verify-rc-source-go-linux-ubuntu-20.04-amd64 Github Actions
verify-rc-source-go-linux-ubuntu-22.04-amd64 Github Actions
verify-rc-source-go-macos-amd64 Github Actions
verify-rc-source-go-macos-arm64 Github Actions
verify-rc-source-integration-linux-almalinux-8-amd64 Github Actions
verify-rc-source-integration-linux-conda-latest-amd64 Github Actions
verify-rc-source-integration-linux-ubuntu-20.04-amd64 Github Actions
verify-rc-source-integration-linux-ubuntu-22.04-amd64 Github Actions
verify-rc-source-integration-macos-amd64 Github Actions
verify-rc-source-integration-macos-arm64 Github Actions
verify-rc-source-integration-macos-conda-amd64 Github Actions
verify-rc-source-java-linux-almalinux-8-amd64 Github Actions
verify-rc-source-java-linux-conda-latest-amd64 Github Actions
verify-rc-source-java-linux-ubuntu-20.04-amd64 Github Actions
verify-rc-source-java-linux-ubuntu-22.04-amd64 Github Actions
verify-rc-source-java-macos-amd64 Github Actions
verify-rc-source-js-linux-almalinux-8-amd64 Github Actions
verify-rc-source-js-linux-conda-latest-amd64 Github Actions
verify-rc-source-js-linux-ubuntu-20.04-amd64 Github Actions
verify-rc-source-js-linux-ubuntu-22.04-amd64 Github Actions
verify-rc-source-js-macos-amd64 Github Actions
verify-rc-source-js-macos-arm64 Github Actions
verify-rc-source-python-linux-almalinux-8-amd64 Github Actions
verify-rc-source-python-linux-conda-latest-amd64 Github Actions
verify-rc-source-python-linux-ubuntu-20.04-amd64 Github Actions
verify-rc-source-python-linux-ubuntu-22.04-amd64 Github Actions
verify-rc-source-python-macos-amd64 Github Actions
verify-rc-source-python-macos-arm64 Github Actions
verify-rc-source-python-macos-conda-amd64 Github Actions
verify-rc-source-ruby-linux-almalinux-8-amd64 Github Actions
verify-rc-source-ruby-linux-conda-latest-amd64 Github Actions
verify-rc-source-ruby-linux-ubuntu-20.04-amd64 Github Actions
verify-rc-source-ruby-linux-ubuntu-22.04-amd64 Github Actions
verify-rc-source-ruby-macos-amd64 Github Actions
verify-rc-source-ruby-macos-arm64 Github Actions
verify-rc-source-windows Github Actions
wheel-macos-big-sur-cp310-arm64 Github Actions
wheel-macos-big-sur-cp311-arm64 Github Actions
wheel-macos-big-sur-cp38-arm64 Github Actions
wheel-macos-big-sur-cp39-arm64 Github Actions
wheel-macos-mojave-cp310-amd64 Github Actions
wheel-macos-mojave-cp311-amd64 Github Actions
wheel-macos-mojave-cp37-amd64 Github Actions
wheel-macos-mojave-cp38-amd64 Github Actions
wheel-macos-mojave-cp39-amd64 Github Actions
wheel-manylinux2014-cp310-amd64 Github Actions
wheel-manylinux2014-cp310-arm64 Travis CI
wheel-manylinux2014-cp311-amd64 Github Actions
wheel-manylinux2014-cp311-arm64 Travis CI
wheel-manylinux2014-cp37-amd64 Github Actions
wheel-manylinux2014-cp37-arm64 Travis CI
wheel-manylinux2014-cp38-amd64 Github Actions
wheel-manylinux2014-cp38-arm64 Travis CI
wheel-manylinux2014-cp39-amd64 Github Actions
wheel-manylinux2014-cp39-arm64 Travis CI
wheel-windows-cp310-amd64 Github Actions
wheel-windows-cp311-amd64 Github Actions
wheel-windows-cp37-amd64 Github Actions
wheel-windows-cp38-amd64 Github Actions
wheel-windows-cp39-amd64 Github Actions

@kou
Copy link
Copy Markdown
Member Author

kou commented Mar 24, 2023

+1

I'll merge this next week if nobody objects it.

Copy link
Copy Markdown
Member

@assignUser assignUser left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM 👍

@github-actions github-actions bot added awaiting committer review Awaiting committer review awaiting changes Awaiting changes and removed awaiting review Awaiting review awaiting committer review Awaiting committer review labels Mar 24, 2023
@kou kou merged commit c9a09b0 into apache:main Mar 27, 2023
@kou kou deleted the drop-ubuntu-18.04 branch March 27, 2023 01:07
@ursabot
Copy link
Copy Markdown

ursabot commented Mar 27, 2023

Benchmark runs are scheduled for baseline = 9d0bce6 and contender = c9a09b0. c9a09b0 is a master commit associated with this PR. Results will be available as each benchmark for each run completes.
Conbench compare runs links:
[Finished ⬇️0.0% ⬆️0.0%] ec2-t3-xlarge-us-east-2
[Failed ⬇️0.27% ⬆️0.0%] test-mac-arm
[Finished ⬇️0.51% ⬆️0.0%] ursa-i9-9960x
[Failed ⬇️0.0% ⬆️0.0%] ursa-thinkcentre-m75q
Buildkite builds:
[Finished] c9a09b05 ec2-t3-xlarge-us-east-2
[Failed] c9a09b05 test-mac-arm
[Finished] c9a09b05 ursa-i9-9960x
[Failed] c9a09b05 ursa-thinkcentre-m75q
[Finished] 9d0bce65 ec2-t3-xlarge-us-east-2
[Failed] 9d0bce65 test-mac-arm
[Finished] 9d0bce65 ursa-i9-9960x
[Finished] 9d0bce65 ursa-thinkcentre-m75q
Supported benchmarks:
ec2-t3-xlarge-us-east-2: Supported benchmark langs: Python, R. Runs only benchmarks with cloud = True
test-mac-arm: Supported benchmark langs: C++, Python, R
ursa-i9-9960x: Supported benchmark langs: Python, R, JavaScript
ursa-thinkcentre-m75q: Supported benchmark langs: C++, Java

@kou
Copy link
Copy Markdown
Member Author

kou commented Apr 11, 2023

@github-actions crossbow submit test-conda-python-3.10

@github-actions
Copy link
Copy Markdown

Revision: 1a36245

Submitted crossbow builds: ursacomputing/crossbow @ actions-fc32d0b2dd

Task Status
test-conda-python-3.10 Github Actions

ArgusLi pushed a commit to Bit-Quill/arrow that referenced this pull request May 15, 2023
### Rationale for this change

Ubuntu 18.04 will reach End of Standard Support on 2023-04: https://wiki.ubuntu.com/Releases

> Version | Code name | Docs | Release | End of Standard Support | End of Life
> -- | -- | -- | -- | -- | --
> Ubuntu 18.04.6 LTS | Bionic Beaver | Changes | September 17.2021 | April 2023 | April 2028

### What changes are included in this PR?

Remove Ubuntu 18.04 related things.

### Are these changes tested?

Yes.

### Are there any user-facing changes?

Yes.

* Closes: apache#33800

Authored-by: Sutou Kouhei <kou@clear-code.com>
Signed-off-by: Sutou Kouhei <kou@clear-code.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Packaging] Drop support for Ubuntu 18.04

4 participants