Build failures when building Apache Gluten with Velox on Azure Arm64 (Ubuntu 24.04) #11633
Description
Problem description
@acvictor I am trying to build Apache Gluten with Velox backend on Arm64 (aarch64) using an Azure Arm-based VM. During the build process, I consistently encounter two failures:
- Velox compilation fails with
cc1plusbeing killed while compilingMaxByAggregate.cpp - fbthrift installation fails because
libthriftcpp2.ais not generated/found
Both issues occur while building Gluten + Velox on Arm64 and block the build completely.
System information
Cloud provider: Microsoft Azure
Region: Central India
Virtual Machine
VM Size: Standard D4ps v6
vCPUs / Memory: 4 vCPUs, 16 GiB RAM
Architecture: Arm64 (aarch64)
CPU: ARM Neoverse (Azure Arm-based processor)
Operating System
OS: Ubuntu 24.04 LTS
Kernel: Linux 5.15.x
Toolchain
CMake: 3.28.x
C/C++ Compiler: GCC 9.4.0
Build system: Ninja
ccache: Enabled
CMake log
Error 1: Velox build fails (cc1plus killed)
This is the first failure observed during the Velox build.
[1402/2758] Building CXX object velox/buffer/CMakeFiles/velox.dir/__/functions/prestosql/aggregates/MaxByAggregate.cpp.o
FAILED: velox/buffer/CMakeFiles/velox.dir/__/functions/prestosql/aggregates/MaxByAggregate.cpp.o
/usr/bin/ccache /usr/bin/c++ ... -mcpu=neoverse-n2 -O3 -std=gnu++20 ...
-c /home/azureuser/velox/velox/functions/prestosql/aggregates/MaxByAggregate.cpp
c++: fatal error: Killed signal terminated program cc1plus
compilation terminated.
ninja: build stopped: subcommand failed.
Error 2: fbthrift install fails (libthriftcpp2.a missing)
After partial progress, the build fails again during fbthrift installation.
-- Installing: /usr/local/lib/libthriftanyrep.a
-- Installing: /usr/local/lib/libthriftprotocol.a
CMake Error at _build/thrift/lib/cpp2/cmake_install.cmake:113 (file):
file INSTALL cannot find
"/home/azureuser/incubator-gluten/ep/build-velox/build/velox_ep/fbthrift/_build/lib/libthriftcpp2.a":
No such file or directory.
Call Stack (most recent call first):
_build/thrift/lib/cmake_install.cmake:77 (include)
_build/thrift/cmake_install.cmake:90 (include)
_build/cmake_install.cmake:51 (include)
Failed to run install_fbthrift.