Skip to content

python@3.11.4 on Cray is non-functional: Could not find platform dependent libraries <exec_prefix> #40110

@eugeneswalker

Description

@eugeneswalker

Steps to reproduce the issue

Building python@3.11.4 on our Cray system results in a non-functional install using

  • spack@develop (31fe78e from Wed Sep 20 11:28:52 2023 -0600)
  • GCC 10.3.0
  • Cray SLES 15, x86_64
Spack environment
spack:
  view: false

  compilers:
  - compiler:
      spec: gcc@=10.3.0
      paths:
        cc: /opt/cray/pe/gcc/10.3.0/bin/gcc
        cxx: /opt/cray/pe/gcc/10.3.0/bin/g++
        f77: /opt/cray/pe/gcc/10.3.0/bin/gfortran
        fc: /opt/cray/pe/gcc/10.3.0/bin/gfortran
      flags: {}
      operating_system: sle_hpc15
      target: x86_64
      modules: [PrgEnv-gnu-amd]
      environment: {}
      extra_rpaths: []

  concretizer:
    reuse: false
    unify: false

  packages:
    all:
      require: '%gcc'
      target: [zen4]

    ncurses:
      require: '@6.3 +termlib'
    xz:
      variants: +pic

  specs:
  - python

Concretization:

[+]  4teyakj  python@3.11.4%gcc@10.3.0+bz2+crypt+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tkinter+uuid+zlib build_system=generic patches=13fa8bf,b0615b2,f2fd060 arch=linux-sle_hpc15-x86_64_v4
[+]  zlbxmv3      ^bzip2@1.0.8%gcc@10.3.0~debug~pic+shared build_system=generic arch=linux-sle_hpc15-x86_64_v4
[+]  ja6nemy          ^diffutils@3.9%gcc@10.3.0 build_system=autotools arch=linux-sle_hpc15-x86_64_v4
[+]  ro4fiho      ^expat@2.5.0%gcc@10.3.0+libbsd build_system=autotools arch=linux-sle_hpc15-x86_64_v4
[+]  7sf6yks          ^libbsd@0.11.7%gcc@10.3.0 build_system=autotools arch=linux-sle_hpc15-x86_64_v4
[+]  q27nr33              ^libmd@1.0.4%gcc@10.3.0 build_system=autotools arch=linux-sle_hpc15-x86_64_v4
[+]  xxrw2cv      ^gdbm@1.23%gcc@10.3.0 build_system=autotools arch=linux-sle_hpc15-x86_64_v4
[+]  5d5ahmk      ^gettext@0.21.1%gcc@10.3.0+bzip2+curses+git~libunistring+libxml2+tar+xz build_system=autotools arch=linux-sle_hpc15-x86_64_v4
[+]  wx3p4zt          ^libiconv@1.17%gcc@10.3.0 build_system=autotools libs=shared,static arch=linux-sle_hpc15-x86_64_v4
[+]  vzl2vyq          ^libxml2@2.10.3%gcc@10.3.0+pic~python+shared build_system=autotools arch=linux-sle_hpc15-x86_64_v4
[+]  ei2dro4          ^tar@1.34%gcc@10.3.0 build_system=autotools zip=pigz arch=linux-sle_hpc15-x86_64_v4
[+]  ka3c2gf              ^pigz@2.7%gcc@10.3.0 build_system=makefile arch=linux-sle_hpc15-x86_64_v4
[+]  hcp3mzb              ^zstd@1.5.5%gcc@10.3.0+programs build_system=makefile compression=none libs=shared,static arch=linux-sle_hpc15-x86_64_v4
[+]  ogojdtg      ^libffi@3.4.4%gcc@10.3.0 build_system=autotools arch=linux-sle_hpc15-x86_64_v4
[+]  2to2w5m      ^libxcrypt@4.4.35%gcc@10.3.0~obsolete_api build_system=autotools patches=4885da3 arch=linux-sle_hpc15-x86_64_v4
[+]  f364rso          ^perl@5.38.0%gcc@10.3.0+cpanm+opcode+open+shared+threads build_system=generic patches=714e4d1 arch=linux-sle_hpc15-x86_64_v4
[+]  hw3mprt              ^berkeley-db@18.1.40%gcc@10.3.0+cxx~docs+stl build_system=autotools patches=26090f4,b231fcc arch=linux-sle_hpc15-x86_64_v4
[+]  vs5qwkm      ^ncurses@6.3%gcc@10.3.0~symlinks+termlib abi=none build_system=autotools arch=linux-sle_hpc15-x86_64_v4
[+]  2cltnkk      ^openssl@3.1.2%gcc@10.3.0~docs+shared build_system=generic certs=mozilla arch=linux-sle_hpc15-x86_64_v4
[+]  avmlirn          ^ca-certificates-mozilla@2023-05-30%gcc@10.3.0 build_system=generic arch=linux-sle_hpc15-x86_64_v4
[+]  jskx7el      ^pkgconf@1.9.5%gcc@10.3.0 build_system=autotools arch=linux-sle_hpc15-x86_64_v4
[+]  2pm6liu      ^readline@8.2%gcc@10.3.0 build_system=autotools patches=bbf97f1 arch=linux-sle_hpc15-x86_64_v4
[+]  qrrvjcl      ^sqlite@3.42.0%gcc@10.3.0+column_metadata+dynamic_extensions+fts~functions+rtree build_system=autotools arch=linux-sle_hpc15-x86_64_v4
[+]  duzd3zl      ^util-linux-uuid@2.38.1%gcc@10.3.0 build_system=autotools arch=linux-sle_hpc15-x86_64_v4
[+]  gpdp3ie      ^xz@5.4.1%gcc@10.3.0+pic build_system=autotools libs=shared,static arch=linux-sle_hpc15-x86_64_v4
[+]  fp2jn4r      ^zlib-ng@2.1.3%gcc@10.3.0+compat+opt build_system=autotools patches=299b958,ae9077a,b692621 arch=linux-sle_hpc15-x86_64_v4
$> spack env activate
$> spack install 
... OK

$> spack load python
$> which python
/tmp/gnu-debug/spack/opt/spack/linux-sle_hpc15-x86_64_v4/gcc-10.3.0/python-3.11.4-4teyakjavmjou3xbglxeizjivo5z64q3/bin/python

$> python
Could not find platform dependent libraries <exec_prefix>
Python 3.11.4 (main, Sep 20 2023, 11:02:41) [GCC 10.3.0 20210408 (Cray Inc.)] on linux
Type "help", "copyright", "credits" or "license" for more information.
Traceback (most recent call last):
  File "/etc/pythonstart", line 7, in <module>
    import readline
ModuleNotFoundError: No module named 'readline'
>>>

If I manually set PYTHONPATH I can get rid of the No module named 'readline' error:

$> export PYTHONPATH=$(spack location -i python)/lib64/python3.11/lib-dynload:$PYTHONPATH
$> python
Could not find platform dependent libraries <exec_prefix>
Python 3.11.4 (main, Sep 20 2023, 11:02:41) [GCC 10.3.0 20210408 (Cray Inc.)] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>>

Error message

Error message
... see above

Information on your system

  • Spack: 0.21.0.dev0 (31fe78e)
  • Python: 3.6.15
  • Platform: linux-sle_hpc15-x86_64_v4
  • Concretizer: clingo

Additional information

spack-build-env.txt
spack-build-out.txt

General information

  • I have run spack debug report and reported the version of Spack/Python/Platform
  • I have run spack maintainers <name-of-the-package> and @mentioned any maintainers
  • I have uploaded the build log and environment files
  • I have searched the issues of this repo and believe this is not a duplicate

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions