Skip to content

pip installs wrong binaries on macOS arm64 #454

Description

@clstaudt

The pip install output indicates that there is a package for the platform macosx_11_0_arm64:

╰─ pip install hnswlib                                                                                                                             (trIAge) 
Collecting hnswlib
  Using cached hnswlib-0.7.0-cp310-cp310-macosx_11_0_arm64.whl
Requirement already satisfied: numpy in /Users/cls/miniforge3/envs/trIAge/lib/python3.10/site-packages (from hnswlib) (1.23.5)
Installing collected packages: hnswlib
Successfully installed hnswlib-0.7.0

However, the installed binaries are apparently not of the correct architecture:

---------------------------------------------------------------------------
ImportError                               Traceback (most recent call last)
Cell In[27], line 5
      3 temporary_file.flush()
      4 loader = TextLoader(temporary_file.name)
----> 5 docsearch = index_creator.from_loaders([loader])

File [~/miniforge3/envs/trIAge/lib/python3.10/site-packages/langchain/indexes/vectorstore.py:71](https://file+.vscode-resource.vscode-cdn.net/Users/cls/Documents/Work/Projects/PrototypeFund/Dev/trIAge/notebooks/~/miniforge3/envs/trIAge/lib/python3.10/site-packages/langchain/indexes/vectorstore.py:71), in VectorstoreIndexCreator.from_loaders(self, loaders)
     69     docs.extend(loader.load())
     70 sub_docs = self.text_splitter.split_documents(docs)
---> 71 vectorstore = self.vectorstore_cls.from_documents(
     72     sub_docs, self.embedding, **self.vectorstore_kwargs
     73 )
     74 return VectorStoreIndexWrapper(vectorstore=vectorstore)

File [~/miniforge3/envs/trIAge/lib/python3.10/site-packages/langchain/vectorstores/chroma.py:336](https://file+.vscode-resource.vscode-cdn.net/Users/cls/Documents/Work/Projects/PrototypeFund/Dev/trIAge/notebooks/~/miniforge3/envs/trIAge/lib/python3.10/site-packages/langchain/vectorstores/chroma.py:336), in Chroma.from_documents(cls, documents, embedding, ids, collection_name, persist_directory, client_settings, **kwargs)
    334 texts = [doc.page_content for doc in documents]
    335 metadatas = [doc.metadata for doc in documents]
--> 336 return cls.from_texts(
    337     texts=texts,
    338     embedding=embedding,
    339     metadatas=metadatas,
    340     ids=ids,
    341     collection_name=collection_name,
    342     persist_directory=persist_directory,
...
----> 6 import hnswlib
      7 from chromadb.db.index import Index
      8 from chromadb.errors import NoIndexException, InvalidDimensionException, NotEnoughElementsException

ImportError: dlopen([/Users/cls/miniforge3/envs/trIAge/lib/python3.10/site-packages/hnswlib.cpython-310-darwin.so](https://file+.vscode-resource.vscode-cdn.net/Users/cls/miniforge3/envs/trIAge/lib/python3.10/site-packages/hnswlib.cpython-310-darwin.so), 0x0002): tried: '[/Users/cls/miniforge3/envs/trIAge/lib/python3.10/site-packages/hnswlib.cpython-310-darwin.so](https://file+.vscode-resource.vscode-cdn.net/Users/cls/miniforge3/envs/trIAge/lib/python3.10/site-packages/hnswlib.cpython-310-darwin.so)' (mach-o file, but is an incompatible architecture (have 'x86_64', need 'arm64')), '[/System/Volumes/Preboot/Cryptexes/OS/Users/cls/miniforge3/envs/trIAge/lib/python3.10/site-packages/hnswlib.cpython-310-darwin.so](https://file+.vscode-resource.vscode-cdn.net/System/Volumes/Preboot/Cryptexes/OS/Users/cls/miniforge3/envs/trIAge/lib/python3.10/site-packages/hnswlib.cpython-310-darwin.so)' (no such file), '[/Users/cls/miniforge3/envs/trIAge/lib/python3.10/site-packages/hnswlib.cpython-310-darwin.so](https://file+.vscode-resource.vscode-cdn.net/Users/cls/miniforge3/envs/trIAge/lib/python3.10/site-packages/hnswlib.cpython-310-darwin.so)' (mach-o file, but is an incompatible architecture (have 'x86_64', need 'arm64'))
``

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions