Skip to content

colpali v1.3 by AndrewOgn#427

Merged
joein merged 26 commits into
mainfrom
colpali-multi
Feb 6, 2025
Merged

colpali v1.3 by AndrewOgn#427
joein merged 26 commits into
mainfrom
colpali-multi

Conversation

@joein

@joein joein commented Dec 18, 2024

Copy link
Copy Markdown
Member

it's a draft of second iteration of work on colpali #394

@joein joein changed the title wip: design draft wip: colpali design draft Dec 18, 2024
Comment thread fastembed/late_interaction_multimodal/colpali.py Outdated
Comment thread fastembed/late_interaction_multimodal/colpali.py Outdated
Comment thread fastembed/late_interaction_multimodal/onnx_multimodal_model.py Outdated
@I8dNLo

I8dNLo commented Dec 23, 2024

Copy link
Copy Markdown
Contributor

To check out values for tests I use code examples from here

@joein joein left a comment

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Comment thread fastembed/late_interaction_multimodal/__init__.py Outdated
Comment thread tests/test_late_interaction_multimodal.py Outdated
Comment thread tests/test_late_interaction_multimodal.py Outdated
Comment thread fastembed/late_interaction_multimodal/late_interaction_multimodal_embedding.py Outdated
Comment thread fastembed/late_interaction_multimodal/colpali.py Outdated
Comment thread fastembed/late_interaction_multimodal/colpali.py Outdated
Comment thread fastembed/late_interaction_multimodal/colpali.py
Comment thread fastembed/late_interaction_multimodal/colpali.py Outdated
@I8dNLo I8dNLo changed the title wip: colpali design draft colpali v1.3 by AndrewOgn Jan 13, 2025

@joein joein left a comment

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit comments + could you please upload canonical vectors / conversion code to the dedicated repo

Comment thread fastembed/late_interaction_multimodal/onnx_multimodal_model.py Outdated
Comment thread tests/test_late_interaction_multimodal.py Outdated
query += "\n"

texts_query.append(query)
encoded = self.tokenizer.encode_batch(texts_query, max_length=self.QUERY_MAX_LENGTH)

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I got an exception encode_batch does not have max_length parameter

@joein joein merged commit 2fe33c5 into main Feb 6, 2025
@joein joein deleted the colpali-multi branch February 6, 2025 15:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants