Skip to content

wip: start reviewing#420

Merged
I8dNLo merged 2 commits into
cross_encoders_parallelismfrom
review-cross-encoder-pairs
Dec 11, 2024
Merged

wip: start reviewing#420
I8dNLo merged 2 commits into
cross_encoders_parallelismfrom
review-cross-encoder-pairs

Conversation

@joein

@joein joein commented Dec 11, 2024

Copy link
Copy Markdown
Member

No description provided.

@I8dNLo I8dNLo merged commit 42b8f4e into cross_encoders_parallelism Dec 11, 2024
@I8dNLo I8dNLo deleted the review-cross-encoder-pairs branch December 11, 2024 20:01
I8dNLo added a commit that referenced this pull request Dec 16, 2024
* Merge master

* rerank_pairs interface + parallelism support

* remove test notebook

* Removed unused code

* New tests for cross encoders and new interface

* Importing Self fix. We will need it for mypy support in newer versions

* Removed Self typing

* Removed non-needed changes from text

* Isort + black

* wip: start reviewing (#420)

Co-authored-by: Dmitrii Ogn <dimitriy_rudenko@mail.ru>

* Test fix

* Update fastembed/rerank/cross_encoder/text_cross_encoder.py

Co-authored-by: George <george.panchuk@qdrant.tech>

* Update fastembed/rerank/cross_encoder/text_cross_encoder.py

Co-authored-by: George <george.panchuk@qdrant.tech>

* Update fastembed/rerank/cross_encoder/text_cross_encoder.py

Co-authored-by: George <george.panchuk@qdrant.tech>

* Update fastembed/rerank/cross_encoder/text_cross_encoder_base.py

Co-authored-by: George <george.panchuk@qdrant.tech>

* Test for parallel processing + bugfix of PosixPath passing

* Removed non-needed import and added docstring

* Typing fix + argument passing

* Test parametrization
Moved to selected models set to test

* Run base test on all models

* Typing fix + improvement of input_names check

* nit: fix post process, update docstring, update tokenize, remove redundant imports

---------

Co-authored-by: George <george.panchuk@qdrant.tech>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants