Skip to content

fix: datasets loading#3421

Merged
Samoed merged 11 commits into
v2.0.0from
fix_statistics
Oct 18, 2025
Merged

fix: datasets loading#3421
Samoed merged 11 commits into
v2.0.0from
fix_statistics

Conversation

@Samoed

@Samoed Samoed commented Oct 18, 2025

Copy link
Copy Markdown
Member

@fzoll I found source of 'Dataset' object has no attribute 'items' problem, but when I try to run Vidore2BioMedicalLecturesRetrieval I got OOM (10+ gb) quickly even dataset weights only 100mb ref #3279 (comment)

@fzoll

fzoll commented Oct 18, 2025

Copy link
Copy Markdown
Contributor

@Samoed I can try your fix

@Samoed

Samoed commented Oct 18, 2025

Copy link
Copy Markdown
Member Author

Fixed _convert_to_fast and AlloprofRetrieval

@Samoed Samoed changed the title fix: 'Dataset' object has no attribute 'items' fix: datasets loading Oct 18, 2025
@Samoed

Samoed commented Oct 18, 2025

Copy link
Copy Markdown
Member Author

@fzoll I fixed more datasets. And found that these datasets can't be downloaded #3279 (comment) for now. I will fix them later

Comment thread mteb/abstasks/text/pair_classification.py Outdated
@Samoed Samoed enabled auto-merge (squash) October 18, 2025 14:04
@Samoed Samoed disabled auto-merge October 18, 2025 14:05
@Samoed Samoed enabled auto-merge (squash) October 18, 2025 14:12
@Samoed Samoed merged commit 60ecbf1 into v2.0.0 Oct 18, 2025
11 checks passed
@Samoed Samoed deleted the fix_statistics branch October 18, 2025 14:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants