Skip to content

BRIGHT #2811

Description

@amallia

Describe the bug

HTTP Error 429 thrown while requesting HEAD https://huggingface.co/datasets/xlangai/BRIGHT/resolve/a75a0eb/README.md
Retrying in 1s [Retry 1/5].
HTTP Error 429 thrown while requesting HEAD https://huggingface.co/datasets/xlangai/BRIGHT/resolve/a75a0eb/README.md
Retrying in 2s [Retry 2/5].
HTTP Error 429 thrown while requesting HEAD https://huggingface.co/datasets/xlangai/BRIGHT/resolve/a75a0eb/README.md
Retrying in 4s [Retry 3/5].
HTTP Error 429 thrown while requesting HEAD https://huggingface.co/datasets/xlangai/BRIGHT/resolve/a75a0eb/README.md
Retrying in 8s [Retry 4/5].
HTTP Error 429 thrown while requesting HEAD https://huggingface.co/datasets/xlangai/BRIGHT/resolve/a75a0eb/README.md
Retrying in 8s [Retry 5/5].
HTTP Error 429 thrown while requesting HEAD https://huggingface.co/datasets/xlangai/BRIGHT/resolve/a75a0eb/README.md
HTTP Error 429 thrown while requesting HEAD https://huggingface.co/datasets/xlangai/BRIGHT/resolve/a75a0eb483f6a5233a6efc2d63d71540a4443dfb/BRIGHT.py
Retrying in 1s [Retry 1/5].
HTTP Error 429 thrown while requesting HEAD https://huggingface.co/datasets/xlangai/BRIGHT/resolve/a75a0eb483f6a5233a6efc2d63d71540a4443dfb/BRIGHT.py
Retrying in 2s [Retry 2/5].

It seems that BRIGHT has a new revision.

Currently is set to a75a0eb in MTEB, while the upstream one is 3066d29c9651a576c8aba4832d249807b181ecae

To reproduce

tasks = mteb.get_tasks(tasks=["BrightRetrieval"])
tasks[0].load_data()

Additional information

No response

Are you interested to contribute a fix for this bug?

Yes

Metadata

Metadata

Labels

No labels
No labels

Type

No fields configured for Bug.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions