Currently, the test suite sometimes fails due to an error outside the scope of mteb (e.g. on HF). This makes it hard to trust when the test fails. A solution to this would be to simply factor out those tests in a separate CI (such that if the main tests fail it is clear easy to trust the error)

@Samoed and @isaac-chung WDYT about this?

thread on how to do this in pytest for reference