Linux conda build jobs are failing https://github.com/pytorch/vision/actions/runs/10161091148/job/28098866874?pr=7990

Traceback (most recent call last):
  File "/__w/_temp/conda_environment_10161091148/conda-bld/torchvision_1722337474925/work/setup.py", line 11, in <module>
    import torch
ModuleNotFoundError: No module named 'torch'

According to the HUD these jobs started failing from #8542, but the failures are still present even when reverting it (#8559), so #8542 is unlikely to be the cause.

This may have been caused by a recent change in test-infra?