Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 86.07%. Comparing base (9563a51) to head (6115b7b).
⚠️ Report is 37 commits behind head on forks/osaka.

@@             Coverage Diff              @@
##           forks/osaka    #1730   +/-   ##
============================================
  Coverage        86.07%   86.07%           
============================================
  Files              743      743           
  Lines            44078    44078           
  Branches          3894     3894           
============================================
  Hits             37938    37938           
  Misses            5659     5659           
  Partials           481      481           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@marioevz used --dist=loadfile in #1666, would that make sense here?

I have implemented --dist=loadgroup by defining all the tests in a particular json fixture file as part of the same xdist group. That allows each file to be read exactly once and makes the LRU caching technique maximally useful. Just waiting to see what the CI runtime from this is

@marioevz used --dist=loadfile in #1666, would that make sense here?

Next, I will try out some of the ideas from that PR and see what works best

I have implemented --dist=loadgroup by defining all the tests in a particular json fixture file as part of the same xdist group.

I saw! Was wondering if loadfile would save you having to manually create those groups.

I saw! Was wondering if loadfile would save you having to manually create those groups.

Ah. I see. From what I understand --dist=loadfile groups the tests by the python test file (.py file) and has no way of distinguishing the different json fixtures (unless we explicitly tell it). This is why I decided to explicitly define the groups and run the --dist=loadgroup which should achieve the intended effect.

Closing this in favor of #1666