While looking into #5734 I noticed that we only have a tracker on TestNode and not GroupNode. This means we're probably not tracking groups (eg. classes in test_reflective_loader) correctly.
When we add these, we need to ensure they are untracked during deletion (as was a bug with tests in that issue).