Very similar issue to this one #1305

However as per your comment #1305 (comment):

This is unfortunately expected. At least, until you next run the whole my_drawer_test.dart file (or all test suites). Does it disappear when you do that?

Tests gets updated only if executing particular tests in file. However this doesn't work when running Dart: Run all tests

plugin version 3.1.0