Something that laszio (@ting-yuan) mentioned, this issue can have a negative impact on Windows users due to this:

Closing a URLClassLoader

However, since it can't be predicted exactly when finalization and garbage collection will occur, problems are caused for applications which need to be able to do this in a predictable and timely fashion. It is a problem on Windows, because open files cannot be deleted or replaced.

Unfortunately, as it currently exists, this PR is a little incomplete. There are a couple of compiler errors due to the signature change in PluginCliParser. But this is a problem we have also been wanting to fix. So I'm going to retarget your code to a branch of my own and build on your solution to finish it out. Thank you for kick-starting this work!