Looks like the activate() method below is always associated with the language server, and is not called if there is no language server being used

(The language server provides the symbol provider which is used to get codelenses. But having codelenses isn't necessary for testing frameworks to work.)

This means that none of the commands related to testing (python.discoverTests etc.) are registered and testing doesn't work.