I just ran the windows installer and it had the Desktop as the default path for the installation (which isn't really the best place to put executables, tbh).
I changed the path, and it extracted the uninstaller to the custom path I gave it, but the git-lfs.exe executable went to the Destkop anyway and not the custom path.