Ensure watchers are cleaned up when directories or files are removed #268
Description
Some operating systems may clean up for us, others may not.
Removing the watch explicitly could return an error.
IMO, the behaviour we want is to clean up in the library if the OS doesn't, so that the caller doesn't need to worry about cleaning up watchers for removed folders or files.