If we detect an old version of the cache directory, we should remove it and start fresh.