Why not always use the referrer? If a site includes user information in the URL sometimes they might not wish for that to go into their COOP logs and it seems there's no way to prevent that with the current setup.