It's annoying for downstream users when they don't use the exact same compiler as we do because any random new (or old) compiler warning breaks the build. Only set it in CI and developer builds. See #1333.