Describe the feature request

As global isolation is enabled for long, and now pushEds generates ClusterLoadAssignment from the cached IstioEndpoint directly, and can not use that in edsClusters anymore.

So we should cleanup it, and this will

1. save a lot of memory.
2. no need updating this cache anymore each time pushing eds, definitely saves cpu usage

Describe alternatives you've considered

Additional context