Consider the cilium datapath config when deciding which IPs need to be tracked as allowedIPs:

• for overlay routing, we expect that all pod traffic is encapsulated in VXLAN / GENEVE. Hence we shouldn't need to track pod IPs.
• for native routing, we should be able to register PodCIDRs (instead of individual pod IPs).
• for native routing without per-node PodCIDRs, @marseel suggested looking into prefix delegation.