Move away from just "port" so that we can support TCP/UDS/UDP/etc. and also virtual listeners that get routed to dynamically (potentially via SO_ORIGINAL_DST).

cc @enricoschiattarella