udp: avoid listener cleanups with active opens