Don't send IPs to connections without peer IDs. This is not because IPs need the peer ID for anything, but because we mustn't send anything encyrpted to PEERs that haven't yet completed their crypto startup. This is just a conveinent way to ensure that.