It is a good security measure.
Even if somebody spoofs your IP address to try and authenticate, they would not receive the packets back as they would route through the internet to the correct address and then most likely get dropped by your device / network.
Hope that helps.
Kind regards,
Jamie Sabbatella