Yea, if you want a different default reply from the established Email Address Policy, then you need to leave that unchecked, otherwise the Email Address Policy will apply.
Alternatively, create a new Address Policy and apply to specific recipients who need that reply