Thank you for posting query in Microsoft Q&A Platform.
If your SQL server information is different for different environments then yes you should consider overriding it. During deployment you may see option to override parameters there you should consider doing it.
Hope this helps. Please let us know how it goes.
-------
Please consider hitting Accept Answer
. Accepted answers help community also.