Hi
Use App Service App Settings - the underscore replaces ":" for the hierarchy. The following snip (below) shows both the legacy instrumentation key and the newer connection string config .
App Settings override the config file values and are also exposed as Env Vars at runtime.
Azure Dev Ops (ADO) supports tasks for App service - and more generically there's a PS1 and CLI commands for setting app settings which can be used in a pipeline. CLI example here.
App settings also help a lot if you want to use App Service slots.