Azure Function is down after github deployment until manual stop & restart
Hi,
I have an Azure Function App which gets deployed via a github action. More often than not after a successful deployment (no errors on github) the endpoints start failing with Http 404. The endpoints definitely exist and after a manual restart the function app in question start working fine until the next github deployment which then breaks the APIs again.
I checked the traces in app insights and it looks like the requests don't reach the function app, which suggests the error is somewhere between API Management and the Function App.
I have downloaded the eventlog.xml file from the Kudu DebugConsole and I can see the following being spammed in it 100s of times:
<Event>
<System>
<Provider Name="ZipFS"/>
<EventID>0</EventID>
<Level>1</Level>
<Task>0</Task>
<Keywords>Keywords</Keywords>
<TimeCreated SystemTime="2024-07-23T14:21:16Z"/>
<EventRecordID>178827125</EventRecordID>
<Channel>Application</Channel>
<Computer>XXX</Computer>
<Security/>
</System>
<EventData>
<Data>Failed to write to temp file D:\local\NtExecutableCache\844770304\bin\SOME_SHARED_LIBRARY.dll.temp. Error: 0x80070070</Data>
</EventData>
</Event>
<Event>
<System>
<Provider Name="ZipFS"/>
<EventID>0</EventID>
<Level>1</Level>
<Task>0</Task>
<Keywords>Keywords</Keywords>
<TimeCreated SystemTime="2024-07-23T14:21:16Z"/>
<EventRecordID>178827156</EventRecordID>
<Channel>Application</Channel>
<Computer>XXX</Computer>
<Security/>
</System>
<EventData>
<Data>ExtractFileFromZip failed with code 0x80070070</Data>
</EventData>
</Event>
Apparently 0x80070070
means There is not enough space on the disk.
The dll file the system is trying to decompress is around a 100 MB in size, not sure if that is considered too big or not.
Does anyone have a suggestion what to do about this?
Thanks!