Azure Function is down after github deployment until manual stop & restart

tamas-kr 56 Reputation points
2024-07-23T15:14:48.7333333+00:00

Hi,

I have an Azure Function App which gets deployed via a github action. More often than not after a successful deployment (no errors on github) the endpoints start failing with Http 404. The endpoints definitely exist and after a manual restart the function app in question start working fine until the next github deployment which then breaks the APIs again.

I checked the traces in app insights and it looks like the requests don't reach the function app, which suggests the error is somewhere between API Management and the Function App.

I have downloaded the eventlog.xml file from the Kudu DebugConsole and I can see the following being spammed in it 100s of times:

<Event>
	<System>
		<Provider Name="ZipFS"/>
		<EventID>0</EventID>
		<Level>1</Level>
		<Task>0</Task>
		<Keywords>Keywords</Keywords>
		<TimeCreated SystemTime="2024-07-23T14:21:16Z"/>
		<EventRecordID>178827125</EventRecordID>
		<Channel>Application</Channel>
		<Computer>XXX</Computer>
		<Security/>
	</System>
	<EventData>
		<Data>Failed to write to temp file D:\local\NtExecutableCache\844770304\bin\SOME_SHARED_LIBRARY.dll.temp. Error: 0x80070070</Data>
	</EventData>
</Event>
<Event>
	<System>
		<Provider Name="ZipFS"/>
		<EventID>0</EventID>
		<Level>1</Level>
		<Task>0</Task>
		<Keywords>Keywords</Keywords>
		<TimeCreated SystemTime="2024-07-23T14:21:16Z"/>
		<EventRecordID>178827156</EventRecordID>
		<Channel>Application</Channel>
		<Computer>XXX</Computer>
		<Security/>
	</System>
	<EventData>
		<Data>ExtractFileFromZip failed with code 0x80070070</Data>
	</EventData>
</Event>

Apparently 0x80070070 means There is not enough space on the disk. The dll file the system is trying to decompress is around a 100 MB in size, not sure if that is considered too big or not.

Does anyone have a suggestion what to do about this?

Thanks!

Azure Functions
Azure Functions
An Azure service that provides an event-driven serverless compute platform.
4,694 questions
{count} votes