We are using Azure Managed Redis, running in Balanced B0, size 0.5GB, location West Europe.
After a few days our Container Apps (.NET 9) cannot connect anymore and get the following two exceptions:
The message timed out in the backlog attempting to send because no connection became available (5000ms) - Last Connection Exception: UnableToConnect (0-sent) on XYZ.westeurope.redis.azure.net:10000/Interactive, Flushed/ReadAsync, last: ECHO, origin: ResetNonConnected, outstanding: 13, last-read: 5s ago, last-write: 4s ago, unanswered-write: 4s ago, keep-alive: 60s, state: ConnectedEstablishing, mgr: 10 of 10 available, last-heartbeat: never, global: 5s ago, v: 2.8.24.3255, command=HGET, timeout: 5000, inst: 0, qu: 2, qs: 0, aw: False, bw: CheckingForTimeout, rs: ReadAsync, ws: Idle, in: 0, last-in: 0, cur-in: 0, sync-ops: 0, async-ops: 9, serverEndpoint: XYZ.westeurope.redis.azure.net:10000, conn-sec: 22.99, aoc: 0, mc: 1/1/0, mgr: 10 of 10 available, clientName: abc (SE.Redis-v2.8.24.3255), IOCP: (Busy=0,Free=1000,Min=1,Max=1000), WORKER: (Busy=0,Free=32767,Min=1,Max=32767), POOL: (Threads=7,QueuedItems=0,CompletedItems=441,Timers=19), v: 2.8.24.3255
The message timed out in the backlog attempting to send because no connection became available (5000ms) - Last Connection Exception: It was not possible to connect to the redis server(s). There was an authentication failure; check that passwords (or client certificates) are configured correctly: (RedisServerException) Error: WRONGPASS invalid username-password pair ConnectTimeout, command=HMSET, timeout: 5000, inst: 0, qu: 1, qs: 0, aw: False, bw: CheckingForTimeout, rs: ReadAsync, ws: Idle, in: 0, last-in: 0, cur-in: 0, sync-ops: 9, async-ops: 568, serverEndpoint: XYZ.westeurope.redis.azure.net:10000, conn-sec: 16.79, aoc: 0, mc: 1/1/0, mgr: 10 of 10 available, clientName: ABC (SE.Redis-v2.8.24.3255), PerfCounterHelperkeyHashSlot: 10240, IOCP: (Busy=0,Free=1000,Min=1,Max=1000), WORKER: (Busy=77,Free=32690,Min=1,Max=32767), POOL: (Threads=106,QueuedItems=1,CompletedItems=2321851,Timers=27), v: 2.8.24.3255
We use a user managed identity to connect. That identity can connect to other services like Azure table. So, the identity is existing and valid.
The only way we could get Redis working again was by deleting and recreating the Redis resource.
Monitoring is not showing any problems: 2MB used. Server load 30 to 60% - which is interesting because our apps can't connect. Connected Clients and Total Operations show both 10 with Count aggregation.
Any idea what could cause this?