@Zoran Maricic What is your mobile app hosted on? An Azure VM?
I know with Azure Web Apps, there is an always-on feature that pings the site every minute to keep it loaded into memory. The behavior you are describing sounds similar to that.
As far as I know, Azure Notification Hub does not have an always-on feature, nor does it need it.
If your dependencies are hot, how many clients are expected to receive the notification? I ask as the next concern would be throttling by your PNS if you are sending larger amounts.
Lastly, what tier of notification hub are you using? The free tier does not offer any SLA so troubleshooting performance/reliability issues because a bit more of a grey area. I would also check the quota per pricing tier listed here to ensure you are not exceeding any of these such as the 500 active devices for the free tier.