That's exactly the cold start behavior of any web server because web apps need to warm up on demand before they can be ready to serve HTTP requests, not merely IIS, and mostly noticeably on a server that's not busy enough.
So, if you observe it on a debug/dev environment, simply ignore it and there is nothing wrong yet.