So I'm finnally able to test on my iOS device after about two weeks of issues getting it work. Thats another story for another day. I am able to now create an ipa and uload to the Apple store and then distribute through TestFlight. The result is that the delay I had when testing locally has disappeared. It is now extremmly fast (about 1 sec) on the same iPhone I used locally.
I can live with the delay when testing locally.
Thanks for your help