Hi Michael,
I found out it was the .NET version.
At first I created the solution using .NET version 4.6.2, created the online repo, and was able to push proceeding updates.
Later I changed the solution's .NET version to 4.7.2, since then all my publish was stuck to Outgoing Push state.
I also noticed error message showing in the output is not related at all because that particular issue where SharePoint server is missing is still there but the publish-and-commit-all was successful.