Hi @Rahul Chouhan to quickly get up and going, you can use Visual Studio code to create your app service; which you've already done, and deploy your code. Even though the tutorial mentions creating a Linux the app, the same applies for a windows app. There are many options to deploy continuously to your app service. This tutorial walks you through deploying from your local git repo while this one shows how you can deploy continuously from github, azure devops, bitbucket, and others.
If you run into any issues, just let the community know :)