Create a Static Web App directly from the Azure portal and set the Deployment details option to Azure DevOps. This will create a pipeline automatically for you
If the above response helps answer your question, remember to "Accept Answer" so that others in the community facing similar issues can easily find the solution. Your contribution is highly appreciated.
hth
Marcin