Issue with assigning sparkpoolname in synapse pipeline deployed from template

Rohith Korupalli 1 Reputation point
2022-01-26T01:06:06.357+00:00

I am currently deploying our synapse workspace using az cli and json templates and after deploying, pipeline is unable to pickup the spark pool name from pipeline parameters as in the attached pic.

168478-image.png

168487-image.png
Any help is appreciated!!

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,486 questions
{count} votes

1 answer

Sort by: Most helpful
  1. KranthiPakala-MSFT 46,427 Reputation points Microsoft Employee
    2022-02-09T08:14:12.587+00:00

    Hello @Rohith Korupalli ,

    Thank you for patience and we have an update from the product team. Below is the workaround suggested by team until the bug/feature is being released. Sorry we do not have a definite ETA at the moment, hence recommended to use the below powershell approach in the meantime.

    $token=Get-AzAccessToken -ResourceUrl https://dev.azuresynapse.net  
    $authHeader=@{  
    'Content-Type'='application/octet-stream'   
    'Authorization'='Bearer '+$token.Token  
    }  
    $workspaceName="<your-worksapce-name>"  
    $pipelineName="<your-pipeline-name>"  
    # pipeline definition file which should be json format, such as “D:\def.json”  
    $pipelineDefinitonFile = "<your-pipeline-definition-File>"    
    $json = Get-Content  $pipelineDefinitonFile  
    #Set pipeline  
    Invoke-WebRequest -Method PUT -Uri "https://${workspaceName}.dev.azuresynapse.net/pipelines/${pipelineName}?api-version=2020-12-01" -Headers $authHeader -Body $json  
    

    Hope this info helps. Do let us know if you have further query.

    ------------------------------

    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
    • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators