Syanpse Pipeline Call stored procedure using SQL Pool

Question

I'm capturing audit log for success / failure activities when moving data from parquet to sql pool db. Activities are running in parallel but few cases, there are no audit getting written to table.

Pipeline shows success but still no entry in db. When I directly executed proc with json object, data gets inserted.

Is there any other way to debug this why this got skipped data entry?
This should either fail or insert data rather than giving false success here?

Answer 1

Hi @Puran Joshi ,
Thankyou for using Microsoft Q&A platform and thanks for your query.

There are missing pieces in the query, which I want to clarify. What I understand is you are trying to copy data from parquet file to SQL DB . I can't see where is that happening, I expect there should be copy activity instead of Set variable , post the copy activity SQL Pool SP activity should run. Please let me know if there is gap in my understanding.

Now, coming to your issue, when you ran the SP manually with JSON as input parameter, it worked fine. So , what I would suggest is to check the input of SQL Pool SP in the pipeline runs, and see if the input parameter is taking the JSON correctly or not. Data entry might not have happened because the input parameter passed might be empty or NULL for those runs.

Also, Could you please check if you can reshare the second screenshot as it is not visible. Thanks in advance for your efforts! Looking forward to your response.

Hope this will help. Please let us know if any further queries.

------------------------------

• Please don't forget to click on or upvote button whenever the information provided helps you.
  Original posters help the community find answers faster by identifying the correct answer. Here is how
• Want a reminder to come back and check responses? Here is how to subscribe to a notification
• If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators