How can I see the complete url sent by synapse analytics?

Question

How can I see the complete url sent by synapse analytics?

Stinna Kongsdal Mikkelsen 26

I have created a pipeline in synapse analytics that loops through a list of entities, which is then passed to a foreach activity with a copy data activity inside.

My source is Dynamics 365FO and I am using the Dynamics AX connector. My linked service is working fine and the entity is dynamically passed in the foreach activity. However, I also need to add "?cross-company=true" in the query.

Data is indeed copied from Dynamics 365FO to my Azure SQL db but the "cross-company=true" does not seem to work.

How can I see the entire url sent to Dynamics 365FO? I have tried to look through the monitoring and debugging but I cannot see the complete url used. It should be a mix of the baseurl from the linked service, the entitypath and the query - but I cannot verify this.

In SSIS you could step through debugging and see all variable values at all times - I suppose something similar is available in synapse analytics / adf?

ShaikMaheer-MSFT 38,631 Reputation points Microsoft Employee Moderator

2022-11-17T04:18:03.35+00:00

Hi @Stinna Kongsdal Mikkelsen , Just checking in to see if the below answer helped. If this answers your query, do click and upvote for the same. And, if you have any further query do let us know.

Answer accepted by question author

0 additional answers

Your answer

ShaikMaheer-MSFT 38,631 Reputation points Microsoft Employee Moderator

2022-11-17T04:18:03.35+00:00

Hi @Stinna Kongsdal Mikkelsen , Just checking in to see if the below answer helped. If this answers your query, do click and upvote for the same. And, if you have any further query do let us know.

Answer 1

ShaikMaheer-MSFT 38,631 Microsoft Employee Moderator

Hi @Stinna Kongsdal Mikkelsen ,

Thank you for posting query in Microsoft Q&A Platform.

It seems you are using Dynamics AX connector as source dataset in Copy activity. Please correct me if I am wrong.

In Copy activity, Source tab using query option you can specify your OData query options for filtering data. For Example: $select=Name,Description&$top=5

When we use query options the connector copies data from the combined URL in below format.
[URL specified in linked service]/[path specified in dataset][query specified in copy activity source]

For more information see, OData URL components.

In your case, when after using query option in copy activity source tab, still your are facing issue? If yes, could you please share your implementation details along with screenshots once?

Please let me know how it goes.

Stinna Kongsdal Mikkelsen 26 Reputation points

2022-11-02T09:46:13.747+00:00

It is correct that I am using the Dynamics AX connector as a source dataset in copy activity.
'

And I have read the same documentation that you are referring to.

Here is a screenshot of my pipeline. I am getting the right data from the right entities but without the "?cross-company=true". I have checked in D365FO and the user DO have access to cross-company data. And I have tried with and without the quotes and questionmark but nothing seems to work. Isn't it possible to see the complete url that is sent to D365FO? Then it might be more obvious what is going on.
ShaikMaheer-MSFT 38,631 Reputation points Microsoft Employee Moderator

2022-11-02T11:37:08.603+00:00

Hi @Stinna Kongsdal Mikkelsen , Could you please remove double quotes from value and use only as ?cross-company=true and see how it behaves? Please let me know how it goes.
Stinna Kongsdal Mikkelsen 26 Reputation points

2022-11-02T12:33:06.143+00:00

It was not enough to remove the double quotes. I also had to remove the questionmark.

Here is a screenshot of my pipeline, which is working and giving me all the data that I want - including cross-company data.

However, I still would like to know how to check the complete url sent to D365FO - to help with future problems that might arise. Where can I see it? Can I get it dynamically and write it to a variable that I can see in the debugging?
ShaikMaheer-MSFT 38,631 Reputation points Microsoft Employee Moderator

2022-11-03T05:03:28.62+00:00

Hi @Stinna Kongsdal Mikkelsen , Awesome. yes you are right. As per documentation also I can see we no need to add ? symbol there. Please check below screenshot.

Regarding checking the complete URL, thats not possible at this moment. ADF service handles formation of URL and sending request all at behind the scenes we will not having control over to it to see the same.

----------------

Please consider hitting Accept Answer button. Accepted answers help community as well. Thank you.

Share via

How can I see the complete url sent by synapse analytics?

0 additional answers

Your answer