How to fix adf pipeline missing properties in api call response
Calling D365 dynamics in copy data activity in adf pipeline, api is getting called but not getting all the returned properties in response, few properties are missing.
ex. in D365 api is returning 5 properties in response, but in ADF pipeline i am getting on 4 properties.
adf pipeline calling d365 api and missing some of the preparties in response.
Azure Data Factory
-
Bhargava-MSFT • 31,226 Reputation points • Microsoft Employee
2023-09-12T20:14:49.6233333+00:00 Hello Arvind Singh,
Welcome to the Microsoft Q&A forum.
Please see the document below, which has the supported properties for the Dynamics linked service using ADF and Synapse.
Please let me know if the missing property still exists on the document.
I hope this helps.
-
Bhargava-MSFT • 31,226 Reputation points • Microsoft Employee
2023-09-13T15:59:32.8066667+00:00 Hello Arvind Singh,
I am checking to see if you got a chance to look into the above response.
-
Arvind Singh • 0 Reputation points • Microsoft External Staff
2023-09-14T04:26:16.8+00:00 Hi @Bhargava-MSFT ,
I am using Dynamix AX, I have checked this https://learn.microsoft.com/en-us/azure/data-factory/connector-dynamics-ax?tabs=data-factory
but there is solution mentioned for asked issue.
-
Bhargava-MSFT • 31,226 Reputation points • Microsoft Employee
2023-09-14T17:09:33.5466667+00:00 Hello Arvind Singh,
You mean there is no solution in that document, or you have already found a solution for the issue.
-
Arvind Singh • 0 Reputation points • Microsoft External Staff
2023-09-15T03:46:50.9866667+00:00 Hi BhargavaGunnam-MSFT, There is no solution in that document, I am still stuck in that issue.
-
Bhargava-MSFT • 31,226 Reputation points • Microsoft Employee
2023-09-15T22:28:21.95+00:00 Hello Arvind Singh,
Can you let me know what are all the missing properties in the API response?
-
Arvind Singh • 0 Reputation points • Microsoft External Staff
2023-09-20T06:19:48.13+00:00 I have created ADF pipeline, added a copy data activity and in source connection I have created linked service to Dynamics AX and added as source. Now issue is while loading data from Dynamics AX, pipeline is missing some of the response properties. ex. I am calling Dynamics AX api in browser getting 10 properties in response like {Id:1, name:'xyz', IsActive:1,.....so on} but in adf pipeline not getting all of these properties getting only ~8 properties like{Id:1, name:'xyz',.....so on}, some of the properties are missing for example IsActive is missing.
-
Bhargava-MSFT • 31,226 Reputation points • Microsoft Employee
2023-09-20T21:32:39.18+00:00 Hello Arvind Singh,
<update from internal team>
Thanks for the additional details.
Dynamics AX connector supports copying data from Dynamics AX using OData protocol with Service Principal authentication.
The Odata Connector document mentioned, "OData complex data types (such as Object) aren't supported."
If your datatypes are complex, ADF doesn't retrieve them.
So, the issue you are facing is due to the limitation of the ADF tool.
Reference documents:
I would suggest submitting a feature request in the ADF Feedback channel.
https://feedback.azure.com/d365community/forum/1219ec2d-6c26-ec11-b6e6-000d3a4f032c
All the feedback shared in this forum is actively monitored and reviewed by respective product owners. Please share the feedback link once it is posted so that I can up-vote it and pass the feedback to respective product owners.
I will also request the Product Team to update the "Dynamics AX" document regarding the limitation.
I hope this helps.
If this answers your question, please consider accepting the answer by hitting the Accept answer and up-vote as it helps the community look for answers to similar questions.
-
Bhargava-MSFT • 31,226 Reputation points • Microsoft Employee
2023-09-21T18:10:54.9566667+00:00 Hello Arvind Singh,
We noticed your feedback that the answer on this thread was not helpful.
Thank you for taking the time to share your feedback.
Since the issue you are facing is due to the limitation of the ADF tool, I suggest you submit the feedback item in the ADF feedback channel to improve your experience with ADF.
Kindly let us know what we could have done better to improve the answer and make your experience better.
I request that you would kindly re-take the survey for your engagement on this thread.
If you can accept and upvote this thread, it will be helpful for the community members who are experiencing the same issue due to the tool limitation.
We are here to help you and strive to make your experience better, and we greatly value your feedback. Looking forward to your reply.
I appreciate your feedback!
-
Bhargava-MSFT • 31,226 Reputation points • Microsoft Employee
2023-09-25T15:59:11.4+00:00 Hello Arvind Singh,
I am checking to see if you got a chance to look into my above response.
Sign in to comment