Pipeline publishing error in Azure data lake

Shripad 101

Hi Azure Gurus

I had created a pipeline in ADF and while publishing it getting the below error

Error:
Could not find a subtype for the resource. Fix the resource and refresh the page.

As this pipeline was redundant we had deleted it and now its throwing error for all other pipeline to be published.

Please let me know solution, i happened to read most of the forum queries and found most relevant and tried the solution given in below url

https://social.msdn.microsoft.com/Forums/azure/en-US/dba84ab4-beb5-4a2f-a106-9fa01e43f5ec/df-v2-all-pipelines-and-data-sets-now-saying-this-resource-references-resources-which-could-not?forum=AzureDataFactory

but still no luck.....

KranthiPakala-MSFT 46,427 Reputation points Microsoft Employee

2020-08-07T20:35:22.48+00:00

Hi @Shripad ,

Welcome to Microsoft Q&A platform and thanks for using this forum.

As per my understanding, when you tried to publish the pipeline that you have created, you are receiving the above mentioned error. But I'm a unclear on this statement 'As this pipeline was redundant we had deleted it and now its throwing error for all other pipeline to be published.'- Could you please elaborate more on this to clarify.

Also is your Data factory associated with GIT/AzureDevops or live mode?

Thank you
Shripad 101 Reputation points

2020-08-10T04:41:20.787+00:00

Hi Kranthi,

Elaboration of scenario:
I happened to learn this after posting the question, we had created the pipeline in the old branch of azure dev ops, and had to be moved to new branch for publishing, so the Json file of pipeline was copied along with dataset files from old branch to new branch in Dev ops.
After copying the new branch pipeline was tested and post testing the old branch pipeline was deleted from the Azure data lake.
Then when we published the new branch pipeline, happened to get the error as stated above.

Yes we are using Azure devops.

Please let me know if more details required.
KranthiPakala-MSFT 46,427 Reputation points Microsoft Employee

2020-08-11T00:30:53.08+00:00

Thanks for your response @Shripad . I will try to reproduce the behavior and will let you know once I have my findings ready. Will let you know if I need any additional details.

Thank you.
Shripad 101 Reputation points

2020-08-12T06:38:39.633+00:00

Thanks for reply, i have also raised it as an incident with internal team, will share if found any solution to it.

Thanks.

Accepted answer

Shripad 101 Reputation points

2020-08-12T12:37:44.377+00:00

Solution:
In the main branch under dataset we found a sink file which was referring to the deleted pipeline name. It was also deleted and then the tick on the pipeline validation occurred immediately.
So the problem is if we delete any pipeline using devops file system we should make sure all files are deleted else this error occurs while publishing.

Thanks.
Please sign in to rate this answer.

1 person found this answer helpful.
KranthiPakala-MSFT 46,427 Reputation points Microsoft Employee

2020-08-12T18:43:27.037+00:00

Hi @Shripad ,
Glad to know that your issue was resolved. And thank you so much for sharing your findings here with the community as it will be helpful for other reading this thread. :)

----------

Thank you
Sign in to comment

Share via

Pipeline publishing error in Azure data lake

0 additional answers