How to resolve this error when deploying an ADF release in DevOps

Question

How to resolve this error when deploying an ADF release in DevOps

Nick Nicolaides 0

We have 3 different release environments DEV, UAT, PROD.

I made a small change in a script (just added a comment), just so that I can test the deployment process, as the previous people working on this project have left and I will be taking it over.

I managed to deploy to DEV, but when I try to deploy to UAT and PROD I get the following error:

##[error]ADFT0010: Wrong path defined in config for object(path): pipeline.Cube 15 mins(properties.activities.typeProperties.url)

Do I just need to make a small change in a config file or would I need to get my head around this particular pipeline?

Bhargava-MSFT 31,261 Reputation points Microsoft Employee Moderator

2023-01-12T22:52:01.2066667+00:00

Hello @Nick Nicolaides ,

Welcome to the MS Q&A platform.

Per the error message, there is an issue with the path defined in the config file for the object in the pipeline "pipeline.Cube 15 mins".
Yes, I believe you can make the changes on the config file by locating the object "pipeline.Cube 15 mins" and checking the url path defined for it, and updating it to the correct path.

I hope this helps. Please let me know if you have any further questions.
Nick Nicolaides 0 Reputation points

2023-01-13T09:58:51.1466667+00:00
Hi @BhargavaGunnam-MSFT

Thanks for your response. I forgot to put in my description, that the error message also mentions a config file.

Is this not the file I need to change?

However, I'm not sure how to get to this file?

With regards to the pipeline, all I can see is this:

The settings for the pipeline seem to be the same settings in the DEV environment and that deployed fine.

Also when I copy and paste the url into a browser, I get:

{"code":"Unauthorized","subCode":0,"message":"Authentication failed.","timeStamp":"2023-01-13T09:56:34.6886605Z","httpStatusCode":401,"details":[{"code":"RootActivityId","message":"d26f6649-eca1-4a79-9e9a-24bd9134f583"}]}
Nick Nicolaides 0 Reputation points

2023-01-13T10:00:21.48+00:00

I pasted this question above, as it was meant to be a comment!
Bhargava-MSFT 31,261 Reputation points Microsoft Employee Moderator

2023-01-14T03:25:51.66+00:00

Hello @Nick Nicolaides ,

Sorry, your screenshots are not visible. Could you please re-send them?

Nick Nicolaides 0

Hi @Bhargava-MSFT

I'll copy and paste the error message:

2023-01-10T12:30:11.3756509Z STEP: Replacing all properties environment-related...2023-01-10T12:30:11.3892637Z Config file:   D:\a\r1\a\_Azure Data Factory CI\drop\deployment\config-uat.csv2023-01-10T12:30:11.4041812Z Validation of config file completed.2023-01-10T12:30:12.5162983Z ##[error]ADFT0010: Wrong path defined in config for object(path): pipeline.Cube 15 mins(properties.activities.typeProperties.url)2023-01-10T12:30:12.5673034Z ##[section]Finishing: Publish ADF vcuk-mymi-uat-eun-v2 from JSON files

Then in the pipeline settings for the "Process Cube" Activity we have the following URL:

[https://northeurope.asazure.windows.net/servers/asvfmmymiuatne/models/mymi/refreshes

Finally I managed to locate the "config-uat.csv" config file in the Repos/files and it contains the following:

type,name,path,value
linkedService,AppenateSync,typeProperties.connectionString.secretName,"vcuk-fm253-uat-sql-db-syncdata"
linkedService,AzureBlobStorage_MyMI,typeProperties.connectionString.secretName,"vcukmymiuateun"
linkedService,AzureSQL_MyMI_Report,typeProperties.connectionString.secretName,"report-uat-eun"
linkedService,AzureSQL_MyMI_Warehouse,typeProperties.connectionString.secretName,"warehouse-uat-eun"
linkedService,COINS_Replication_SQL,typeProperties.connectionString.secretName,"oalive"
linkedService,DataWarehouse_SQL,typeProperties.connectionString.secretName,"BI-DW"
linkedService,LNK_KVT_01,typeProperties.baseUrl,"https://kvt-vcfm-cbre-uat-uks.vault.azure.net/"
linkedService,LNK_KVT_02,typeProperties.baseUrl,"https://kvt-vcuk-mymi-uat-ne.vault.azure.net/"
linkedService,Maximo,typeProperties.server,"utwat-mdb-srvr1.vinci.plc.net:50005"
linkedService,Maximo,typeProperties.database,"MAXDB71"
linkedService,Maximo,typeProperties.username,"UATMAXMYMI"
linkedService,Maximo,typeProperties.schema,"maxprod"
linkedService,Maximo,typeProperties.encryptedCredential,"xx"
linkedService,Portal,typeProperties.connectionString.secretName,"portal-uat-eun"
linkedService,ShellBlobStorage,typeProperties.serviceEndpoint,"https://strvcfmshelluatuks.blob.core.windows.net"
linkedService,SSISDB,typeProperties.connectionString.secretName,"SSISDB"
linkedService,wat_sdb_srvr1,typeProperties.connectionString.secretName,"hseqwarehouse"
pipeline,"Cube 15 mins",activities.typeProperties.url,"https://northeurope.asazure.windows.net/servers/asvfmmymiuatne/models/mymi/refreshes"
linkedService,LNK_SFTP_CBRE,typeProperties.host,"sftp.uat.liaison.eu"
linkedService,LNK_SFTP_CBRE,typeProperties.username,"vinci_uat"
linkedService,LNK_SFTP_CBRE,typeProperties.privateKeyContent.secretName,"cbre-uat-sftp-privatekey"
linkedService,LNK_SFTP_CBRE,typeProperties.passPhrase.secretName,"cbre-uat-passphrase"
dataset,ShellCBREDataExtractSink,typeProperties.location.folderPath,"/inbox/vinci_uat"

I'm guessing there is a path in the code above it doesn't like but can't figure it out.

Nick Nicolaides 0 Reputation points

2023-01-17T08:46:25.52+00:00

Another thing to add, I just ran the Pipeline manually in ADF and it process the cube fine.
Nick Nicolaides 0 Reputation points

2023-01-17T15:17:50.18+00:00
@Bhargava-MSFT

I did some further investigating and discovered that the config file must be in the following format:

type,name,path,value

I found some information here:

[https://github.com/Azure-Player/azure.datafactory.devops

In my example the line it doesn't like is:

pipeline,"Cube 15 mins",activities.typeProperties.url,"https://northeurope.asazure.windows.net/servers/asvfmmymiuatne/models/mymi/refreshes"

And is displaying the error:

ADFT0010: Wrong path defined in config for object(path): pipeline.Cube 15 mins(properties.activities.typeProperties.url)

Which I interpret as; the object path (which is the "properties.activities.typeProperties.url" part) is incorrect.

I'm not what the correct syntax would be though?

Not sure if you can see images, but this is what the JSON file for that Pipeline looks like:

2 answers

Your answer

Bhargava-MSFT 31,261 Reputation points Microsoft Employee Moderator

2023-01-12T22:52:01.2066667+00:00

Hello @Nick Nicolaides ,

Welcome to the MS Q&A platform.

Per the error message, there is an issue with the path defined in the config file for the object in the pipeline "pipeline.Cube 15 mins".
Yes, I believe you can make the changes on the config file by locating the object "pipeline.Cube 15 mins" and checking the url path defined for it, and updating it to the correct path.

I hope this helps. Please let me know if you have any further questions.
Nick Nicolaides 0 Reputation points

2023-01-13T09:58:51.1466667+00:00

Hi @BhargavaGunnam-MSFT

Thanks for your response. I forgot to put in my description, that the error message also mentions a config file.

Is this not the file I need to change?

However, I'm not sure how to get to this file?

With regards to the pipeline, all I can see is this:

The settings for the pipeline seem to be the same settings in the DEV environment and that deployed fine.

Also when I copy and paste the url into a browser, I get:

{"code":"Unauthorized","subCode":0,"message":"Authentication failed.","timeStamp":"2023-01-13T09:56:34.6886605Z","httpStatusCode":401,"details":[{"code":"RootActivityId","message":"d26f6649-eca1-4a79-9e9a-24bd9134f583"}]}
Nick Nicolaides 0 Reputation points

2023-01-13T10:00:21.48+00:00

I pasted this question above, as it was meant to be a comment!
Bhargava-MSFT 31,261 Reputation points Microsoft Employee Moderator

2023-01-14T03:25:51.66+00:00

Hello @Nick Nicolaides ,

Sorry, your screenshots are not visible. Could you please re-send them?
Nick Nicolaides 0 Reputation points

2023-01-17T08:46:25.52+00:00

Another thing to add, I just ran the Pipeline manually in ADF and it process the cube fine.
Nick Nicolaides 0 Reputation points

2023-01-17T15:17:50.18+00:00

@Bhargava-MSFT

I did some further investigating and discovered that the config file must be in the following format:

type,name,path,value

I found some information here:

[https://github.com/Azure-Player/azure.datafactory.devops

In my example the line it doesn't like is:

pipeline,"Cube 15 mins",activities.typeProperties.url,"https://northeurope.asazure.windows.net/servers/asvfmmymiuatne/models/mymi/refreshes"

And is displaying the error:

ADFT0010: Wrong path defined in config for object(path): pipeline.Cube 15 mins(properties.activities.typeProperties.url)

Which I interpret as; the object path (which is the "properties.activities.typeProperties.url" part) is incorrect.

I'm not what the correct syntax would be though?

Not sure if you can see images, but this is what the JSON file for that Pipeline looks like:

Answer 1

Bhargava-MSFT 31,261 Microsoft Employee Moderator

Hello @Nick Nicolaides ,

Thank you for the details. As per the below error message, the specified path - properties.activities.typeProperties.url , for the object "pipeline.cube 15 mins" is incorrect. It could be that the path is not valid or that this path cannot reach using the URL.

ADFT0010: Wrong path defined in config for object(path): pipeline.Cube 15 mins(properties.activities.typeProperties.url)

Also, earlier you have provided this error message: {"code":"Unauthorized","subCode":0,"message":"Authentication failed.","timeStamp":"2023-01-13T09:56:34.6886605Z","httpStatusCode":401,"details":[{"code":"RootActivityId","message":"d26f6649-eca1-4a79-9e9a-24bd9134f583"}]}

This error message indicates the credentials were wrong.

I hope this gives some idea on troubleshooting the issue. In case, if you still need any further assistance, please let me know.

Nick Nicolaides 0

I'm still getting problems with this.

Initially I removed the line completely from the config file.

As soon as I did that, the Cube Refresh pipeline failed. Was working fine up until that point.

I then tried to put back in the original line, but it won't deploy it, coming up with the same error.

ADFT0010: Wrong path defined in config for object(path): pipeline.Cube 15 mins(properties.activities.typeProperties.url)

I've been told by the team that the url/link is fine as they can run it manually from the front end and it works.

I will attach the json file for this particular pipeline to see if there is anything else I should be passing through:

{
    "name": "Cube 15 mins",
    "properties": {
        "activities": [
            {
                "name": "ProcessCube",
                "type": "WebActivity",
                "dependsOn": [],
                "policy": {
                    "timeout": "7.00:00:00",
                    "retry": 0,
                    "retryIntervalInSeconds": 30,
                    "secureOutput": false,
                    "secureInput": false
                },
                "userProperties": [],
                "typeProperties": {
                    "url": "https://northeurope.asazure.windows.net/servers/asvfmmymidevne/models/mymi/refreshes",
                    "connectVia": {
                        "referenceName": "AzureIntegrationRuntime",
                        "type": "IntegrationRuntimeReference"
                    },
                    "method": "POST",
                    "body": {
                        "value": "{\"Type\":\"Full\",\"CommitMode\":\"transactional\",\"MaxParallelism\":2,\"RetryCount\":2,\"Objects\":[{\"database\":\"MyMI\",\"table\":\"DimAction\"},\n{\"database\":\"MyMI\",\"table\":\"DimActualDocumentAttachmentDate\"},\n{\"database\":\"MyMI\",\"table\":\"DimActualFinishDate\"},\n{\"database\":\"MyMI\",\"table\":\"DimActualFinishTime\"},\n{\"database\":\"MyMI\",\"table\":\"DimActualStartDate\"},\n{\"database\":\"MyMI\",\"table\":\"DimActualStartTime\"},\n{\"database\":\"MyMI\",\"table\":\"DimAdjustment\"},\n{\"database\":\"MyMI\",\"table\":\"DimAgreement\"},\n{\"database\":\"MyMI\",\"table\":\"DimAsset\"},\n{\"database\":\"MyMI\",\"table\":\"DimClass\"},\n{\"database\":\"MyMI\",\"table\":\"DimClassification\"},\n{\"database\":\"MyMI\",\"table\":\"DimCompany\"},\n{\"database\":\"MyMI\",\"table\":\"DimCompletionOverdueCategory\"},\n{\"database\":\"MyMI\",\"table\":\"DimCompletionOverdueStatus\"},\n{\"database\":\"MyMI\",\"table\":\"DimCompletionSLA\"},\n{\"database\":\"MyMI\",\"table\":\"DimCompletionStatus\"},\n{\"database\":\"MyMI\",\"table\":\"DimContract\"},\n{\"database\":\"MyMI\",\"table\":\"DimCurrency\"},\n{\"database\":\"MyMI\",\"table\":\"DimCustomer\"},\n{\"database\":\"MyMI\",\"table\":\"DimDiscipline\"},\n{\"database\":\"MyMI\",\"table\":\"DimDocument\"},\n{\"database\":\"MyMI\",\"table\":\"DimDocumentOverdueCategory\"},\n{\"database\":\"MyMI\",\"table\":\"DimDocumentOverdueStatus\"},\n{\"database\":\"MyMI\",\"table\":\"DimDocumentStatus\"},\n{\"database\":\"MyMI\",\"table\":\"DimDowntimeStartDate\"},\n{\"database\":\"MyMI\",\"table\":\"DimDueDate\"},\n{\"database\":\"MyMI\",\"table\":\"DimEngineer\"},\n{\"database\":\"MyMI\",\"table\":\"DimEscalationPoint\"},\n{\"database\":\"MyMI\",\"table\":\"DimEscalationStatus\"},\n{\"database\":\"MyMI\",\"table\":\"DimFinancialDate\"},\n{\"database\":\"MyMI\",\"table\":\"DimGeneralLedgerAccount\"},\n{\"database\":\"MyMI\",\"table\":\"DimInvoiceStatus\"},\n{\"database\":\"MyMI\",\"table\":\"DimIssueDate\"},\n{\"database\":\"MyMI\",\"table\":\"DimJobPlan\"},\n{\"database\":\"MyMI\",\"table\":\"DimJournal\"},\n{\"database\":\"MyMI\",\"table\":\"DimKPI\"},\n{\"database\":\"MyMI\",\"table\":\"DimKPIMRT\"},\n{\"database\":\"MyMI\",\"table\":\"DimKPIOperational\"},\n{\"database\":\"MyMI\",\"table\":\"DimKPIPlannedMaintenance\"},\n{\"database\":\"MyMI\",\"table\":\"DimKPIResponsePlan\"},\n{\"database\":\"MyMI\",\"table\":\"DimKPIServiceRequest\"},\n{\"database\":\"MyMI\",\"table\":\"DimLabor\"},\n{\"database\":\"MyMI\",\"table\":\"DimLaborSkillLevel\"},\n{\"database\":\"MyMI\",\"table\":\"DimLedger\"},\n{\"database\":\"MyMI\",\"table\":\"DimLocation\"},\n{\"database\":\"MyMI\",\"table\":\"DimLongDescription\"},\n{\"database\":\"MyMI\",\"table\":\"DimMaterial\"},\n{\"database\":\"MyMI\",\"table\":\"DimNote\"},\n{\"database\":\"MyMI\",\"table\":\"DimOrderDate\"},\n{\"database\":\"MyMI\",\"table\":\"DimOrderEndDate\"},\n{\"database\":\"MyMI\",\"table\":\"DimOrderStartDate\"},\n{\"database\":\"MyMI\",\"table\":\"DimOrganisation\"},\n{\"database\":\"MyMI\",\"table\":\"DimOriginalWorkOrder\"},\n{\"database\":\"MyMI\",\"table\":\"DimOriginalWorkType\"},\n{\"database\":\"MyMI\",\"table\":\"DimOvertimeApprover\"},\n{\"database\":\"MyMI\",\"table\":\"DimOvertimeType\"},\n{\"database\":\"MyMI\",\"table\":\"DimPaidDate\"},\n{\"database\":\"MyMI\",\"table\":\"DimPerson\"},\n{\"database\":\"MyMI\",\"table\":\"DimPM\"},\n{\"database\":\"MyMI\",\"table\":\"DimPostedDate\"},\n{\"database\":\"MyMI\",\"table\":\"DimPurchaseDate\"},\n{\"database\":\"MyMI\",\"table\":\"DimReceipt\"},\n{\"database\":\"MyMI\",\"table\":\"DimResponseOverdueCategory\"},\n{\"database\":\"MyMI\",\"table\":\"DimResponseOverdueStatus\"},\n{\"database\":\"MyMI\",\"table\":\"DimResponsePlan\"},\n{\"database\":\"MyMI\",\"table\":\"DimResponseSLA\"},\n{\"database\":\"MyMI\",\"table\":\"DimResponseStatus\"},\n{\"database\":\"MyMI\",\"table\":\"DimServiceDate\"},\n{\"database\":\"MyMI\",\"table\":\"DimSMEStatus\"},\n{\"database\":\"MyMI\",\"table\":\"DimSnapshotDate\"},\n{\"database\":\"MyMI\",\"table\":\"DimSnapshotPeriod\"},\n{\"database\":\"MyMI\",\"table\":\"DimSubContractor\"},\n{\"database\":\"MyMI\",\"table\":\"DimSupplier\"},\n{\"database\":\"MyMI\",\"table\":\"DimSupplierOrderDetails\"},\n{\"database\":\"MyMI\",\"table\":\"DimTargetCompletionDate\"},\n{\"database\":\"MyMI\",\"table\":\"DimTargetCompletionTime\"},\n{\"database\":\"MyMI\",\"table\":\"DimTargetDocumentAttachmentDate\"},\n{\"database\":\"MyMI\",\"table\":\"DimTargetStartDate\"},\n{\"database\":\"MyMI\",\"table\":\"DimTargetStartTime\"},\n{\"database\":\"MyMI\",\"table\":\"DimTicket\"},\n{\"database\":\"MyMI\",\"table\":\"DimTicketStatus\"},\n{\"database\":\"MyMI\",\"table\":\"DimTradeCode\"},\n{\"database\":\"MyMI\",\"table\":\"DimTransactionDate\"},\n{\"database\":\"MyMI\",\"table\":\"DimTravelEndTime\"},\n{\"database\":\"MyMI\",\"table\":\"DimTravelHomeEndTime\"},\n{\"database\":\"MyMI\",\"table\":\"DimTravelHomeStartTime\"},\n{\"database\":\"MyMI\",\"table\":\"DimTravelStartTime\"},\n{\"database\":\"MyMI\",\"table\":\"DimUserSecurity\"},\n{\"database\":\"MyMI\",\"table\":\"DimUserSecurityContract\"},\n{\"database\":\"MyMI\",\"table\":\"DimVFMClass\"},\n{\"database\":\"MyMI\",\"table\":\"DimVFMContractStatusLocationSpec\"},\n{\"database\":\"MyMI\",\"table\":\"DimVFMLRContract\"},\n{\"database\":\"MyMI\",\"table\":\"DimVFMPMApplyCADomain\"},\n{\"database\":\"MyMI\",\"table\":\"DimVFMReportedDate\"},\n{\"database\":\"MyMI\",\"table\":\"DimVFMResponseCategory\"},\n{\"database\":\"MyMI\",\"table\":\"DimVFMRMApplyCALocationSpec\"},\n{\"database\":\"MyMI\",\"table\":\"DimVNexusLink\"},\n{\"database\":\"MyMI\",\"table\":\"DimWorkLog\"},\n{\"database\":\"MyMI\",\"table\":\"DimWorkOrder\"},\n{\"database\":\"MyMI\",\"table\":\"DimWorkOrderClass\"},\n{\"database\":\"MyMI\",\"table\":\"DimWorkOrderStatus\"},\n{\"database\":\"MyMI\",\"table\":\"DimWorkOrderStatusDate\"},\n{\"database\":\"MyMI\",\"table\":\"DimWorkOrPOU\"},\n{\"database\":\"MyMI\",\"table\":\"DimWorkType\"},\n{\"database\":\"MyMI\",\"table\":\"FactCashProfile\"},\n{\"database\":\"MyMI\",\"table\":\"FactCashReceipts\"},\n{\"database\":\"MyMI\",\"table\":\"FactDocument\"},\n{\"database\":\"MyMI\",\"table\":\"FactGeneralLedger\",\"partition\":\"FactGeneralLedger2021\"},\n{\"database\":\"MyMI\",\"table\":\"FactInvoice\"},\n{\"database\":\"MyMI\",\"table\":\"FactKPIMRT\"},\n{\"database\":\"MyMI\",\"table\":\"FactKPIOperational\"},\n{\"database\":\"MyMI\",\"table\":\"FactKPIPlannedMaintenance\"},\n{\"database\":\"MyMI\",\"table\":\"FactKPIResponsePlan\"},\n{\"database\":\"MyMI\",\"table\":\"FactKPIServiceRequest\"},\n{\"database\":\"MyMI\",\"table\":\"FactKPISnapshot\"},\n{\"database\":\"MyMI\",\"table\":\"FactLabor\"},\n{\"database\":\"MyMI\",\"table\":\"FactMaterial\"},\n{\"database\":\"MyMI\",\"table\":\"FactMRTAirConditioning\"},\n{\"database\":\"MyMI\",\"table\":\"FactMRTJobSheet\"},\n{\"database\":\"MyMI\",\"table\":\"FactResponsePlan\"},\n{\"database\":\"MyMI\",\"table\":\"FactSecureOrderBook\"},\n{\"database\":\"MyMI\",\"table\":\"FactSubContractorCertificate\"},\n{\"database\":\"MyMI\",\"table\":\"FactSupplierOrder\"},\n{\"database\":\"MyMI\",\"table\":\"FactSupplierOrderSummary\"},\n{\"database\":\"MyMI\",\"table\":\"FactSupplierPayment\"},\n{\"database\":\"MyMI\",\"table\":\"FactTicket\"},\n{\"database\":\"MyMI\",\"table\":\"FactTimesheet\"},\n{\"database\":\"MyMI\",\"table\":\"FactVForm\"},\n{\"database\":\"MyMI\",\"table\":\"FactWorkLog\"},\n{\"database\":\"MyMI\",\"table\":\"FactWorkOrder\"},\n{\"database\":\"MyMI\",\"table\":\"FactWorkOrderStatus\"}]}",
                        "type": "Expression"
                    },
                    "authentication": {
                        "type": "MSI",
                        "resource": {
                            "value": "https://*.asazure.windows.net",
                            "type": "Expression"
                        }
                    }
                }
            }
        ],
        "folder": {
            "name": "Sub Flows/15mins Flows"
        },
        "annotations": [],
        "lastPublishTime": "2023-02-17T14:54:15Z"
    },
    "type": "Microsoft.DataFactory/factories/pipelines"
}

Bhargava-MSFT 31,261 Reputation points Microsoft Employee Moderator

2023-02-21T22:55:57.4633333+00:00

Hello @Nick Nicolaides ,

The Json seems to be good. I suggest opening a support case so the support engineer can arrange a live troubleshooting session to resolve the issue.
If you don't have a support plan, please let me know. I can help with a one-time free support request to fix the issue,

Looking forward to hearing from you.
Nick Nicolaides 0 Reputation points

2023-02-23T11:41:57.2166667+00:00

Hi

Yes we do have a support plan so I will open a new case.

Is the above, the best product/service to log it under?
Bhargava-MSFT 31,261 Reputation points Microsoft Employee Moderator

2023-02-23T20:20:07.92+00:00

Hello @Nick Nicolaides ,

Yes, Azure DevOps Service is the correct service to submit the support request.

Also, please note we have a dedicated channel here for AzureDevOps-related issues.

I hope this helps. Please let me know if you have any further questions.

Answer 2

Kamil Nowinski 1 MVP

The error ADFT0010 comes from #adftools, my PowerShell module I've written for ADF deployment.
For any issues you have with the tool please report it by raising an issue on the project's GitHub repo here:

https://github.com/Azure-Player/azure.datafactory.tools

You'll find there also the documentation and discussion section - so check whether this problem hasn't been faced by any other data community member before.

Share via

How to resolve this error when deploying an ADF release in DevOps

2 answers

Your answer