Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,344 questions
For an ADF Linked Service JSON definition how can I add the equivalent of a WInSCP AddRawSettings("FtpHost", "0") session option please?
GB
6
Reputation points
Hello, How may I find the ADF Linked Service JSON definition such that it might explain how to add the equivalent of a WInSCP AddRawSettings("FtpHost", "0")
session option please to the following code?
Please assume I know very little, many thanks
{
"name": "FtpServer",
"properties": {
"annotations": [],
"type": "FtpServer",
"typeProperties": {
"host": "xxxx.xxxxxx.co.uk",
"port": 21,
"enableSsl": true,
"enableServerCertificateValidation": true,
"authenticationType": "Basic",
"userName": "anonymous",
"password": {
"type": "AzureKeyVaultSecret",
"store": {
"referenceName": "AzureKeyVault1xx_kv_ls",
"type": "LinkedServiceReference"
},
"secretName": xxxxxxxx/29a2dbb11319452f829a4d35b78b9b76
}
},
"connectVia": {
"referenceName": "IR-xx",
"type": "IntegrationRuntimeReference"
}
}
}
{count} votes
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(134.4, 9%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKM%3C/text%3E%3C/svg%3E)
KranthiPakala-MSFT 46,612 Reputation points Microsoft Employee2023-02-23T23:01:48.6933333+00:00 Welcome to Microsoft Q&A forum and thanks for reaching out here.
As per my understanding you are looking to update the ADF FTP Linked service JSON definition such that you have configuration equivalent to WInSCP AddRawSettings("FtpHost", "0"). Please correct me if I'm not accurate.
I'm not 100% sure if ADF linked service support that property in the linked service, but you can give try by editing the JSON definition of the FTP linked service and adding the following line of code to the
typePropertiessection:"rawSettings": [ { "Name": "FtpHost", "Value": "0" } ]OR
"rawSettings": { "Name": "FtpHost", "Value": "0" }The full JSON definition of the linked service may look like below (Please note that this is just a sample for reference, this will just give you an idea, but may have to play around with it to make it work)
{ "name": "FtpServer", "properties": { "annotations": [], "type": "FtpServer", "typeProperties": { "host": "xxxx.xxxxxx.co.uk", "port": 21, "enableSsl": true, "enableServerCertificateValidation": true, "authenticationType": "Basic", "userName": "anonymous", "password": { "type": "AzureKeyVaultSecret", "store": { "referenceName": "AzureKeyVault1xx_kv_ls", "type": "LinkedServiceReference" }, "secretName": "xxxxxxxx/29a2dbb11319452f829a4d35b78b9b76" }, "rawSettings": { "Name": "FtpHost", "Value": "0" } }, "connectVia": { "referenceName": "IR-xx", "type": "IntegrationRuntimeReference" } } }OR
{ "name": "FtpServer", "properties": { "annotations": [], "type": "FtpServer", "typeProperties": { "host": "xxxx.xxxxxx.co.uk", "port": 21, "enableSsl": true, "enableServerCertificateValidation": true, "authenticationType": "Basic", "userName": "anonymous", "password": { "type": "AzureKeyVaultSecret", "store": { "referenceName": "AzureKeyVault1xx_kv_ls", "type": "LinkedServiceReference" }, "secretName": "xxxxxxxx/29a2dbb11319452f829a4d35b78b9b76" }, "rawSettings": [ { "Name": "FtpHost", "Value": "0" } ] }, "connectVia": { "referenceName": "IR-xx", "type": "IntegrationRuntimeReference" } } }Please give a try as above and see if that helps to achieve your requirement.
Let us know how it goes.
Thank you
-
GB 6 Reputation points
2023-02-24T18:07:44.7966667+00:00 Thanks for the hand holding @KP. Unfortunately neither works. Both return "The remote certificate is invalid according to the validation procedure." when LS is Tested. I was wondering if the 'rawSettings' name had a different value for the ADF syntax over the WinSCP syntax rather than assuming the same value might work Without using the AddRawSettings("FtpHost", "0") with WinSCP in PowerShell the connection is not made. Aside the LS IR is an on prem IR on the same box that allows the WinSCP connection.
How may I find the full JSON elements allowed and implemented for LinkedServices?
My understanding is with a host that needs FEAT enabled (it works with SmartFTP) that the WInSCP.AddRawSettings allows a connection to be made - tested and working. I must admit subsequently pulling data has yet to be tried via WinSCP.
This WinSCP PS has seen to be working:$sessionOptions = New-Object WinSCP.SessionOptions -Property @{Protocol = [WinSCP.Protocol]::FtpHostName = "yadayada"UserName = "anonymous"FtpSecure = [WinSCP.FtpSecure]::ExplicitTlsClientCertificatePath = "yadayada"PrivateKeyPassphrase = "yadayada"}$sessionOptions.AddRawSettings("FtpHost", "0")$session = New-Object WinSCP.Sessiontry{# Connect$session.Open($sessionOptions) # Your code}finally{$session.Dispose()} -
KranthiPakala-MSFT 46,612 Reputation points Microsoft Employee
2023-02-28T00:27:51.88+00:00 @GB Thanks for your response. Unfortunately, there is no documentation on what elements are allowed apart from the ones that are available in Linked Service configurations in UI. Since this particular property is not available in UI, I assume, the product team haven't test it or not included it as part of the functionality. Hence assuming it may not be supported to configure.
But if you have feedback for ADF Product, I encourage you to please log it in feedback forum here:PRODUCT FEATURE REQUEST:
We request to please go ahead and log a feature request in the feedback portal here: https://feedback.azure.com/d365community/forum/1219ec2d-6c26-ec11-b6e6-000d3a4f032c
Product group does monitor and review the requests and based on the priority of requests, they can plan for implementation in future. Once you log the feature request you will also be notified on the status of the request when respective product acknowledges it.
Once you have logged the feature request in the above feedback portal, please do share link for the same here, so that we can share it with internal teams to review it.
Thank you
-
GB 6 Reputation points
2023-03-13T14:14:44.56+00:00 -
GB 6 Reputation points
2023-03-16T17:20:56.0633333+00:00 Might there be a clue to what a valid full schema for linked services is within this ARM resource or component?
https://schema.management.azure.com/schemas/2019-04-01/deploymentTemplate.json
under a 'Microsoft.DataFactory' level?
-
KranthiPakala-MSFT 46,612 Reputation points Microsoft Employee
2023-03-17T05:46:25.2366667+00:00 @GB Thank you so much for sharing the feedback link. We will share it with respective product owners to further review this.
I looked at the ARM template properties but none of them had any clues. My hunch is that those properties aren't support with the connecter yet. I have also reached out to internal teams to see if they any guidance or inputs regarding this requirement but haven't heard anything yet. In case if I hear anything from them, I will keep you posted.
If you think this is a blocker for you, then please feel free to create a support ticket from Azure portal and a support engineer should be able to provide more information and possibly they may involve respective product feature owner to confirm if it is possible to implement or not. In case if you don't have a support plan, please let me know so that I can assist you on creating a one-time free support ticket.
Sign in to comment
Sign in to answer