Azure Data Flow Sink - Connection string is not valid or missing Server/User/Database properties

Kashif Ahmed 40 Reputation points
2024-05-13T06:36:57.6633333+00:00

Could you please assist here to resolve this issue below ?

We are trying to read Delta table and store it as table in Azure SQL Database as using ADF Data Flow. Source Delta table via inline dataset from ADLS Gen2 its working fine and slink is getting below error.

Sink Error :

Connection string is not valid or missing Server/User/Database properties for LS_AzureMySql9dc67c7ce9e84fd7944bd851294e044e","detailedMessage":"Failure 2024-05-13 06:15:45.149 failed DebugManager.processJob, run=3a406977-d0ef-4d56732-bef3-09dc21ceb54675647a, errorMessage=com.microsoft.dataflow.broker.MissingRequiredPropertyException: Connection string is not valid or missing Server/User/Database properties for LS_AzureMySql9dc67e856756754344bd851294e044e"}}\n" } - RunId: 3a40645977-d0ef-4d32-bef3-09dc21ceb47a

Dataset : Azure Database MYSQL , this dataset has linked service parameter and table name parameter, Test connection is working fine in the dataset (Default values in parameter)

User's image


Issue :

Test connection is failing in sink settings while using the Azure Database MYSQL parameter.User's image

Please guide as to resolve this issue.

Azure SQL Database
Azure Database for MySQL
Azure Database for MySQL
An Azure managed MySQL database service for app development and deployment.
727 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,761 questions
{count} votes

Accepted answer
  1. AnnuKumari-MSFT 31,726 Reputation points Microsoft Employee
    2024-05-15T17:13:24.12+00:00

    @Kashif Ahmed ,

    The connection string for mySQL looks like this. I suspect sslmode is missing in the secretvalue which you might have stored in the keyvault, kindly leverage the connection string as it is and try once and let us know how it goes.

    User's image

    Additionally, Could you please execute the Dataflow as well and see if after publishing and execution also it's throwing same error? Thankyou

    1 person found this answer helpful.

1 additional answer

Sort by: Most helpful
  1. AnnuKumari-MSFT 31,726 Reputation points Microsoft Employee
    2024-05-13T17:40:52.6533333+00:00

    Hi Kashif Ahmed ,

    Thankyou for using Microsoft Q&A platform and thanks for posting your query here.

    As per my understanding, you are trying to read a Delta table and store it as a table in Azure SQL Database using Azure Data Factory Data Flow. However , the test connection is failing in sink settings while using the Linked service and dataset parameter. Please let me know if that is not the correct understanding.

    While you are trying to test connection in the sink dataset, you might have been asked to provide value for the linkedserviceSecretBase. Kindly make sure you have provided the valid value there by manually trying to connect to the mySQL server using that value first.

    Additionally, kindly make sure all the expressions used to parameterized the linked service and dataset ex: @dataset().LinkedServiceSecretBase etc are not copied and pasted, you have opened the add dynamic content option and selected the parameter which have generated that expression, else it would treat it as string, instead of passing the value by the system.

    Hope it helps. Kindly let us know how it goes. Thankyou

    0 comments No comments