How to pull data from an on premise MySQL database into Azure Databricks dataframe

Alphonse Okossi 141 Reputation points
2021-04-15T15:58:02.637+00:00

How to pull data from an on premise MySQL database into Azure Databricks dataframe ?

  1. MySQL data is on premise and can be accessed through a VPN connection
  2. I am using Azure Databricks and Azure Data Factory, see below88315-new-design-page-3-2-page-4-1.png

How to setup pipeline in Azure Data Factory to accomplish this?

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,561 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,677 questions
0 comments No comments
{count} votes

Accepted answer
  1. HimanshuSinha-msft 19,491 Reputation points Microsoft Employee Moderator
    2021-04-15T23:55:59.423+00:00

    Hello @Alphonse Okossi ,
    Thanks for the ask and using the Microsoft Q&A platform .
    I think you will have take the two stesp approach , copy the data from my sql to a blob and then you can use a notebook activity in ADF to read the blob and have the data in dataframes .

    Just out of curiosity what is next are you planning to do once the data is in dataframes ?

    Please do let me know how it goes .
    Thanks
    Himanshu
    Please do consider to click on "Accept Answer" and "Up-vote" on the post that helps you, as it can be beneficial to other community members


0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.