How to extract/transfer data from external hive servers to my blob storage?

Samyak Jain 41 Reputation points
2021-12-23T10:21:13.717+00:00

I want to transfer/extract data from my local(external) hive servers to my azure blob storage account in order to perform ETL activities on the data. I also want this task to be automated for future purposes. Can you suggest what would be the best way/services/tutorial to perform such a task?

Azure Blob Storage
Azure Blob Storage
An Azure service that stores unstructured data in the cloud as blobs.
3,200 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,640 questions
{count} votes

Accepted answer
  1. ShaikMaheer-MSFT 38,546 Reputation points Microsoft Employee Moderator
    2021-12-24T16:08:59.68+00:00

    Hi @Samyak Jain ,

    • If your data is in Azure cloud and publicly accessible then you can go with Azure Integration runtime(AutoResolveIntegrationRuntime).
    • If your data is in local or on-prem or in some private network then you should go with Self hosted integration runtime.

    Click here to know more about Integration runtimes and there use cases.

    1 person found this answer helpful.

1 additional answer

Sort by: Most helpful
  1. Ronen Ariely 15,206 Reputation points
    2021-12-23T14:50:23.847+00:00

    Please check if these two document cover what you need:

    Copy and transform data from Hive using Azure Data Factory

    Create Hive tables and load data from Azure Blob Storage (check the part about load the data from blob)

    1 person found this answer helpful.

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.