ELT frameworks (Azure)

GohJiayi 106 Reputation points
2022-01-20T00:15:44.647+00:00

Generally speaking, which Azure data platform is most typically utilized for data processing in an ELT framework?
Azure Data Factory or Azure Databricks...

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,722 questions
0 comments No comments
{count} votes

1 additional answer

Sort by: Most helpful
  1. Meng Yang Liu 911 Reputation points
    2022-01-20T11:00:17.877+00:00

    Both ADF and Databricks are widely used ETL or ELT solutions.
    It depends on the scenarios that must be implemented for the decision-making process.

    In the majority of designs, a hybrid approach is employed, which combines ADF with some custom code using Azure databricks or Azure functions/batch ( for some functionalities which are still not available in ADF)

    Or, in certain special circumstances when dedicated clusters are required, you choose ADB over ADF, as ADF dataflows construct clusters at runtime with each execution.

    ADLA and ADLS will be phased down over the next few years.

    0 comments No comments