Share via

Help me decide between Azure data lake analytics and Azure Databricks

WeirdMan 460 Reputation points
2023-10-04T10:40:23.2033333+00:00

Both Azure Data Lake Analytics and Azure Databricks can be used for batch processing. Can you help me understand for which case we can use each one?

Azure Analysis Services
Azure Databricks
Azure Databricks

An Apache Spark-based analytics platform optimized for Azure.

Azure Data Lake Analytics
0 comments No comments

Answer accepted by question author
  1. Amira Bedhiafi 41,386 Reputation points MVP Volunteer Moderator
    2023-10-04T10:51:24.65+00:00

    Usually, the AZ Data Lake is used as a storage which is much cheaper compared to other tools and you can manage the jobs side via Databricks notebooks (we are talking here about running jobs with high-performance and in-memory clusters).

    Another detail Databricks has more languages options and it is dedicated to many backgrounds working with data.

    If you are dealing with complex batch process and you have different type of developers who will work on your project you may go for both( a Azure Data Lake + Databricks architecture). Otherwise you can use Azure Data Lake.

    Here are some links :

    https://www.element61.be/en/resource/when-use-azure-synapse-analytics-andor-azure-databricks

    https://visualbi.com/blogs/microsoft/azure/etl-azure-databricks-vs-data-lake-analytics/

    https://www.databricks.com/discover/data-lakes

    2 people found this answer helpful.
    0 comments No comments

0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.