Analyze the data available in Delta lake created from ADF

Vaibhav 105 Reputation points
2024-04-02T11:31:19.69+00:00
  1. I am using ADF to ingest the data from Oracle DB to Raw Layer.
  2. Then I am using ADF DataFlow to create and load data from RawLayer to DeltaLake . PFA.
  3. User's image

Now if I want to view/analyze the data in the delta lake , then which tools I can use ? Is there any tool like dbeaver that will understand the delta feature? Or I have to first load the data somewhere like DB ?
( I do not want to use Databricks or Synapse. )

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,718 questions
{count} votes

1 answer

Sort by: Most helpful
  1. Vinodh247 21,226 Reputation points
    2024-04-02T13:58:56.4433333+00:00

    Hi Vaibhav,

    Thanks for reaching out to Microsoft Q&A.

    One can directly interact with Delta Lake using Spark SQL or other Spark APIs. This allows you to explore the data/run queries and perform analytics within the delta lake environment.

    Consider the data profiling tools that support delta Lake. These tools help you understand the structure, quality, and characteristics of your data and some seems to be available in the market, but I will suggest you explore them, particularly licensing and your env suitability.

    • Talend
    • Dataedo
    • Informatica data profiling tool

    Please 'Upvote'(Thumbs-up) and 'Accept' as an answer if the reply was helpful. This will benefit other community members who face the same issue.

    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.