star schema in ADLS

Anshal 2,246

Hi friends, please guide me how I build a star schema in ADLS Gen2 and also

synapse . can it be done , link and documentation will help.

1 answer

Amira Bedhiafi 23,171 Reputation points

2023-09-19T16:47:30.08+00:00
While ADLS Gen2 is schema-on-read , it helps to organize your data to reflect the star schema. For example:

/fact_sales/

/dim_customers/

/dim_products/

...

So in your case, Azure Synapse Analytics can be used to query and analyze data on ADLS Gen2. Ensure you have an Azure Synapse Workspace and necessary components.

Synapse can natively integrate with ADLS Gen2. You'll just want to create linked services and datasets for your data.

Using either serverless SQL pool or provisioned SQL pool, you can develop and run T-SQL queries on your data in ADLS, treating them as if they were in a traditional star schema setup.

Here are some links that can help you :

Azure Data Lake Storage Gen2: ADLS Gen2 Documentation

Azure Synapse Analytics: Azure Synapse Analytics Documentation

Serverless SQL pool: Using Serverless SQL pool with ADLS Gen2
Please sign in to rate this answer.
Anshal 2,246 Reputation points

2023-09-20T08:44:19.31+00:00

Thank you. But my question is how to design star schema in ADF and Synape.

Amira Bedhiafi 23,171 Reputation points

2023-09-20T13:16:27.96+00:00

Star schema is a mature modeling approach widely adopted by relational data warehouses. It requires modelers to classify their model tables as either dimension or fact.

Designing star schema is dedicated to databases and for implementation it depends from a technolgy to another.

I assume that you are looking for Extract, Transform, and Load (ETL) with ADF:

Source Data: Identify your source data which can come from a variety of locations, such as blob storage, Azure SQL Database, on-prem databases, etc.

Transformations: Using Data Factory's data flow capabilities, you can transform your source data into the desired format for the star schema. This may involve data cleansing, aggregating, joining, filtering, etc.

Load: Once your data is transformed, use ADF's copy activity to load it into Azure Synapse Analytics into the fact and dimension tables.

QuantumCache 20,266 Reputation points

2023-09-21T20:31:36.71+00:00

Hello @Anshal Just checking if we are still connected on this discussion?Please let us know if you need to add more info so that we better assist you! If the response is helpful, please click "Accept Answer"
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

star schema in ADLS

1 answer

Your answer