Fact History Load is taking quite huge time in Synapse

Uma B 1 Reputation point
2021-05-22T16:13:49.597+00:00

Hi Team ,

I am trying to load Fact Table (1.8Millions data) needs to be loaded as part of History Load.
first when I tried it took 14+ hours and then it got failed.
So then i tried to do partial load for each year. which i was able to quite well from 2015 to 2020 but now loading for current year it is taking quite hell lot of time(almost 4 + hours still not completing)
in query plan when i checked it is showing some 30billions estimated rows, also shuffling is happening

I have updated all statistics.

I have already raised Microsoft ticket regarding this but i have not received proper response from there.

Can some one assist me here ?

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,696 questions
{count} votes