question

EL-8503 avatar image
0 Votes"
EL-8503 asked Monalv-msft edited

Unpivot very slow SSIS

I have three CSV files, that each one contain 462 rows and 56 columns. I created the unpivot task and this is very slow for 9 hours and not finished. The last status in progress is the count of rows of the first file.

Any suggestion, alternative?

@OlafHelper-2800
@TomPhillips-1744

sql-server-integration-services
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

RusselLoski-0634 avatar image
0 Votes"
RusselLoski-0634 answered

The first thing would do is to get a basic idea of where the problem is. I would test a simple package that reads one file and shows the output in a data viewer. How long does that take?

You could see if using the script component works for you. Check out https://www.sqlmovers.com/ssis-flexible-unpivot/.

5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Monalv-msft avatar image
0 Votes"
Monalv-msft answered Monalv-msft edited

Hi @EL-8503 ,

Please divide the CSV files into different small files.

Then use Unpivot Transformation in SSIS Data Flow Task.

Please refer to Integration Services Performance Best Practices – Data Flow Optimization.

Best regards,
Mona


If the answer is helpful, please click "Accept Answer" and upvote it.

Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.



· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hi @EL-8503 ,

May I know if you have anything to update?

Best regards,
Mona

0 Votes 0 ·