Dataflow sink table as a source

Mogale Rickie 0

I am trying to add the sink as source in order to implement exist and lookup for SCD Type 2 but the source table (from the sink) is blank no column names or data, does anyone perhaps know why that is? How can I resolve this?

Smaran Thoomu 9,685 Reputation points Microsoft Vendor

2024-04-18T05:07:30.5033333+00:00

@Mogale Rickie Just checking in to see if the below answer helped. If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

1 answer

Amira Bedhiafi 15,446 Reputation points

2024-04-17T10:32:29.16+00:00

You didn't provide information about your datasource or the dataflow you are having, just verify if the data is being successfully written to the sink table. Sometimes the configuration or permissions might prevent data from being written, or the write operation may be delayed.

If the schema and data are there, but not immediately visible, there could be a caching issue or a delay in the data refresh in the source system.
Please sign in to rate this answer.
Mogale Rickie 0 Reputation points

2024-04-17T13:01:01.0366667+00:00

Thank you for the response, however I can preview the data on the sink and its available, I can even query it in SQL and it has data; only when I use the (sink) table as a source where it comes out empty. They from a blob storage container

Amira Bedhiafi 15,446 Reputation points

2024-04-17T13:48:06.3733333+00:00

The sink is the location/data store, where we would like the data to be loaded to. If you are familiar with SSIS Data Flow Task, this is similar to the Destination component.

So did you run your pipeline before ?

Amira Bedhiafi 15,446 Reputation points

2024-04-17T13:49:09.1366667+00:00

You may try to delete the sink and add it afresh, to let go of any cache issue.
Sign in to comment