How to read data from integration dataset using SQL

Question

How to read data from integration dataset using SQL

Dolase, Vishal 0

Hello,

I have integration dataset from SQL Database.
I want to query this table for fetching details, I could not find any details in the documentation

User's image

NIKHILA NETHIKUNTA 4,600 Reputation points Microsoft External Staff

2024-12-09T05:29:19.32+00:00

@Dolase, Vishal
Just checking in to see if the below answer helped. If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.
Dolase, Vishal 0 Reputation points

2024-12-09T05:58:53.07+00:00

Thank you for your answer @NIKHILA NETHIKUNTA,
I do not want to use pipelines, I simply want to query the data in real time from synapse.
I also do not want to make copy of data on my side.

Kindly suggest an approach
Chandra Boorla 10,490 Reputation points Microsoft External Staff

2024-12-10T01:20:14.65+00:00

@Dolase, Vishal

Just checking in to see if the below suggestion helped. If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

1 answer

Your answer

NIKHILA NETHIKUNTA 4,600 Reputation points Microsoft External Staff

2024-12-09T05:29:19.32+00:00

@Dolase, Vishal
Just checking in to see if the below answer helped. If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.
Dolase, Vishal 0 Reputation points

2024-12-09T05:58:53.07+00:00

Thank you for your answer @NIKHILA NETHIKUNTA,
I do not want to use pipelines, I simply want to query the data in real time from synapse.
I also do not want to make copy of data on my side.

Kindly suggest an approach
Chandra Boorla 10,490 Reputation points Microsoft External Staff

2024-12-10T01:20:14.65+00:00

@Dolase, Vishal

Just checking in to see if the below suggestion helped. If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

Answer 1

NIKHILA NETHIKUNTA 4,600 Microsoft External Staff

@Dolase, Vishal
Thank you for the question and for using Microsoft Q&A platform.

As per my understanding, you are trying to query from an Integration Dataset.
We cannot query a dataset while creating it. But you can query it while using it in a pipeline. I have provided an example below:

I have created an integration dataset for a SQL database:

User's image

After creating a dataset, add this as the source to Copy data activity. You can query the table here with the query option:

User's image

https://learn.microsoft.com/en-us/azure/data-factory/concepts-datasets-linked-services?tabs=data-factory
https://techcommunity.microsoft.com/blog/azuresynapseanalyticsblog/ingest-and-transform-data-with-azure-synapse-analytics-with-ease/1975563

Hope this helps. Do let us know if you have any further queries. ------------ If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

Dolase, Vishal 0 Reputation points

2024-12-09T05:55:31.4033333+00:00

Thank you for your Answer @NIKHILA NETHIKUNTA,
I dont want to use pipeline, simply want to query the data in realtime from synapse. I also do not want to create any copy of data

Kindly suggest an approach for this
Chandra Boorla 10,490 Reputation points Microsoft External Staff

2024-12-09T09:44:56.8966667+00:00

@Dolase, Vishal

Understanding and Querying Integration Datasets in Synapse Analytics

Understanding Integration Datasets:

Integration datasets in Azure Synapse Analytics are essentially pointers to external data sources. They don't store the actual data within Synapse but provide a way to query and access it directly. This allows you to work with data from various sources, such as SQL databases, without physically copying it into Synapse.

Querying Integration Datasets:

Unfortunately, Synapse Analytics doesn't currently support querying real-time data from an integration dataset without using a pipeline or copying data. The primary reason for this is that Synapse Analytics is designed to work with structured data stored in tables or data warehouses. While it can ingest real-time data through pipelines or streaming ingestion, direct querying of real-time data from an integration dataset isn't a native feature.

Appreciate if you could share the feedback on our feedback channel. Which would be open for the user community to upvote & comment on. This allows our product teams to effectively prioritize your request against our existing feature backlog and gives insight into the potential impact of implementing the suggested feature.

I hope this information helps. Please do let us know if you have any further queries.

If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.
Chandra Boorla 10,490 Reputation points Microsoft External Staff

2024-12-11T02:24:53.26+00:00

@Dolase, Vishal

Following up to see if the above suggestion was helpful. If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

Share via

How to read data from integration dataset using SQL

1 answer

Your answer