How to Enable Copilot Agent to Query Large Datasets from SQL?

Question

How to Enable Copilot Agent to Query Large Datasets from SQL?

Zuha Alfaraj 0

Hello,

I'm using SQL tables from a Synapse Dedicated Pool as a knowledge source in a Copilot agent. The datasets are quite large, but I've noticed that the Copilot agent only queries up to 2,048 rows (tested across multiple tables).

How can I configure my Copilot agent to query the entire dataset and generate accurate responses?

Note: The data is structured (row-based), which is why I’m not considering Azure AI Search for this scenario.

Any insights or recommendations would be greatly appreciated!

Sayali-MSFT 3,991 Reputation points Microsoft External Staff Moderator

2025-01-30T07:16:24.4266667+00:00
@Zuha Alfaraj, Thank you for your inquiry! Could you please provide more details about your issue? Specifically, it would be helpful to know:

Reproduction Steps: What steps did you take leading up to the problem?

Documentation Links: Are there any specific guides or documentation you followed?

Teams Client Version: What version of the Teams client are you using?

Code Snippets: If applicable, please share any relevant code snippets.

Providing this information will help us better understand your situation and assist you more effectively
Zuha Alfaraj 0 Reputation points

2025-01-30T15:25:48.1133333+00:00
@Sayali-MSFT Thank you for your response

Reproduction Steps:

Create a Copilot Agent

Add SQL connection as a knowledge source

Documentation Links:

https://learn.microsoft.com/en-us/microsoft-copilot-studio/knowledge-graph-connections

Teams Client Version

The client version is 49/24120100221.
Sayali-MSFT 3,991 Reputation points Microsoft External Staff Moderator

2025-02-04T10:26:27.7533333+00:00

@Zuha Alfaraj, Thanks for sharing the information. We will check this with internal team and let you know the update.
Crawford, Tom 5 Reputation points

2025-02-17T15:58:57.4233333+00:00

Any update to this?
Crawford, Tom 5 Reputation points

2025-02-17T16:40:43.43+00:00

any update on this?
Mathieu Bouisson 0 Reputation points

2025-02-20T16:16:30.2466667+00:00

Hi, have a similar issue here, stuck with the 2000 rows limit when creating a SQL connection as knowledge source for my agent... how to tackle that ? Thanks in advance

1 answer

Your answer

Sayali-MSFT 3,991 Reputation points Microsoft External Staff Moderator

2025-01-30T07:16:24.4266667+00:00

@Zuha Alfaraj, Thank you for your inquiry! Could you please provide more details about your issue? Specifically, it would be helpful to know:

Reproduction Steps: What steps did you take leading up to the problem?

Documentation Links: Are there any specific guides or documentation you followed?

Teams Client Version: What version of the Teams client are you using?

Code Snippets: If applicable, please share any relevant code snippets.

Providing this information will help us better understand your situation and assist you more effectively
Zuha Alfaraj 0 Reputation points

2025-01-30T15:25:48.1133333+00:00

@Sayali-MSFT Thank you for your response

Reproduction Steps:

Create a Copilot Agent

Add SQL connection as a knowledge source

Documentation Links:

https://learn.microsoft.com/en-us/microsoft-copilot-studio/knowledge-graph-connections

Teams Client Version

The client version is 49/24120100221.
Sayali-MSFT 3,991 Reputation points Microsoft External Staff Moderator

2025-02-04T10:26:27.7533333+00:00

@Zuha Alfaraj, Thanks for sharing the information. We will check this with internal team and let you know the update.
Crawford, Tom 5 Reputation points

2025-02-17T15:58:57.4233333+00:00

Any update to this?
Crawford, Tom 5 Reputation points

2025-02-17T16:40:43.43+00:00

any update on this?
Mathieu Bouisson 0 Reputation points

2025-02-20T16:16:30.2466667+00:00

Hi, have a similar issue here, stuck with the 2000 rows limit when creating a SQL connection as knowledge source for my agent... how to tackle that ? Thanks in advance

Answer 1

Abdali, Md Jafar 0

Additional question in regard to this . Does it use text to sql query in the backend or it vectorize the data in the backend?

Share via

How to Enable Copilot Agent to Query Large Datasets from SQL?

1 answer

Your answer