Is it possible to use Synapse link to retrieve attachments from Dataverse?

Question

Is it possible to use Synapse link to retrieve attachments from Dataverse?

saurabh 361

Hello,

I noticed that currently Synapse link for dataverse does not sync attachments from dataverse. The only way to get attachments is to make Dataverse REST API calls. Is there a way to use synapse link to get the attachments as well ?

Accepted answer

0 additional answers

Your answer

Answer 1

phemanth 15,755 Microsoft External Staff Moderator

@saurabh Welcome to Microsoft Q&A platform and thanks for posting your question.

You're right, currently Azure Synapse Link for Dataverse doesn't synchronize attachments by default. While there's no direct way to achieve it through Synapse Link itself, here are your options:

The primary function of Azure Synapse Link is to enable near real-time analytics on operational data by creating a link between Dataverse and Azure Synapse Analytics1. It allows you to manage and monitor your Dataverse tables included in the Azure Synapse Link.

Dataverse REST API Calls: As you mentioned, this remains the primary method for retrieving attachments. You can leverage Power Automate or custom code to interact with the Dataverse Web API and download attachments based on your needs.

Consider Alternative Storage: Explore storing attachments in Azure Blob Storage instead of directly within Dataverse. Synapse Link integrates seamlessly with Azure Blob Storage, allowing you to synchronize data and access attachments efficiently. This approach involves modifying your data model to reference attachment information stored in Blob Storage.

Here are some resources that might be helpful:

Azure Synapse Link for Dataverse FAQ: https://learn.microsoft.com/en-us/power-apps/maker/data-platform/export-data-lake-faq

Hope this helps. Do let us know if you any further queries.

If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

saurabh 361 Reputation points

2024-06-12T12:08:09.4833333+00:00

@phemanth Thank you for confirming. Say if the dataverse is configured to store the attachments are stored in data lake(not sure if its feasible, I think sharepoint can be integrated), and one uses synapse link for the data. Will these synapse link tables have the document location metadata stored in some of the columns ?
phemanth 15,755 Reputation points Microsoft External Staff Moderator

2024-06-12T13:26:20.8633333+00:00
@saurabh

You're right, Dataverse itself doesn't directly store attachments in a data lake like Azure Data Lake Storage (ADLS). SharePoint integration is a common approach for handling attachments. Here's how Synapse Link interacts with attachments in this scenario:

Storage Location: When Dataverse uses SharePoint for attachments, the actual attachment data resides in SharePoint, not within the data lake or Synapse Link tables.

Document Location Metadata: Synapse Link tables won't have a specific column containing the full document location within SharePoint. However, depending on your Dataverse configuration, there might be a metadata field referencing the attachment. This could be:

Attachment ID: A unique identifier for the attachment within Dataverse. This ID might not directly translate to a SharePoint location, but it could be used with the Dataverse Web API to retrieve the attachment.

Additional Metadata: Dataverse allows storing custom metadata fields alongside attachments. It's possible your configuration captures details like "File Name" or "File Type" in these custom fields, which Synapse Link would then expose in the corresponding table.

In summary:

Attachments reside in SharePoint, not Synapse Link or ADLS.

Synapse Link tables might have attachment IDs or some metadata depending on your Dataverse setup.

Here's what you can do:

Review Dataverse Configuration: Check how attachments are configured in Dataverse. Look for the presence of custom metadata fields related to attachments.

Dataverse Web API: If you have attachment IDs or need to retrieve attachments programmatically, explore using the Dataverse Web API to interact with SharePoint and download the files.

Share via

Is it possible to use Synapse link to retrieve attachments from Dataverse?

0 additional answers

Your answer