Issue with copy data from Azure Synapse Link for Dataverse using ADF Dataflow
Hi there, We use Export to Data Lake option to copy the data from D365 and want to transform to Azure Synapse Link for Dataverse because Export to Data Lake option is obsoleting from 1st Nov 2024. We have configured Azure Synapse link for Dataverse in…
To Read Delta tables from ADLS Gen2 from Azure Analysis Services (AAS)
I'm not able to Read Delta tables from ADLS Gen2 from Azure Analysis Services (AAS), even though the MS Azure page here https://learn.microsoft.com/en-us/azure/analysis-services/analysis-services-datasource#tab1400a has given an option to read delta…
Azure purview and Onelake
Hi friends, how exactly Azure purview cost being calculated, whether it is depend on the service used,such as would costs calculated in Azure purview as single entity or the service and azure purview?
CDM and synapse datawarehouse
Hi friends, I have some questions on CDM common data model and what use cases it best suited for ? Since CDM has attributes , entities and relationships does it fair to assume that we don't need to do data model such as star schema and snowflake schema?…
Unable to use Synapse workspace features in Synapse Link for Dataverse when Synapse network is in private mode
Hi Team, We are using Synapse Link for Dataverse for syncing data from d365 to ADLS Gen2, which can be used for analytics in ADLS Gen2. As our Synapse analytics environment network is publically disabled and using…
Unable to connect Fivetran with public IP to ADLS Gen2 in Vnet with Private end point
Hi, I'm encountering an issue while trying to connect Fivetran to ADLS Gen2 in the UK South region. Here are the details: I have configured ADLS Gen2 as a destination in Fivetran and completed the prerequisites, including creating an SPN with appropriate…
Encryption Data on transit - from oracle to Azure Data lake
Hello - We have this implementation setup: use Synapse analytics Pipelines to extract data from Oracle OCI database Copy data to Azure data Lake Storage Transform data from ADLS Gen 2 to Azure Sql Database We want to make sure that : Data…
How to specify a custom catalog name for Azure Databricks Delta Lake Dataset in ADF
Hello, I am creating an Azure Databricks Delta Lake Dataset in ADF and I am only able to choose the database name that links to Databricks's hive_metastore. How can I specify a custom catalog name that I created in Databricks instead of…
Data Factory Time Discrepancy: Seeking Explanation
In Data Factory, I have a total transfer time of 23 minutes, but the sum of reading and writing time is much lower. My reading time is 4:48 and writing time is 7:12. Can someone help me understand this discrepancy ?
I have an ADLS Gen2 with hierarchical, its not allowing for failover
I have created an ADLS Gen2 with hierarchical and its not allowing for failover, I need to do failover testing
How to protect sensitive data in Azure?
I would like to load sensitive data in an Azure Data Lake Storage Gen2. I need to make sure that this data can not be read by the global administrator or any other kind of super user. How can this be realized? I think role-based access control is not…
How to migrate data from Azure databases to the container of storage accounts?
hi friends, i want to migrate data from two databases of azure synapse analytics to my ADLS2 container.What is a simple and efficient way? Thanks
Failure happened on 'destination' side. ErrorCode=DeltaInvalidCharacterInColumnName.
This exception occurred when I use the pipeline of data factory to copy data from sql server to lakehouse. But I didn't find any problems with the raw data.
Azure Synapse Link for dataverse to bring Dynamics 365 data to ADLS and Synapse for analytical purpose - Facing Issues and inconsistencies in the feature
We are using Synapse Link for Dataverse feature to bring dynamics 365 data to ADLS and Synapse Analytics. We have below open issues due to which we are unable to finalize the solution: In F&O linked dataverse environment, we have created a synapse…
This request is not authorized to perform this operation using this permission.", 403, HEAD Synapse connect to adls
I am trying to select data from ADLS Gen2 storage delta table and keep receiving this error. I added the synapse service principal as storage blob data contributor and ACLs to container with no luck. Firewall is set to enable all networks as well. Please…
Storage Account Limitations
Can anyone clarify the following Storage account questions: How many Storage accounts can be created? Microsoft's documentation indicated an increased quota for 250 storage accounts, with a max of 500 storage accounts. Is it possible to have…
How to copy files from sharepoint drive that has huge heirarcy of folders and subfolders
We want to get all files from the sharepoint into our ADLS container. In sharepoint drive there are arround 60k files but through our existing pipeline we are getting only 600 files. We have a web activity with below…
How to copy files from storage account to another storage account with the same last modified date using ADF
Hi Team, The request is that, when we are running ADF copy job to copy data from Landing storage account to Prod Storage account the last modified date coming as present copy time, but we want to copy the last modified date, what we have in landing…
Is it possible to tranfer files from logic app to SAP AL11 directory
Hi Experts, Is it possible to transfer the files from logic app to SAP AL11 directory. Thanks, Satish Pattanayak
Previous version of Updated file in Azure Datalake with Hierarchical namespace (Container)
How can we get previous version of uploaded/modified files when my storage is Datalake with Hierarchical namespace enabled. Could you please suggest how to get previous version either by Versioning or Snapshots or last option backup and restore? All the…