Using Synaps studio to update data in dataverse

Question

Hello,

I have a canvas app in Power Apps and data is stored in dataverse, now users can leave certain forms data empty if they don't know what to fill in.

In Azure synaps studio I predict these empty values using Fuzzy matching to compare it to similiar records. Now I would like to write the predicted values back to the dataverse table. But this is something I can't get to work properly, I tried overwriting the current table. But instead it just deleteds it...

I would like to know if it is even possible what I'm trying here?

Kind regards,

Jordy

Answer 1

Hey Jordy!

Yes, it is possible to write predicted values back to the Dataverse table in Azure Synapse Studio. However, overwriting the entire table will result in the deletion of existing data, which is not the desired outcome.

To achieve your goal without deleting the entire table, you can follow these steps:

1. Retrieve the Existing Data: Before making any changes, retrieve the existing data from the Dataverse table using appropriate connectors or data sources in Azure Synapse Studio. This will ensure that you have a backup of the original data.
2. Perform Fuzzy Matching and Generate Predictions: Use the Fuzzy matching techniques in Azure Synapse Studio to compare the empty values with similar records and generate predictions. You can leverage built-in functions or custom logic to perform the fuzzy matching and generate the predicted values.
3. Map Predicted Values to the Empty Fields: Once you have the predicted values, map them to the corresponding empty fields in your data. Create a new column or update the existing column in your dataset to store the predicted values.
4. Update the Dataverse Table: Instead of overwriting the entire table, you should update only the specific records with the predicted values. You can achieve this by using the appropriate connectors or data sources in Azure Synapse Studio to connect to the Dataverse table and perform updates based on specific conditions or matching criteria.
5. Test and Validate: Before performing the updates on the Dataverse table, thoroughly test your solution in a controlled environment to ensure that it behaves as expected. Validate that the predicted values are correctly mapped and updated in the appropriate records.
6. Execute the Updates: Once you have tested and validated the solution, execute the updates on the Dataverse table. Make sure you apply the updates in a controlled manner to avoid unintended consequences.

By following these steps, you should be able to write the predicted values back to the Dataverse table without deleting the entire table. Remember to have proper backups and implement appropriate error handling and validation mechanisms to ensure data integrity.

Note: Azure Synapse Studio provides various connectors and data integration capabilities. Ensure that you are using the appropriate connectors and following best practices specific to your scenario when working with the Dataverse table.

If you encounter any specific issues or have further questions, feel free to provide more details, and I'll be happy to assist you further.