Hello @MartinJaffer-MSFT ,
Thank you for your reply and sorry for the delay on my side.
Let's forget the Power bi part (maybe I shouldn't had mentioned it) and focus on the dataset part.
The data is coming from a REST API call and I want to trigger a call that will update a local json blob that will be stored in Azure and afterwards I would like to transform the database.
I am currently using Data Factory and exporting the transformed data into different CSV (sink).
This process seems very inefficient to me and I am trying to figure out the best tool in order to automatically update data received from REST API into multiple tables without the need to overwrite a huge amount of data.
Could I achieve better results with services like Kusto, Databricks or Azure streaming services ?
Sorry if I am not describing the issue properly but I am very new in this field and especially with Azure services.