Hey @Martin Cairney ,
First of all thanks for the reply. Actually currently we have two sources from which we want to import data to azure. One is Salesforce and the second is OpenAir. From salesforce we take daily backup using OwnBackup tool and we can create an endpoint in OwnBackup to export that backup to Azure Mysql Database. In case of Open Air, neither we can make direct connection to OpenAir in Power Bi nor we connect it directly to Azure. We have to do some kind of automation to export backup from OpenAir and import it into Azure. Yes, you are right that currently we can use Power Bi features for now but i am looking for the coming years because our organization is growing , acquisitions are taking place and that's how the data is growing rapidly. Moreover, we can use a lot of more software in future. So, I want a centralized repository of Transformed and well managed data and i want to go with azure. Since i am new to azure so i am unable to decide which technology should i go with. My clear requirements are -
1-Want to create a centralized repository in Azure for the data coming from different sources
2- Want to perform ETL and automation for data importing and transformation
3- Will prepare a data sets in azure after proper ETL and then will use that data set in Power Bi for reporting and analysing.
4- Technology should be efficient , robust, scalable and faster in execution.
5- Also the cost should be out of my hands
Hope you understand my requirement. Now I am looking forward to you for the best suggestion.
It would be great if you could give the comparative suggestion of different options in terms of cost and features and scalability.
Keeping in mind that i don't know what Datalake, databricks and Azure Data Factory are.
Thanks