How do I create an exploratory zone on top of my Azure Data Lake

Question

Hi,
My sincere apologies if this question would have been already answered. However, I searched hard but couldn't find the relevant information. Here lies my question:

I have a Data Lake setup in Azure already. Further on, I have a requirement to enable Sandboxes to Data Scientists for doing experiment by accessing the data from the Data Lake in a controlled manner. The sandboxes will be enabled in various sizes namely - small, medium and large. My question here is how can I enable an automated provisioning of sandboxes , based on the users request.

Following are the list of resources which I need to provision in the sandbox:

• Azure Key Vault
• Azure Data Factory
• Databricks
• Azure SQL
• Azure Synapse
• Cosmos DB
• Azure Machine Learning Services
• Azure functions

Please can you let me know your thoughts on this.
Thanks,
Debu

Answer 1

Hi @Ghosh, Debabrata (External) ,

Welcome to Microsoft Q&A Platform. Thanks for posting the query.

As per my understanding, the requirement is to create controlled environment(Sandboxes) with various Azure resources deployed in it and according to various configurations(That can be divided into small, medium and large types). Using Azure DevOps (ADO) would be good approach to automatically deploy resources into Azure using Release pipelines.

Please check the Azure DevOps documentation for more details on creating and setting up of pipelines. We can leverage environments and variable groups in ADO that enables us to have different deployment mechanisms as desired (Small, Medium and Large).

Azure DevOps is currently not supported in the Q&A forums, please ask the experts in the dedicated Azure DevOps forum over here:

https://developercommunity.visualstudio.com/spaces/21/index.html.html

Hope this helps! If the question is understood incorrectly or the approach suggested is not meeting the requirement, kindly share more details with us and we will be glad to assist further.