Migration of ADLS gen1 to gen2 - U-SQL scripts to ADLS Gen2

Question

We are in the process of migrating ADLS Gen1 to ADLS Gen2.  We understand that ADLA (Azure Data Lake Analytics) is not supported on ADLS Gen2. Can you please support us in how we can migrate U-SQL scripts to ADLS Gen2? Is there a quick workaround for migration or should we start converting all the code from U-SQL to a new platform? Your reply to this support is highly appreciated!

Answer 1

Hello Renny Sreekumar, Yes, you are correct. Currently, ADLS Gen2 does not support Azure data lake analytics. There is a feedback item submitted for this feature request in the Data lake feedback channel. https://feedback.azure.com/d365community/idea/61e1912b-7326-ec11-b6e6-000d3a4f032c for your question, one recommended approach is to migrate your U-SQL scripts to Azure Synapse Analytics, which supports ADLS Gen2 Below is a detailed document explained about the migration process. https://learn.microsoft.com/en-us/azure/data-lake-analytics/migrate-azure-data-lake-analytics-to-synapse https://learn.microsoft.com/en-us/azure/data-lake-analytics/understand-spark-data-formats High level steps:<copied form the documentation page> ·       Assess readiness ·       Create a migration plan. ·       Transform your U-sql scripts to apache spark which is supported by synapse. ·       Cutover

Please note depending on the complexity and scale of your U-SQL scripts and data pipelines. It's essential to plan and allocate resources accordingly. One more option is to use Azure databricks. You can migrate your U-SQL scripts to Apache Spark using the PySpark or Scala APIs, and then run them on Databricks. Databricks also provides integration with ADLS Gen2, so you can easily access your data in the new storage account. I hope this helps you with your migration process. Please let me know if you have any further questions. If this answers your question, please consider accepting the answer by hitting the Accept answer and up-vote as it helps the community look for answers to similar questions.