Query data in .csv file in Azure Data lake and insert queried data in Azure SQL using Azure Data lake

Question

Data is in .csv file in Azure Data lake containers. We want to query the data in these files and insert the queried data directly in Azure SQL using Azure Data factory. Don't want to copy all the data from .csv as is to Azure SQL some temporary table and then query this table to fetch and insert data in another Azure SQL table.

Do I have to create Azure Data lake Analytics account and user U-SQL here? Will it server the purpose?

Thanks

Vishal

Answer 1

Hello @Vishal Bhanage ,
Thanks for the ask and using Microsoft Q&A platform .

Yes you will have a create ADL account . Let me point to thie blog by Mark , this should be helpful .
https://kromerbigdata.com/2019/03/03/u-sql-searchlog-aggregations-as-adf-data-flows/

Please do let me know how it goes .
Thanks
Himanshu

-------------------------------------------------------------------------------------------------------------------------

• Please don't forget to click on or upvote button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
• Want a reminder to come back and check responses? Here is how to subscribe to a notification
• If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators