ADLS connections with third party

Question

Hi friends, we have ingested data from all the data sources and stored it in ADLS Gen2 but after that, there is a virtual layer in the form of Denodo. This virtualization tool only has views and once views are executed, it fetches the data from multiple data sources and retrieves the data. Since Denodo has views on how it would connect with ADLS and fetch the data from multiple datalake folders and subfolders at once. Is it even possible?

Answer 1

Create a data source in Denodo that connects to your ADLS Gen2 account and provide the necessary connection details such as the Account Name, Account Key, Container Name, and File System Name.

Then you need to provide the Account Key for authentication. You may also use other authentication methods like Service Principal or Managed Identity if preferred.

Once everything is ok , you can create base views in Denodo which will represent the data stored in ADLS Gen2.

Select the files or folders you want to create views for and define the schema for these files (Denodo c can automatically detect the schema based on the file format) and create Base View for each data file or folder you need.

To fetch data from multiple folders and subfolders, you can use the derived views or combine multiple base views using SQL.

https://community.denodo.com/videos/details/Cloud/Denodo%207.0/How%20to%20connect%20to%20Azure%20Data%20Lake%20Storage%20from%20Denodo%20Platform