Azure data factory convert excel file copied from Sharepoint online to parquet

Question

Hi All,

I have a requirement to copy excel files from share point online to Azure data lake store(ADLS) Gen1 in parquet format, with the below link I was able to copy file over to ADLS. But I can't convert the file to parquet format as it doesn't show me the SheetName of the excel file while reading in ADF.

Can anybody suggest?

http://learn.microsoft.com/en-us/azure/data-factory/connector-sharepoint-online-list

Answer 1

Hi @Cooldbguy ,

You can now read excel files as a source, which means you can specify the sheet name while copying too. However, Excel format is supported for the following connectors: Amazon S3, Azure Blob, Azure Data Lake Storage Gen1, Azure Data Lake Storage Gen2, Azure File Storage, File System, FTP, Google Cloud Storage, HDFS, HTTP, and SFTP. Read more here : https://learn.microsoft.com/en-us/azure/data-factory/format-excel

Hence, you can convert the copied excel to parquet format by having another copy activity to copy data from the xls files in your ADLS Gen1, to a parquet dataset which can still be on the same ADLS Gen1.

Hope this helps.

Answer 2

Hi @Cooldbguy-8578,

You can parameterize the sheet name to dynamically pass it during your copy activity as shown below.