How get the StorageFileLogs from Azure Files into Azure Data Factory oder into an SQL Database

Question

Hi,

how to get StorageFileLogs into an Datbase or copy them with Azure Data Factory ?

I want to Save informations like TimeGenerated, AccountName and the Uri.

Greetings

Waleed

Answer 1

@Waleed Saleem Firstly, apologies for the delay in responding here and any inconvenience this issue may have caused.

Azure Files currently supports Storage Analytics metrics. Azure Storage logs in Azure Monitor is in public preview and is available for preview testing in all public cloud regions. This preview enables logs for blobs (including Azure Data Lake Storage Gen2), files, queues, tables, premium storage accounts in general-purpose v1 and general-purpose v2 storage accounts. Classic storage accounts are not supported. See here for files (property) that are supported

To learn more, see: https://learn.microsoft.com/en-us/azure/storage/common/monitor-storage?tabs=azure-powershell#logs-in-azure-monitor-preview

It would be good to evaluate this feature and let us know if it meets your needs.

If you’re interested in joining the preview, please complete the following form: https://forms.microsoft.com/Pages/ResponsePage.aspx?id=v4j5cvGGr0GRqy180BHbRxW65f1VQyNCuBHMIMBV8qlUM0E0MFdPRFpOVTRYVklDSE1WUTcyTVAwOC4u

• You can download the logs in the local machine and you can use the Azcopy tool to copy in different areas. To learn more about how to download specific files, see Download specific files.
• Copy activity in Azure Data Factory
• Copy data from or to Azure File Storage by using Azure Data Factory

You could reference these two links: 1. https://learn.microsoft.com/en-us/azure/data-factory/monitor-visually
2. https://learn.microsoft.com/en-us/azure/data-factory/monitor-programmatically

Additional information: StorageFileLogs
Query Azure Storage analytics logs in Azure Log Analytics

For now, you may refer to the Copy data from Blob Storage to SQL Database using Data Factory which gives some idea on your secnario.

Hope this helps!

Kindly let us know if the above helps or you need further assistance on this issue.

---------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Please don’t forget to "Accept the answer” and “up-vote” wherever the information provided helps you, this can be beneficial to other community members.