Accessing blob storage $logs through ADF

Question

Hi,

first I'll explain what I need to accomplish. We have a container where users can insert and update data files (CSVs) that then are read into a database using ADF and event triggers. We need add the information about who updated the file into the database.

My idea was to activate logging on our Storage Datalake v2 and use the logs to find the AD-user who updated or inserted the file. The actual logs seem to include the information I need but ADF does not see the "$logs" container in the datalake.

I found this previous and quite old question: https://social.msdn.microsoft.com/Forums/en-US/e59a9b0e-cf6b-4155-b1ba-3165ee831478/logs-container-not-accessible-in-adf?forum=AzureDataFactory where someone from Microsoft says that $logs should be accessible, however it does not appear or work for me.

Has anyone else had success with either accessing $logs through ADF or adding information about the user updating files in a storage account to a database?

Answer 1

Hello @VehmaanperaEdwin-1860,

Welcome to the Microsoft Q&A platform.

Unfortunately, you cannot access Azure Storage analytics logs folder $logs through Azure Data Factory.

You can access the Azure Storage analytics logs folder $logs using Azure Storage Explorer.

Reference: Azure Storage analytics logging

I would suggest you to provide feedback on the same:

https://feedback.azure.com/forums/270578-data-factory

https://feedback.azure.com/forums/217298-storage?query=%24logs

All of the feedback you share in these forums will be monitored and reviewed by the Microsoft engineering teams responsible for building Azure.

Hope this helps. Do let us know if you any further queries.

------------

• Please accept an answer if correct. Original posters help the community find answers faster by identifying the correct answer. Here is how.
• Want a reminder to come back and check responses? Here is how to subscribe to a notification.