How to troubleshoot Data Collection Rule that shows no transformation errors but nothing ends up in Custom Table

Question

I am trying to test using Azure Monitor to ingest logs from on premises applications using the Logs Ingestion API. I have followed the tutorial https://learn.microsoft.com/en-us/azure/azure-monitor/logs/tutorial-logs-ingestion-api to setup the required data collection endpoint and data collection rule to push the data into the created custom table. I can call the endpoint and receive a successful 204 response. I can also see the requests making it to the Data Collection Rule on the metrics view, but nothing ends up in the custom table. There are no transformation errors reported in the metrics on the data collection rule either. How can I troubleshoot this issue to see where the data is getting lost?

Answer 1

Hi,

The best way to troubleshoot this is:

• collect the data without transformation rule
• construct your transformation query from all the data
• add the transformation query to the rule

If you do not get the data even without any transformation you have some other problem with your setup. If you get the data without transformation query that means the previous transformation query was not correct and most likely is blocking any record to be ingested.

Please "Accept the answer" if the information helped you. This will help us and others in the community as well.