An Azure service that is used to collect, analyze, and act on telemetry data from Azure and on-premises environments.
Hello Prasad Boke, Thanks for confirming.
As you are using a Logic App to send data to the ThreatIntelIndicators table in Microsoft Sentinel, but the logs are delayed sometimes by hours or even a full day might be due to following reasons:
- Logic App Timing: If your Logic App uses a recurrence trigger, it may not run exactly on time. This causes delays in when data is fetched and sent.
- Ingestion vs. TimeGenerated: Sentinel uses
TimeGeneratedto filter logs. If your data arrives late, it might fall outside the time window used in your queries or rules making it look like it’s missing. - Pipeline Latency: Even if your Logic App runs fine, the data pipeline into Sentinel can have delays, especially if you're using custom connectors or transformations.
As a workaround you can try below steps:
- Use Sliding Window Trigger in Logic App
Switch from a recurrence trigger to a sliding window trigger. It’s more reliable and ensures consistent execution.
- Increase Look-Back Period in Sentinel Rules
If your analytics rule looks back 5 minutes, increase it to 10 or 15 minutes. This helps capture delayed logs.
- Use
ingestion_time()in Queries
Update your KQL queries to include ingestion time checks:
ThreatIntelIndicators
| where ingestion_time() - TimeGenerated > 2m
This helps you measure and adjust for delay.
- Monitor Ingestion Health
Use Sentinel’s built-in Health Monitoring Workbook to track ingestion latency and identify bottlenecks.
Below are the reference documents:
- https://learn.microsoft.com/en-us/azure/sentinel/work-with-threat-indicators
- Handle ingestion delay in Microsoft Sentinel
- https://learn.microsoft.com/en-us/azure/connectors/connectors-native-sliding-window
Thanks,
Suchitra.