About Disaster Recovery on Event Hubs + Functions
Hi, I'm facing an architectural challenge. I have: A Blob Storage where files will be landing A Function environment where one functions gets executed every time a file is uploaded. This is done via Event Grid notification source on Blob trigger An…
How to add a new field with a different record type using Avro in the schema registry?
Hi all, Can another record be used as the type field in the Avro schema? Example: Existed schema: { "type": "record", "name": "Foo", "namespace": "com.example", …
Receive change notifications through Azure Event Hubs
Hi All, I have a little inquiry regarding ‘Receive change notifications through Azure Event Hubs’. As you know, we load Azure Databricks Diagnostic logs (plus a few system tables via Azure EventGrid) into Azure EventHub, which we then consume into ADX…
Databricks not sending audit logs to event hub
Hi, I'm trying to push all the logs from databricks using the diagnostic tool to event hub but is not working, it didn't push anything. I'm using the root access policy and also already created the eventhub name, what else I'm probably missing? Thanks in…
Ingestion of Security Events
Good afternoon, Was not sure if anyone else has seen this before. We have a few clients that are getting abnormal ingestion of security events coming from the DC. Event ID 4661 in this case. We don't want to disable the event as it is important but we do…
Azure function event hub trigger executes after delay of about 5-10 seconds
I have an Azure Function v4 .NET 6 isolated app with an HTTP trigger function that writes events to an event hub. Another event hub triggered function in the same app listens to those events, performs some manipulation, and publishes them again to…
About Event Hubs partitions
Hi, I'm facing a challenge and a colleague of mine suggested to me to use partitions on Event Hubs. So, I've reading a lot and have some questions: ¿How are partitions related to Event Hub capacity? Let's suppose an Standard Tier with 5 TU ... ¿How is…
How are PUs assigned/distributed in azure event hub premium tier ?
Hi We have 15+ eventhub in a namespace, each namespace has varying partitions, the problem we are having are seeing is we are able to pull only 1TB per an hour, which the limits as per eventhub as higher than these. We are consuming using logstash…
Enhancing Event Processing Efficiency
Hello, I have documents that I read and use to create events of different types. The system_id serves as a unique identifier for each event and will be passed as a parameter for the vertex. I send these events to Event Grid with an endpoint at Azure…
We are not getting data in azure data lake Service v2 storage's container.
Hello, We are getting data in the Azure event hub sink through the POSTGRES SQL database but we are not getting files in the container which we have configured in an ADLS GEN 2 and while configuring we have an encounter that we are using a free…
Event Hub namespace not resolving with private endpoint's private IP
Hi folks, We've got some Event Hub name spaces and we have created private endpoints for them. We have kept the DNS configurations in a centralized Private DNS zone. But the namespaces don't resolve with the private IP rather they do with the public IP…
Best practice to manage device logs with IoT Hub
Hello, I was wondering if there are any best practices for managing logs generated by IoT devices. Currently, our devices generate logs in text files, and we thought the easiest way to manage these logs is to upload the text files to a storage account…
Failed to connect to Azure event hub(AEH) from Java using kafka client
It gets disconnected with following error when trying to connect to Azure event hub(AEH) from Java using kafka client. 2024-05-21 16:03:23.991 DEBUG 44 --- [ntainer#2-0-C-1] o.a.k.common.network.SslTransportLayer : [SslTransportLayer channelId=-1…
Creating an EventHub with capture configuration using Bicep script fails saying the user does not have the required data plane write permissions
I'm running a bicep script to create a couple of resources in my resource group. When it comes to event hub, I would like to use the capture functionality to store events inside a storage account gen 2. The bicep script is running from DevOps pipeline…
How to retrieve all Schema Versions from a given Schema Group, Schema in EventHub.
Hi, I am trying to access Schema Registry of a Event Hub Namespace. I want to be able to read all the versions of a SchemaDefinitions inside a known SchemaGroup and SchemaName. I know that there are SchemaRegistryClients(Azure class) provided in Azure…
Partition Key in Azure Event Hub and Stream Analytics
Hello, I am reading about Azure Event Hub with the ability to use a partition key to map incoming event data into specific partitions: https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-scalability#mapping-of-events-to-partitions I am…
About Event Hub REST API discordancy respect to Docs
Hi I'm using Event Hub REST API to send data to a stream. This happens in a Functions with BlobStorage trigger.I feel a little confused with some terminology which I've not found the proper documentation to finally fully understand. I built this…
How to fix - "Error occurred in partition processor for partition : Did not observe any item or terminal signal within 60000ms in 'filter' (and no fallback has been configured)"
Hi, We are using azure-messaging-eventhubs java sdk version 5.7.0 and azure-messaging-eventhubs-checkpointstore-blob to retrieve the data from azure event hub during this while accessing event data we are receiving following error - Error occurred in…
How to fix "Microsoft.Azure.Storage.Common: Operation could not be completed within the specified time."?
Hi, I have been facing this issue, in my function app. These function app has two triggers: Event Grid Trigger Event Hub Trigger The first one works fine but the second one (Event Hub Trigger) is facing some issues. The 2nd function is not…
Azure EventHubs Processor recommendation
I have Azure Event Hubs and on my local machine, I'm using NuGet Azure.Messaging.EventHubs.Processor for processing events. Is it possible to use Azure.Messaging.EventHubs.Processor in production or is it recommended to use Azure Functions and Event Hub…