580 questions with Azure Event Hubs tags

Sort by: Updated
1 answer

About Disaster Recovery on Event Hubs + Functions

Hi, I'm facing an architectural challenge. I have: A Blob Storage where files will be landing A Function environment where one functions gets executed every time a file is uploaded. This is done via Event Grid notification source on Blob trigger An…

Azure Functions
Azure Functions
An Azure service that provides an event-driven serverless compute platform.
4,477 questions
Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
580 questions
asked 2024-06-06T17:32:30.5533333+00:00
Jona 455 Reputation points
answered 2024-06-14T08:18:13.51+00:00
Pieter de Bruin 81 Reputation points Microsoft Employee
0 answers

How to add a new field with a different record type using Avro in the schema registry?

Hi all, Can another record be used as the type field in the Avro schema? Example: Existed schema: { "type": "record", "name": "Foo", "namespace": "com.example", …

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
580 questions
asked 2024-06-14T07:00:32.0033333+00:00
Mariia Kharkhuta 0 Reputation points
0 answers

Receive change notifications through Azure Event Hubs

Hi All, I have a little inquiry regarding ‘Receive change notifications through Azure Event Hubs’. As you know, we load Azure Databricks Diagnostic logs (plus a few system tables via Azure EventGrid) into Azure EventHub, which we then consume into ADX…

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
580 questions
asked 2024-06-07T10:54:54.84+00:00
Suleman 0 Reputation points
commented 2024-06-14T06:39:15.0933333+00:00
PRADEEPCHEEKATLA-MSFT 82,191 Reputation points Microsoft Employee
1 answer

Databricks not sending audit logs to event hub

Hi, I'm trying to push all the logs from databricks using the diagnostic tool to event hub but is not working, it didn't push anything. I'm using the root access policy and also already created the eventhub name, what else I'm probably missing? Thanks in…

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
580 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,015 questions
asked 2024-06-13T19:41:27.85+00:00
Danny AMAYA 0 Reputation points
answered 2024-06-13T23:26:42.6066667+00:00
hossein jalilian 4,540 Reputation points
2 answers

Ingestion of Security Events

Good afternoon, Was not sure if anyone else has seen this before. We have a few clients that are getting abnormal ingestion of security events coming from the DC. Event ID 4661 in this case. We don't want to disable the event as it is important but we do…

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
580 questions
Windows Server Security
Windows Server Security
Windows Server: A family of Microsoft server operating systems that support enterprise-level management, data storage, applications, and communications.Security: The precautions taken to guard against crime, attack, sabotage, espionage, or another threat.
1,762 questions
asked 2024-06-10T20:35:10.7766667+00:00
Eugene Golovanyuk 0 Reputation points
answered 2024-06-10T23:14:14.46+00:00
Vlad Costa 615 Reputation points
2 answers

Azure function event hub trigger executes after delay of about 5-10 seconds

I have an Azure Function v4 .NET 6 isolated app with an HTTP trigger function that writes events to an event hub. Another event hub triggered function in the same app listens to those events, performs some manipulation, and publishes them again to…

Azure Functions
Azure Functions
An Azure service that provides an event-driven serverless compute platform.
4,477 questions
Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
580 questions
asked 2024-05-30T13:42:14.9533333+00:00
Akshay Chauhan 46 Reputation points
answered 2024-06-10T10:10:44.3366667+00:00
Akshay Chauhan 46 Reputation points
2 answers One of the answers was accepted by the question author.

About Event Hubs partitions

Hi, I'm facing a challenge and a colleague of mine suggested to me to use partitions on Event Hubs. So, I've reading a lot and have some questions: ¿How are partitions related to Event Hub capacity? Let's suppose an Standard Tier with 5 TU ... ¿How is…

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
580 questions
asked 2024-05-28T00:13:01.1533333+00:00
Jona 455 Reputation points
accepted 2024-06-07T05:07:23.28+00:00
Jona 455 Reputation points
2 answers

How are PUs assigned/distributed in azure event hub premium tier ?

Hi We have 15+ eventhub in a namespace, each namespace has varying partitions, the problem we are having are seeing is we are able to pull only 1TB per an hour, which the limits as per eventhub as higher than these. We are consuming using logstash…

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
580 questions
asked 2024-04-05T22:04:29.98+00:00
ARAVETI, MAHESH 0 Reputation points
commented 2024-06-07T04:28:03.09+00:00
PRADEEPCHEEKATLA-MSFT 82,191 Reputation points Microsoft Employee
0 answers

Enhancing Event Processing Efficiency

Hello, I have documents that I read and use to create events of different types. The system_id serves as a unique identifier for each event and will be passed as a parameter for the vertex. I send these events to Event Grid with an endpoint at Azure…

Azure Functions
Azure Functions
An Azure service that provides an event-driven serverless compute platform.
4,477 questions
Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
580 questions
Azure Event Grid
Azure Event Grid
An Azure event routing service designed for high availability, consistent performance, and dynamic scale.
333 questions
asked 2024-06-06T14:56:20.08+00:00
Maryna Paluyanava 211 Reputation points
0 answers

We are not getting data in azure data lake Service v2 storage's container.

Hello, We are getting data in the Azure event hub sink through the POSTGRES SQL database but we are not getting files in the container which we have configured in an ADLS GEN 2 and while configuring we have an encounter that we are using a free…

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
580 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,549 questions
asked 2024-05-30T07:02:45.27+00:00
DNT 0 Reputation points
commented 2024-06-06T07:08:00.7066667+00:00
PRADEEPCHEEKATLA-MSFT 82,191 Reputation points Microsoft Employee
1 answer

Event Hub namespace not resolving with private endpoint's private IP

Hi folks, We've got some Event Hub name spaces and we have created private endpoints for them. We have kept the DNS configurations in a centralized Private DNS zone. But the namespaces don't resolve with the private IP rather they do with the public IP…

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
580 questions
asked 2024-05-23T17:54:30.05+00:00
Apurva Pathak 320 Reputation points
commented 2024-06-06T02:24:54.3433333+00:00
AnnuKumari-MSFT 31,731 Reputation points Microsoft Employee
2 answers

Best practice to manage device logs with IoT Hub

Hello, I was wondering if there are any best practices for managing logs generated by IoT devices. Currently, our devices generate logs in text files, and we thought the easiest way to manage these logs is to upload the text files to a storage account…

Azure IoT Hub
Azure IoT Hub
An Azure service that enables bidirectional communication between internet of things (IoT) devices and applications.
1,143 questions
Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
580 questions
asked 2024-06-05T08:24:05.4066667+00:00
Mariachiara Cesario 0 Reputation points
answered 2024-06-05T13:03:31.5766667+00:00
Sander van de Velde 30,396 Reputation points MVP
0 answers

Failed to connect to Azure event hub(AEH) from Java using kafka client

It gets disconnected with following error when trying to connect to Azure event hub(AEH) from Java using kafka client. 2024-05-21 16:03:23.991 DEBUG 44 --- [ntainer#2-0-C-1] o.a.k.common.network.SslTransportLayer   : [SslTransportLayer channelId=-1…

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
580 questions
asked 2024-05-21T20:05:23.9033333+00:00
Kalikiri, Karthik 0 Reputation points
commented 2024-06-03T07:00:20.3033333+00:00
PRADEEPCHEEKATLA-MSFT 82,191 Reputation points Microsoft Employee
1 answer One of the answers was accepted by the question author.

Creating an EventHub with capture configuration using Bicep script fails saying the user does not have the required data plane write permissions

I'm running a bicep script to create a couple of resources in my resource group. When it comes to event hub, I would like to use the capture functionality to store events inside a storage account gen 2. The bicep script is running from DevOps pipeline…

Azure Storage Accounts
Azure Storage Accounts
Globally unique resources that provide access to data management services and serve as the parent namespace for the services.
2,815 questions
Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
580 questions
asked 2024-05-29T06:04:22.3266667+00:00
Stoian, Claudiu 20 Reputation points
edited a comment 2024-05-30T08:08:32.8+00:00
PRADEEPCHEEKATLA-MSFT 82,191 Reputation points Microsoft Employee
0 answers

How to retrieve all Schema Versions from a given Schema Group, Schema in EventHub.

Hi, I am trying to access Schema Registry of a Event Hub Namespace. I want to be able to read all the versions of a SchemaDefinitions inside a known SchemaGroup and SchemaName. I know that there are SchemaRegistryClients(Azure class) provided in Azure…

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
580 questions
asked 2024-05-20T16:46:19.9633333+00:00
Kasam, Sai 0 Reputation points
commented 2024-05-29T08:03:50.8066667+00:00
PRADEEPCHEEKATLA-MSFT 82,191 Reputation points Microsoft Employee
1 answer One of the answers was accepted by the question author.

Partition Key in Azure Event Hub and Stream Analytics

Hello, I am reading about Azure Event Hub with the ability to use a partition key to map incoming event data into specific partitions: https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-scalability#mapping-of-events-to-partitions I am…

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
580 questions
Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
339 questions
asked 2024-05-27T00:18:24.99+00:00
Karl Gardner 85 Reputation points
accepted 2024-05-28T14:05:12.8533333+00:00
Karl Gardner 85 Reputation points
2 answers One of the answers was accepted by the question author.

About Event Hub REST API discordancy respect to Docs

Hi I'm using Event Hub REST API to send data to a stream. This happens in a Functions with BlobStorage trigger.I feel a little confused with some terminology which I've not found the proper documentation to finally fully understand. I built this…

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
580 questions
asked 2024-05-07T00:29:30.93+00:00
Jona 455 Reputation points
accepted 2024-05-27T23:10:34.77+00:00
Jona 455 Reputation points
1 answer

How to fix - "Error occurred in partition processor for partition : Did not observe any item or terminal signal within 60000ms in 'filter' (and no fallback has been configured)"

Hi, We are using azure-messaging-eventhubs java sdk version 5.7.0 and azure-messaging-eventhubs-checkpointstore-blob to retrieve the data from azure event hub during this while accessing event data we are receiving following error - Error occurred in…

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
580 questions
asked 2024-05-12T02:23:50.2933333+00:00
Namrata Dhamdhere 0 Reputation points
commented 2024-05-23T16:53:18.1066667+00:00
ShaikMaheer-MSFT 38,301 Reputation points Microsoft Employee
1 answer One of the answers was accepted by the question author.

How to fix "Microsoft.Azure.Storage.Common: Operation could not be completed within the specified time."?

Hi, I have been facing this issue, in my function app. These function app has two triggers: Event Grid Trigger Event Hub Trigger The first one works fine but the second one (Event Hub Trigger) is facing some issues. The 2nd function is not…

Azure Functions
Azure Functions
An Azure service that provides an event-driven serverless compute platform.
4,477 questions
Azure Storage Accounts
Azure Storage Accounts
Globally unique resources that provide access to data management services and serve as the parent namespace for the services.
2,815 questions
Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
580 questions
asked 2024-05-20T11:44:35.4333333+00:00
Pandit, Upendra 30 Reputation points
commented 2024-05-21T12:46:30.58+00:00
Pandit, Upendra 30 Reputation points
1 answer One of the answers was accepted by the question author.

Azure EventHubs Processor recommendation

I have Azure Event Hubs and on my local machine, I'm using NuGet Azure.Messaging.EventHubs.Processor for processing events. Is it possible to use Azure.Messaging.EventHubs.Processor in production or is it recommended to use Azure Functions and Event Hub…

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
580 questions
asked 2024-05-14T12:35:31.83+00:00
Macháček Martin 201 Reputation points
accepted 2024-05-16T12:16:27.39+00:00
Macháček Martin 201 Reputation points