Extract Salesforce live data ingestion in Azure SQL database
I have successfully copied data from Salesforce to my Azure SQL Database using Azure Data Factory pipelines, and I want to ensure that my pipeline automatically retrieves updated or new entries from Salesforce into my database. I am considering using…
How can I scale my mobile application using Azure Event Hub to support more than 5 concurrent connections per consumer group for real-time sensor data processing?
I have a mobile application that reads sensor data, and we need it to support multiple users simultaneously. Currently, we use Azure Event Hub to handle the data, with consumer groups connecting to it. However, one consumer group only allows 5…
Azure Activity Logs for Management Group and Subscription creation/deletion do not match the expected schema
I have a diagnostic setting set up for my root management group: { "id": "providers/Microsoft.Management/managementGroups/MY-ROOT-MANAGEMENT-GROUP-ID/providers/microsoft.insights/diagnosticSettings/ManagementSetting", …
Process streaming data with Synapse Pipeline or Data Flow
Hi Team, May I know if I can use Synapse pipeline or Data Flow to connect Eventhub and process Streaming data? Pipeline: Data Flow: I try to use this visual programming to create a process to read streaming data from eventhub and join cosmos db etc.…
Does IoThub pushes the historic data to event hub when we create a new message routing?
I want to understand whether Event Hub gets the Historic data from IoT Hub at the instance of creation of event hub endpoint?
Deprecation ETA on SAS Authentication for Azure Event Hub
Hi, I have come across these 2 pages encouraging the move to Microsoft Entra ID for authentication to Azure Event Hub, deprecating SAS: Receive change notifications through Azure Event Hubs Authenticate access to Event Hubs resources using shared…
How verifying the time about an incoming event and outcoming event
Hi, I've an Azure Event Hubs instance. I need to verify how long an event takes to income in the Hub and to outcome out the Hub. Which measure do I need to verify and how? Thanks
Streaming analytics job can't connect to Azure Event Hub input when using user assigned managed identity.
I am trying to use an Azure event hub as an input for a streaming analytics (SA) job. I want to use a user-assigned managed identity for the SA job. I followed the directions in this documentation:…
Optimal data format for events to manage with Azure Event Hubs
Hi, in order to manage events in Azure Event Hubs with optimal performances, which is the best data format to adopt for them? The events must enter and exit in the same format. Is it necessary to define a related schema in the Schema Registry? Any helps…
How to verify even hub is immutable
I need to provide proof to the Auditor that the azure event hub is immutable and append only. He needs proof based on config setting or code, not based on event hub doc. How can we provide the same?
Is there a way to check active connections and the auth type on Standard tier Event hubs?
Looks like runtime audit logs are available only in premium and dedicated tiers. Is there a way to check the event hub active connections and the auth type on Standard tier?
Adding a schema to Eventhub Schema registry with a private endpoint enabled
Greetings, As the title suggests I am trying to register a schema in an Eventhub Schema Registry which is in a vnet with a private endpoint enabled. I see that there is a warning sign inside the schema group saying: "This namespace has private…
integrate dynamics crm to Azure event Hub
Hi, I would like to connect our Dynamics CRM to an Azure event hub, that create an event each time we create a changes in dynamic. Can somone help me
Function with Event Hub Trigger doen't follow maxWaitTime in host.json
Hello, I am trying to trigger an Azure function after every 10 minutes using the Event Hub. The host.json has max batch size of 100, so if either of the above is satisfied , the function should fire. But the custom metrics (in App Insights table) which…
Connect to eventhub using Managed service identity (MSI) from Azure synapse analytics using pyspark spark streaming
I am trying to write data to Azure Event Hubs from an Azure Synapse Analytics notebook in PySpark using Managed Service Identity (MSI). Could you please provide step-by-step guidance on how to achieve this, along with the necessary code? Please note, I…
Event Hub: seeing requests but no messages
Hello, We have an Event Hub namespace set up but we can see successful/incoming requests without any messages or throughput. Why is this happening? Thanks. Regards.
Get the number of messages in each partition of topic event hub
I have a topic in Azure event hub. i want to see how the data is distributed accross partitions. I tried to get count of messages in partition by using AzureDiagnostics but its not working. Can you sugget how can i get it? I am using ActivaityName_s =…
Azure Function App EventHub Trigger - wrong event received/wrong function called
I have two different functions in a function app: accept_event: def insert_into_production(event_body: dict): dmpid = event_body.get('deviceModuleProductId') msgid = event_body.get('id') logging.info('Try to accept an…
How to set EventHubOptions in Isolated Azure Function
I had in-process azure function with event hub trigger. I was configuring EventHubOptions programmatically as below: builder.Services.PostConfigure<EventHubOptions>(o => { o.MaxEventBatchSize =…
Generate data preview
Why is the 'Generate Data Preview' option missing from my newly created Azure Event Hub instance?