Azure IoT Operations dataflows source details as "message broker" and azure event hub endpoint - message not received at event hub

Question

Azure IoT Operations dataflows source details as "message broker" and azure event hub endpoint - message not received at event hub

Shivkumar Pal 0

Azure IoT Operations dataflows source details as "message broker" and azure event hub endpoint - message not received at event hub.

In the data flows , I have selected default datapoint as source and event hub endpoint as dataflow endpoint. When I publish a message the request is received in the event hub but not the message.

I have checked dataflow endpoints, topic seems to be ok. all the endpoint and dataflow shows succeeded.

User's image

When I tested this with quick start oven asset its working fine.

Can someone help here please.

Dominic 1,631 Reputation points Microsoft Employee

2025-05-20T08:14:11.4333333+00:00

Can you provide any information about the structure of the message your asset is sending? What processing is happening on your data flow?
Shivkumar Pal 0 Reputation points

2025-05-20T08:40:36.8133333+00:00

I am testing with MQTT default as source and event hub as destination endpoint in the dataflow. The dataflow is created successfully . I am using mqtt explorer to publish message. A simple message {"temperature": 28.5, "unit": "C"} No asset in this case
Dominic 1,631 Reputation points Microsoft Employee

2025-05-20T08:44:37.67+00:00

Is the data flow modifying the message or simply forwarding it on to the Event Hubs endpoint?
Shivkumar Pal 0 Reputation points

2025-05-20T08:48:19.1766667+00:00

its simply forwarding it on the event hub endpoint
Shivkumar Pal 0 Reputation points

2025-05-20T08:52:34.99+00:00

Kindly ignore the duplicate in comments. its got pasted twice.
Dominic 1,631 Reputation points Microsoft Employee

2025-05-20T15:20:05.14+00:00

Do the logs from the data flow pod in your cluster show any errors?

Try this command:

kubectl logs aio-dataflow-default-0 -n azure-iot-operations

Shivkumar Pal 0

Thank you. There are errors but it seems it is recovering: Here is the part of the log where it shows error:

3>2025-05-20T07:33:02.773Z aio-dataflow-default-0 [dataflows@311 tid="7"] - librdkafka: Global error: AllBrokersDown (Local: All broker connections are down): 1/1 brokers are down
<4>2025-05-20T07:33:02.773Z aio-dataflow-default-0 [dataflows@311 tid="7"] - Ignored event 'Error' on base producer poll
<6>2025-05-20T07:33:04.472Z aio-dataflow-default-0 [dataflows@311 tid="8"] - Kafka target 'quickstart-oven-data-flow' - Average msg/min: 60
<6>2025-05-20T07:34:04.486Z aio-dataflow-default-0 [dataflows@311 tid="7"] - Kafka target 'quickstart-oven-data-flow' - Average msg/min: 60
<6>2025-05-20T07:35:04.503Z aio-dataflow-default-0 [dataflows@311 tid="9"] - Kafka target 'quickstart-oven-data-flow' - Average msg/min: 60
<6>2025-05-20T07:36:04.522Z aio-dataflow-default-0 [dataflows@311 tid="7"] - Kafka target 'quickstart-oven-data-flow' - Average msg/min: 60
<6>2025-05-20T07:37:04.522Z aio-dataflow-default-0 [dataflows@311 tid="7"] - Kafka target 'quickstart-oven-data-flow' - Average msg/min: 60
<3>2025-05-20T07:38:02.770Z aio-dataflow-default-0 [dataflows@311 tid="9"] - librdkafka: Global error: AllBrokersDown (Local: All broker connections are down): 1/1 brokers are down
<4>2025-05-20T07:38:02.771Z aio-dataflow-default-0 [dataflows@311 tid="9"] - Ignored event 'Error' on base producer poll
<6>2025-05-20T07:38:04.537Z aio-dataflow-default-0 [dataflows@311 tid="7"] - Kafka target 'quickstart-oven-data-flow' - Average msg/min: 60
<6>2025-05-20T07:39:04.556Z aio-dataflow-default-0 [dataflows@311 tid="10"] - Kafka target 'quickstart-oven-data-flow' - Average msg/min: 60
<6>2025-05-20T07:40:04.570Z aio-dataflow-default-0 [dataflows@311 tid="10"] - Kafka target 'quickstart-oven-data-flow' - Average msg/min: 60
<6>2025-05-20T07:41:04.578Z aio-dataflow-default-0 [dataflows@311 tid="10"] - Kafka target 'quickstart-oven-data-flow' - Average msg/min: 60
<6>2025-05-20T07:42:04.588Z aio-dataflow-default-0 [dataflows@311 tid="9"] - Kafka target 'quickstart-oven-data-flow' - Average msg/min: 60
<3>2025-05-20T07:43:03.766Z aio-dataflow-default-0 [dataflows@311 tid="7"] - librdkafka: Global error: AllBrokersDown (Local: All broker connections are down): 1/1 brokers are down
<4>2025-05-20T07:43:03.767Z aio-dataflow-default-0 [dataflows@311 tid="7"] - Ignored event 'Error' on base producer poll

Manas Mohanty 5,620 Reputation points Microsoft External Staff Moderator

2025-05-20T16:30:45.6033333+00:00

Hi Shivkumar Pal

Requesting to share the logs as mentioned by Dominic from above command in private chat for further debugging

Thank you.

1 answer

Your answer

Dominic 1,631 Reputation points Microsoft Employee

2025-05-20T08:14:11.4333333+00:00

Can you provide any information about the structure of the message your asset is sending? What processing is happening on your data flow?
Shivkumar Pal 0 Reputation points

2025-05-20T08:40:36.8133333+00:00

I am testing with MQTT default as source and event hub as destination endpoint in the dataflow. The dataflow is created successfully . I am using mqtt explorer to publish message. A simple message {"temperature": 28.5, "unit": "C"} No asset in this case
Dominic 1,631 Reputation points Microsoft Employee

2025-05-20T08:44:37.67+00:00

Is the data flow modifying the message or simply forwarding it on to the Event Hubs endpoint?
Shivkumar Pal 0 Reputation points

2025-05-20T08:48:19.1766667+00:00

its simply forwarding it on the event hub endpoint
Shivkumar Pal 0 Reputation points

2025-05-20T08:52:34.99+00:00

Kindly ignore the duplicate in comments. its got pasted twice.
Dominic 1,631 Reputation points Microsoft Employee

2025-05-20T15:20:05.14+00:00

Do the logs from the data flow pod in your cluster show any errors?

Try this command:

kubectl logs aio-dataflow-default-0 -n azure-iot-operations
Manas Mohanty 5,620 Reputation points Microsoft External Staff Moderator

2025-05-20T16:30:45.6033333+00:00

Hi Shivkumar Pal

Requesting to share the logs as mentioned by Dominic from above command in private chat for further debugging

Thank you.

Answer 1

Your log file shows these messages appearing in a regular basis:

librdkafka: Global error: AllBrokersDown (Local: All broker connections are down): 1/1 brokers are down
Ignored event 'Error' on base producer poll

Currently, these messages appear in the log file if the data flow hasn't received any data from its input for four or five minutes. This does result in a request to the Event Hubs endpoint to keep the connection alive.

Can you double check that when you're using MQTT Explorer to manually publish a message that you're publishing to the correct topic and that the data source in your data flow is configured to subscribe to this topic?

Share via

Azure IoT Operations dataflows source details as "message broker" and azure event hub endpoint - message not received at event hub

1 answer

Your answer