Python-Azure function issue for Kafka trigger

Question

Python-Azure function issue for Kafka trigger

CK 11

I am facing below error while executing python azure function from VSCODE. I have checked bindings and all extension, looks good. Could you please let me know what may cause this issue? Any help would be appriciated.

KafkaMessageReceiver: kafkaTrigger

For detailed output, run func with --verbose flag.
[2022-10-13T10:35:27.277Z] Host lock lease acquired by instance ID '0000000000000000000000009936F7DD'.
[2022-10-13T10:35:27.826Z] Worker process started and initialized.
[2022-10-13T10:36:04.297Z] Executing 'Functions.KafkaMessageReceiver' (Reason='(null)', Id=40b8568c-8bca-46df-8c93-2f7012b0accd)
[2022-10-13T10:36:04.957Z] Executed 'Functions.KafkaMessageReceiver' (Failed, Id=40b8568c-8bca-46df-8c93-2f7012b0accd, Duration=838ms)
[2022-10-13T10:36:04.958Z] System.Private.CoreLib: Exception while executing function: Functions.KafkaMessageReceiver. System.Private.CoreLib: Result: Failure
Exception: AttributeError: 'str' object has no attribute 'type'
Stack: File "C:\Program Files\Microsoft\Azure Functions Core Tools\workers\python\3.9/WINDOWS/X64\azure_functions_worker\dispatcher.py", line 388, in _handle__invocation_request
args[pb.name] = bindings.from_incoming_proto(
File "C:\Program Files\Microsoft\Azure Functions Core Tools\workers\python\3.9/WINDOWS/X64\azure_functions_worker\bindings\meta.py", line 88, in from_incoming_proto
return binding.decode(datum, trigger_metadata=metadata)
File "C:\Program Files\Microsoft\Azure Functions Core Tools\workers\python\3.9/WINDOWS/X64\azure\functions\kafka.py", line 176, in
decode
return cls.decode_multiple_events(data, trigger_metadata)
File "C:\Program Files\Microsoft\Azure Functions Core Tools\workers\python\3.9/WINDOWS/X64\azure\functions\kafka.py", line 265, in
decode_multiple_events
key=cls._decode_typed_data(
File "C:\Program Files\Microsoft\Azure Functions Core Tools\workers\python\3.9/WINDOWS/X64\azure\functions\meta.py", line 126, in _decode_typed_data
data_type = data.type
.

CK 11 Reputation points

2022-10-14T05:55:19.897+00:00

Any leads to the cause of this issue would be appriciated.
MuthuKumaranMurugaachari-MSFT 22,441 Reputation points Moderator

2022-10-14T15:47:09.923+00:00

@CK Thank you for reaching out to Microsoft Q&A. Sorry to hear that you are facing this issue. Based on your statement, you already reviewed the bindings and extensions in your app, and I hope you are using the latest Core Tools version.

I found an open issue in #388 in azure-functions-kafka-extension where few other users are also reporting the same problem. Can you please share the details such as Core Tools version, Runtime version and code snippet? This would help in investigating the issue and also, if possible, share it in the repo so that experts from the repo can also look at it.
CK 11 Reputation points

2022-10-14T17:11:43.833+00:00
@MuthuKumaranMurugaachari-MSFT : I am using below versions of core tools and function

Core Tools Version: 4.0.4590 (64-bit)
Function Runtime Version: 4.5.2.18383

This is my Function.Json
{
"scriptFile": "init.py",
"bindings": [
{
"type": "kafkaTrigger",
"direction": "in",
"name": "kevents",
"topic": "Mytopic",
"brokerList": "Mykafka.cishoc.com:1234",
"username": "Myuser",
"password": "passvalue",
"consumerGroup": "myconsumergrp",
"protocol": "SaslSsl",
"authenticationMode": "Plain",
"cardinality": "MANY",
"dataType": "string"
}

],
"disabled": false
}

-------This is init.py code snippet---

import logging
import typing
from azure.functions import KafkaEvent
import json

def main(kevents: typing.List[KafkaEvent]):
for event in kevents:

event_dec = event.get_body().decode('utf-8') event_json = json.loads(event_dec) logging.info("Python Kafka trigger function called for message " + event_json["Value"])
MuthuKumaranMurugaachari-MSFT 22,441 Reputation points Moderator

2022-10-18T18:18:57.07+00:00

@CK Thank you for sharing the details. I tried to repro this issue but unfortunately couldn't do at my end. I had an internal discussion with SDK team with the details you shared, and they are investigating it now. Please post the details in #388 and we can follow up with them on the progress.

Thanks.
CK 11 Reputation points

2022-10-19T06:03:32.753+00:00

Thank you @MuthuKumaranMurugaachari-MSFT . Yes, I am following up issue #388.

1 answer

Your answer

CK 11 Reputation points

2022-10-14T05:55:19.897+00:00

Any leads to the cause of this issue would be appriciated.
MuthuKumaranMurugaachari-MSFT 22,441 Reputation points Moderator

2022-10-14T15:47:09.923+00:00

@CK Thank you for reaching out to Microsoft Q&A. Sorry to hear that you are facing this issue. Based on your statement, you already reviewed the bindings and extensions in your app, and I hope you are using the latest Core Tools version.

I found an open issue in #388 in azure-functions-kafka-extension where few other users are also reporting the same problem. Can you please share the details such as Core Tools version, Runtime version and code snippet? This would help in investigating the issue and also, if possible, share it in the repo so that experts from the repo can also look at it.
CK 11 Reputation points

2022-10-14T17:11:43.833+00:00

@MuthuKumaranMurugaachari-MSFT : I am using below versions of core tools and function

Core Tools Version: 4.0.4590 (64-bit)
Function Runtime Version: 4.5.2.18383

This is my Function.Json
{
"scriptFile": "init.py",
"bindings": [
{
"type": "kafkaTrigger",
"direction": "in",
"name": "kevents",
"topic": "Mytopic",
"brokerList": "Mykafka.cishoc.com:1234",
"username": "Myuser",
"password": "passvalue",
"consumerGroup": "myconsumergrp",
"protocol": "SaslSsl",
"authenticationMode": "Plain",
"cardinality": "MANY",
"dataType": "string"
}

],
"disabled": false
}

-------This is init.py code snippet---

import logging
import typing
from azure.functions import KafkaEvent
import json

def main(kevents: typing.List[KafkaEvent]):
for event in kevents:

event_dec = event.get_body().decode('utf-8') event_json = json.loads(event_dec) logging.info("Python Kafka trigger function called for message " + event_json["Value"])
MuthuKumaranMurugaachari-MSFT 22,441 Reputation points Moderator

2022-10-18T18:18:57.07+00:00

@CK Thank you for sharing the details. I tried to repro this issue but unfortunately couldn't do at my end. I had an internal discussion with SDK team with the details you shared, and they are investigating it now. Please post the details in #388 and we can follow up with them on the progress.

Thanks.
CK 11 Reputation points

2022-10-19T06:03:32.753+00:00

Thank you @MuthuKumaranMurugaachari-MSFT . Yes, I am following up issue #388.

Answer 1

@CK Thank you for sharing the information and reaching out to Microsoft Q&A. This really helped in engaging our SDK team and after the investigation, they found the cause.

For Community:
This is due to a bug #388 in azure-functions-kafka-extension and PR with fix has been created here. Our product team is working on the roll out of the fix and please follow #388 for the same. The workaround for now is to use Kafka function with single mode rather than batch mode.

Sorry for the inconvenience caused by the issue. Feel free to add a comment if any further questions.

Share via

Python-Azure function issue for Kafka trigger

1 answer

Your answer