Azure Stream Analytics: File name prefix
While using ADLS Gen 1 as output for a Stream Analytics job, if the file path pattern doesn't contain a trailing slash (/), the last pattern in the file path is treated as a file name prefix. For example, if the path pattern is 'dir/{date}/{time}' the…
Azure Stream Analytics Module on Azure Percept Edge Device
Trying to Deploy stream analytics module to Azure Percept device. Following this tutorial here: https://learn.microsoft.com/en-us/azure/iot-edge/tutorial-deploy-stream-analytics?view=iotedge-2020-11 Steps to Duplicate : Created blob…
How to create powerBi dashboard for multiple devices automatically?
Hi All, I need help in creating multiple device dashboard using powerbi. Let's say i provision a device on azure IOTHub, and after successful registration. Registered device must be populated in power bi dashboard.
Problem exposing GetMetadataPropertyValue in a streaming job with powerbi or blob storage outputs
Hi, I have a python script that sends device telemetry to iothub. I add a custom User/Application property called cpuAlert ****from azure.iot.device import IoTHubDeviceClient, Message, MethodResponse message.content_encoding='utf-8' …
I am unable to send the data to SQL database through IoT hub using Stream analytics
When i start the process in stream analytics and then try to write a query in SQL, then it shows the process is degraded and shows a notification failed to initialize output adapter output stream.
How to add private endpoint in Stream Analytics cluster for Synapse workspace?
I want to add a private endpoint in Stream analytics cluster for Synapse sql database. My Synapse workspace is configured with in a Vnet. In private endpoint creation popup, Synapse resource is not available to select from resource list.
Keep getting `No subscription for receiving messages found for dthakkar-rpi-edge-device/EdgeTelementryASAAverage`
After deploying the azure stream analytics job on my edge device (Rasberry Pi 3), iotHub container logs keep showing No subscription for receiving messages found for dthakkar-rpi-edge-device/EdgeTelementryASAAverage, and the stream analytics job is not…
Azure Stream Analytics needs a better choice for the key column in an auto-created table
Azure Stream Analytics needs a better choice for the key column in an auto-created table I have the following tech stack: SQL Server on-prem running 2019 Change Data Capture (CDC) is enabled on one table for all columns Debezium is connecting…
IoT Hub to other services - Pricing
Hello, I'm studying an Azure solution with IoT Hub, which will ingest data from devices (only D2C, say through MQTT). The aim is to pass these data to an Azure Function, execute some computation, and save them in some DB (e.g.CosmosDB), or…
'InputDeserializerError.InvalidData' | Invalid Avro Format, drop invalid record
I am sending AVRO messages using Java Kafka API to event hub, and using stream analytics to route the data to BLOB Storage. Although after successfully producing the avro message to eventhub, under ASA logs, I can see Diagnostic error. …
Stream Analytics Job Failed - unable to find assembly
I have configured the job and tested the whole things, where the input is working, query is collecting data, and output connection is working correctly. but when it comes to starting the job an error occur with the following warning. I'm trying to…
How to perform stream analytics to simple export data from blob storage to table storage in regular intervals?
Hi, I am creating a stream analytics job in azure where data is exported and saved into table storage in azure. While I am able to do the data export when the stream analytic job starts, data export does not happen when job is still running since…
Need help starting with Kafka server
I'm getting the following error when setting up confluent. That's why looking for alternative options for Kafka. {"code":"DeploymentFailed","message":"At least one resource deployment operation failed. Please list…
How to configure log analytics perf table as an input source to stream analytics job?
My requirement is to take data from log analytics perf table to stream analytic job as an input, in near real-time. I want, for example last 2 mins data, from the perf table, not the entire perf table. What is the best way to do this? Note: I already…
Select DISTINCT column values from Input
Hi, I have multiple entries in table in a single sec, and I want to fetch the single value only, or we say distinct , is there any way we can do that, because DISTINCT is not allowed in stream analytics query
Streamanalytics 'InputDeserializerError.InvalidData' error
Hello, I am trying to store my telemetry data to SQL database through stream analytics, I am getting a below mentioned error while trying to run a streaming job. "Source 'edgeinputstream' had 1 occurrences of kind…
Event Hub Azure Stream Analytics size of record
I have some messages in Event Hub, and I want to determine the size of the message in bytes Thought I can do it in Azure Stream Analytics query SELECT t.metadata, t.payload, datalength(???? ) As SizeInBytes INTO [OutputAlias] …
IoTHubQuota Exceeded
Im a developer with many years experience, but a newbie to azure and to python I am working on an IoT project where I have a number of Raspberry Pi units sending telemetry data to Azure. To facilitate this I have set up the following in the cloud 1…
How to handle data coming on IOT Hub which has multiple JSON formats?
Hello, I am working on a use case wherein I am sending data from az3166 iot device to IOT hub. Further I am running a stream analytics query to store data onto blob storage. The json for the same is …
Stream Analytics on Edge with OPC UA Publisher
Hi @Sander van de Velde , followed your blog post for Getting Started with OPC UA Publisher . It made my life a lot more simpler. So Thank you for that. Now that I have my OPC Publisher module running on Edge, I would like to filter some data…