330 questions with Azure Stream Analytics tags

Sort by: Updated
2 answers One of the answers was accepted by the question author.

How to ingest CDC data from SQL DATA SYNC to Event hub?

Hi we have a scenario to implement real-time CDC from SQL DATA SYNC to Azure SQL DB. Which tools are good for near real-time processes and prices as well. By using data bricks we can merge stream data into delta lake. But How to ingest real-time…

Azure SQL Database
Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
556 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
1,916 questions
Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
330 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,526 questions
asked 2020-11-10T12:28:43.067+00:00
THIMMAIAH GARI,PRASHANTH,, 201 Reputation points
edited an answer 2024-04-24T06:51:50.8266667+00:00
Shane Blake 0 Reputation points
1 answer

Unable to update Cosmos DB documents with Hierarchical partition keys using Azure Stream Analytics job

I have document in Cosmos DB with Hierarchical partition keys. I want to patch certain property value. But while running the job I am getting this error👇 The streaming job failed: Stream Analytics job has validation errors: Error connecting to…

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
556 questions
Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
330 questions
Azure Cosmos DB
Azure Cosmos DB
An Azure NoSQL database service for app development.
1,441 questions
asked 2024-03-01T13:02:56.9233333+00:00
Subhajit Mondal 10 Reputation points
edited a comment 2024-04-16T17:38:45.9266667+00:00
Krarzia, Mahmoud 0 Reputation points
1 answer One of the answers was accepted by the question author.

Azure Stream Analytics Jobs - Alert Creation for "Diagnostic: Diagnostic Error"

I have multiple Azure stream Analytics Jobs (more than 50 Azure Stream Analytics Jobs) in my subscription. One of the requirement we have is to create an Alert whenever there is a activity logged in Azure Portal --> Stream Analytics Job -->…

Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
330 questions
asked 2024-04-03T09:46:13.2933333+00:00
NewDBA 101 Reputation points
accepted 2024-04-04T21:20:06.1+00:00
NewDBA 101 Reputation points
3 answers

Im trying to send Data from my IoTHub Input to my Sql Database output, but tables stay empty?

Hello everyone, Im currently working on a university-project and I'm connecting my Raspberry Pi Pico with Azure. The Pico is sending temperature data, which is recieved in the IoTHub Input im my analytics stream, but when I'm trying to send the data to…

Azure IoT Hub
Azure IoT Hub
An Azure service that enables bidirectional communication between internet of things (IoT) devices and applications.
1,115 questions
Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
330 questions
asked 2024-03-20T14:33:58.6733333+00:00
Snack Overflow 0 Reputation points
answered 2024-03-20T15:53:31.9666667+00:00
Sander van de Velde 28,311 Reputation points MVP
1 answer One of the answers was accepted by the question author.

Data sync issue in Stream Analytics job to Azure SQL database

I am using the Raspberry Pi Azure IoT Online Simulator to push the data (in the interval of every 500 milli seconds) to Azure IoT hub (Basic Tier) using this link https://azure-samples.github.io/raspberry-pi-web-simulator/ I have configured Stream…

Azure SQL Database
Azure IoT Hub
Azure IoT Hub
An Azure service that enables bidirectional communication between internet of things (IoT) devices and applications.
1,115 questions
Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
330 questions
asked 2024-02-29T05:47:33.0566667+00:00
Vishvanath Bhat 20 Reputation points
accepted 2024-03-14T10:38:44.5933333+00:00
Vishvanath Bhat 20 Reputation points
1 answer One of the answers was accepted by the question author.

Stream Analytics: Why does state of reference data retrieval not leave "In progress"

Hi, I'm using a CSV file from Azure Blob Storage as a reference input source in a Stream Analytics resource. Right now this file is updated every twenty minutes, but this will change to longer periods as our testing progresses. Within the activity logs…

Azure Blob Storage
Azure Blob Storage
An Azure service that stores unstructured data in the cloud as blobs.
2,427 questions
Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
330 questions
asked 2024-03-13T08:40:16.1533333+00:00
Tobias Reinhardt 20 Reputation points
accepted 2024-03-14T08:11:56.1966667+00:00
Tobias Reinhardt 20 Reputation points
2 answers

How to recover Stream Analytics job to normal Running status from Degraded state?

Hello, My stream analytics job had been working fine with IoT Hub stream input and SQL DB as reference input, output is written to storage account. Yesterday there was an unplanned Azure service issue with IoT Hub in my region and it lasted for around 6…

Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
330 questions
asked 2024-02-22T03:01:24.33+00:00
Vishwanath Hariharan 30 Reputation points
commented 2024-03-13T13:28:08.0033333+00:00
Vishwanath Hariharan 30 Reputation points
1 answer

Trying to ingest filter Kafka header and filter into my azure stream analytics job

Hello I am trying to ingest kafka header in azure stream analytics job - i successfully connected to an input kafka topic, containing standard and custom headers. When testing the query, i only get data field. I tried GetMetadataPropertyValue function,…

Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
330 questions
asked 2024-03-07T11:33:00.58+00:00
Frederic DDurand 0 Reputation points
answered 2024-03-07T14:13:45.1766667+00:00
Sander van de Velde 28,311 Reputation points MVP
1 answer

Records Column (json) to convert one column to multiple rows in Azure Streaming Language

I have a ID column and Records column with the values in different rows between square brackets in it. Azure Streaming analytics language, I would want to split the values between square brackets pivot into multiple rows .

Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
330 questions
asked 2024-02-24T14:54:09.71+00:00
N2120 81 Reputation points
commented 2024-03-06T00:05:17.14+00:00
Sander van de Velde 28,311 Reputation points MVP
1 answer

User Header filter from Kafka enabled Azure eventhub using Azure Stream Analytics query

I have a Kafka enabled azure eventhub where am publishing the data from my client application. To publish i use the confluent kafka dot net package. Each message has a User header (message headers). The Eventhub has 10 partitions. Multiple tenants (5)…

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
556 questions
Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
330 questions
asked 2024-02-09T03:25:34.3766667+00:00
K S Devadoss, Vishnu Kumar 20 Reputation points
answered 2024-03-01T08:30:50.6033333+00:00
K S Devadoss, Vishnu Kumar 20 Reputation points
1 answer One of the answers was accepted by the question author.

How to achieve streaming ingestion for ASA input to ADX?

Hi, I've set up an ADX Dev cluster which has been configured for streaming. I created a Database and Table which both had their streamingingestion policies enabled. I used this MS Link to create an ADX output from an Azure Stream Analytics job I…

Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
480 questions
Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
330 questions
asked 2024-02-22T16:26:59.37+00:00
Javier Huamani 20 Reputation points
accepted 2024-02-26T20:18:56.8+00:00
Javier Huamani 20 Reputation points
1 answer

Input file to Azure Stream analytics in Json format error while previewing

Thanks for your time, I have a job in azure stream analytics with an input json format file which is accessed through Azure data lake. the format of json is of format [{"tag":…

Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
330 questions
asked 2024-02-21T16:04:44.08+00:00
N2120 81 Reputation points
commented 2024-02-26T06:58:55.2533333+00:00
Wilko van de Velde 2,146 Reputation points
2 answers

Stream Analytics Job Output Stuck

I have a stream analytics job with an MQTT JSON input and a postgreSQL output. I noticed that if a certain JSON parameter that is part of the message no output rows are generated. I couldn't find any related info in the logs. Restarting the stream…

Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
330 questions
asked 2021-11-12T14:36:21.217+00:00
Lior Bahat 1 Reputation point
edited a comment 2024-02-01T17:13:59.93+00:00
Sander van de Velde 28,311 Reputation points MVP
0 answers

Issue with max block count in Azure Data Lake Gen2

Starting from 03/02/23 I have noticed that my Stream Analytics Job has been creating more files per day than before. Looking through the files' properties I discovered that every file maxes out at 10000 blocks and then the SA Job creates another one,…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,338 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,362 questions
Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
330 questions
asked 2023-04-12T14:00:18.7933333+00:00
Anonymous
commented 2024-02-01T16:01:56.7666667+00:00
Forlani Mauro 1 Reputation point
0 answers

How to hide a column in Azure Stream Analytics Data Preview

Is there anyways to hide the column in Azure Stream Analytics Data Preview? In my case, I want to hide column "properties" in data preview. Thanks!

Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
330 questions
asked 2024-02-01T02:49:41.17+00:00
Tu Nguyen 0 Reputation points
commented 2024-02-01T09:52:57.24+00:00
Tu Nguyen 0 Reputation points
1 answer

Why are booleans in Stream Analytics sample outputs getting converted into 0's and 1's?

When using the data sampler available from Event Hubs -> namespace -> Process Data, and running the default sample query, we've recently noticed that values that would previously show as booleans are now converting into 0 or 1 in the…

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
556 questions
Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
330 questions
asked 2024-01-30T21:04:59.7766667+00:00
John Barhorst 0 Reputation points
commented 2024-02-01T01:59:26.0166667+00:00
PRADEEPCHEEKATLA-MSFT 76,921 Reputation points Microsoft Employee
0 answers

Difference between schema.history and database.history in mysql connector

I set up kafka, mysql and debezium in my computer successfully. However, i have still not understood about the difference between database.history.kafka.topic and schema.history.internal.kafka.topic. Below is my connector: Please help me explaining the…

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
556 questions
Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
330 questions
asked 2024-01-16T13:56:59.92+00:00
Eddy Tran 40 Reputation points
edited the question 2024-01-25T04:43:02.8633333+00:00
PRADEEPCHEEKATLA-MSFT 76,921 Reputation points Microsoft Employee
1 answer

How to use AnomalyDetection_ChangePoint Anomaly detection?

Hi , I look to find the anomaly detection using AnomalyDetection_ChangePoint two parameters using Tumbling window grouping(since its a non stable value input), but I have doubt regarding the set point, is it possible to give a set point or threshold…

Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
330 questions
asked 2024-01-18T05:04:08.49+00:00
Novin George Thomas 0 Reputation points
commented 2024-01-19T14:43:47.2566667+00:00
Novin George Thomas 0 Reputation points
1 answer

How to read inputs from beginning?

Hi there, currently I'm testing Stream Analytics for a streaming application and facing the issue that my job only reads data that is incoming after it has been started. Data that has been present before won't be processed. I tested this behaviour with…

Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
330 questions
asked 2024-01-15T08:48:47.57+00:00
Philipp Marinovic-BrĂĽnjes 0 Reputation points
commented 2024-01-17T14:59:55.13+00:00
Sander van de Velde 28,311 Reputation points MVP
1 answer

Stream analytics LAST method Partition by

When using Stream Analytics LAST built in method do you set a property which is "PARTITION BY", does this mean that you change the overall partitioning you set from the input stage or is this somehow locally. For clarification, you can set…

Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
330 questions
asked 2024-01-03T09:46:20.6333333+00:00
tobbin2 1 Reputation point
commented 2024-01-17T11:07:35.8133333+00:00
ShaikMaheer-MSFT 37,896 Reputation points Microsoft Employee