397 questions with Azure Stream Analytics tags

Sort by: Updated
1 answer

Error encountered while storing reference data snapshot into the storage account

Error encountered while storing reference data snapshot into the storage account

Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
397 questions
asked 2024-05-09T12:13:14.1633333+00:00
Kelele G Berhe 0 Reputation points
answered 2025-06-25T10:06:46.1666667+00:00
Bansari Oza 0 Reputation points
2 answers One of the answers was accepted by the question author.

How can I troubleshoot latency issues in Azure Stream Analytics job output?

I'm experiencing increased latency in the output of my Azure Stream Analytics job. The input is coming from an Event Hub and the output is going to an Azure SQL Database. I’ve checked that the Event Hub is receiving data in near real-time, but the…

Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
397 questions
asked 2025-05-27T18:46:40.6766667+00:00
Stephen27 80 Reputation points
accepted 2025-06-24T10:30:42.1766667+00:00
Stephen27 80 Reputation points
2 answers

Which solution on Azure is better and why

Scenario 1 : when I am consuming data from Stream Analytics to Azure SQL via service bus, as these services was already in used in different Pipeline. Pic 1 Secenerio 2 : I am thinking to Leverage ADF to bring same data from ADLS Gen2 to Azure SQL. As…

Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
397 questions
asked 2025-05-22T14:44:28.7666667+00:00
Relay 200 Reputation points
commented 2025-06-03T15:20:30.2666667+00:00
Chandra Boorla 14,675 Reputation points Microsoft External Staff Moderator
2 answers

How to fix this error Value cannot be null.\r\nParameter name: s", azure stream analytics

I'm onboarding datasets from Kafka. Everything works fine when I onboard up to 6 datasets. But when I try to add a 7th dataset, I get the following error from Azure Stream Analytics: "The streaming job failed: Value cannot be null. Parameter name:…

Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
397 questions
asked 2025-05-28T14:17:47.5666667+00:00
Naveen S Kumar 0 Reputation points
edited a comment 2025-06-03T07:10:18.8366667+00:00
Venkat Reddy Navari 3,625 Reputation points Microsoft External Staff Moderator
1 answer

Low Level Design For Batch and Streaming Data Platform In Azure

Hello, I am trying to create Low level design Document for below mention diagram. May Someone please help me what all should be consider for each component. How to handle Error and Failure and Restartibility. Thank You So Much for your help.

Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
397 questions
asked 2025-05-19T15:52:01.6033333+00:00
Relay 200 Reputation points
commented 2025-05-21T17:20:11.44+00:00
Ganesh Gurram 7,295 Reputation points Microsoft External Staff Moderator
1 answer One of the answers was accepted by the question author.

How to do Low Level Design for Given HLD in Azure

I have created a High level design where I am consuming JSON file from Azure Stream Analytics to Azure SQL. What all are properties I should consider for creating Low Level Design for same. Please help me with your expertise knowledge. Thanks a lot

Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
397 questions
asked 2025-05-18T03:57:50.1766667+00:00
Relay 200 Reputation points
accepted 2025-05-19T05:00:58.3366667+00:00
Relay 200 Reputation points
2 answers

Design Real Time Streaming with Azure

I am in process of designing a real time (15 sec latency) data streaming system. Please share your thoughts on Pros and Cons for below scenerio. I have to replace SAP Connector with Azure Tech stack with lowest latency for process data, as shown in pic…

Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
397 questions
asked 2025-05-13T06:12:26.8833333+00:00
Relay 200 Reputation points
answered 2025-05-13T08:16:46.0866667+00:00
phemanth 15,765 Reputation points Microsoft External Staff Moderator
1 answer One of the answers was accepted by the question author.

Stream Analytics compatibility 1.2 - PARTITION BY PartitionId

Will the PARTITION BY PartitionId statement still ensure parallel processing (and make sure that input partition = output partition) for compatibility level 1.2 when we don't specify a partition key column? Our situation: we have 2 input eventhubs…

Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
397 questions
asked 2025-05-12T10:53:56.6233333+00:00
Guusje 40 Reputation points
accepted 2025-05-12T12:02:49.27+00:00
Guusje 40 Reputation points
1 answer

How to fix We cannot connect to Event Hub partition [0] because the maximum number of allowed receivers per partition in a consumer group has been reached

We cannot connect to Event Hub partition [0] because the maximum number of allowed receivers per partition in a consumer group has been reached. Ensure that other Stream Analytics jobs or Service Bus Explorer are not using the same consumer group. The…

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
721 questions
Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
397 questions
asked 2025-02-12T16:07:20.29+00:00
h85824 0 Reputation points
commented 2025-04-29T16:34:32.18+00:00
Sander van de Velde | MVP 36,766 Reputation points MVP Volunteer Moderator
1 answer

Unable to connect kafka topic as input in Azure Stream Analytics Job

We are getting error while establishing connection with kafka in Azure Stream Analytics Exception thrown while trying to retrieve Kafka partition count for <

Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
397 questions
asked 2025-04-16T10:04:36.4033333+00:00
Raghav, Omkar S 0 Reputation points
commented 2025-04-18T16:32:42.06+00:00
Chandra Boorla 14,675 Reputation points Microsoft External Staff Moderator
1 answer

azure stream analytics job issue.

For Cost management we tried the autoscaling option but as soon as that is configured, we stop receiving data in ADLS. currently we are receiving data only with manual Scale using 2SU JOB works with 2SU but not with 1SU even though we are processing…

Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
397 questions
asked 2025-04-15T08:38:44.45+00:00
Anonymous
answered 2025-04-16T07:24:26.36+00:00
Sander van de Velde | MVP 36,766 Reputation points MVP Volunteer Moderator
1 answer

[Error] An error happened while submitting Job 'sql-job-0', error detail: Cannot read properties of undefined (reading 'length')

Error while submitting stream analytics job to azure from visual studio code - [Error] An error happened while submitting Job 'sql-job-0', error detail: Cannot read properties of undefined (reading 'length') I dont see any 'length' in my configs.

Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
397 questions
asked 2025-04-11T21:53:45.3+00:00
Suraj Pawar Vadeghar 0 Reputation points
commented 2025-04-15T06:06:36.31+00:00
Ganesh Gurram 7,295 Reputation points Microsoft External Staff Moderator
0 answers

When will Kafka Streaming Analytics REST/ARM deployments & documentation be available?

Now that Kafka inputs/outputs are GA as of November 2024 in Streaming Analytics, when will they be available to deploy programmatically? The following link indicates that you can deploy Kafka inputs with ARM, but there is no documentation in the Azure…

Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
397 questions
asked 2025-04-03T15:30:35.2633333+00:00
Steve Hibit 0 Reputation points
commented 2025-04-03T17:25:53.2066667+00:00
Chandra Boorla 14,675 Reputation points Microsoft External Staff Moderator
1 answer

How to create cross tenant Output with Private Endpoint from Stream Analytics Job (Cluster) to an Event Hub (namespace)?

Hello Community! I'm currently trying to set up an Event Hub (on a namespace) output which exists in another Tenant, and Directory (and of course, Subscription) for a Stream Analytics Job within a Stream Analytics Cluster. I have verified that the…

Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
397 questions
asked 2025-03-19T15:24:47.3766667+00:00
Sinipelto 0 Reputation points
commented 2025-03-26T07:22:06.7666667+00:00
Anonymous
1 answer

How to fix "where' operator: Failed to resolve scalar expression named 'properties_s'" when running the standard query named "List all input deserialization errors" in Stream Analytics job

When attempting to run the following standard query: The following error message is displayed 'where' operator: Failed to resolve scalar expression named 'properties_s' If the column properties_s doesn't exist, which column should I use instead?

Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
397 questions
asked 2025-03-18T14:46:52.2233333+00:00
Lucas Pires Savassa 0 Reputation points
commented 2025-03-20T09:16:36.3+00:00
Venkat Reddy Navari 3,625 Reputation points Microsoft External Staff Moderator
1 answer

Memory Usage Over Capacity error in Stream Analytics

Hi Team, I have stream analytics setup which is consuming data from an EventHub, I am constantly getting the below error message : The memory usage is over the capacity for one or more of the query steps. Event processing may be delayed or stop making…

Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
397 questions
asked 2025-03-11T12:30:33.31+00:00
h85824 0 Reputation points
commented 2025-03-18T13:01:09.6833333+00:00
J N S S Kasyap 3,780 Reputation points Microsoft External Staff Moderator
1 answer One of the answers was accepted by the question author.

How streaming data is processed in real time projects , which was ingested through azure event hubs

And I have few questions : How streaming data is processed in real time projects?, lets say my streaming data is stored in adls gen-2, where every minute a new blob file is created. Does it should be treated as batch data and should process…

Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
397 questions
asked 2025-03-10T21:16:06.5233333+00:00
Prakash Mj 20 Reputation points
edited a comment 2025-03-13T01:00:22.4166667+00:00
Ganesh Gurram 7,295 Reputation points Microsoft External Staff Moderator
1 answer One of the answers was accepted by the question author.

Azure stream analytics

I get this error when I want to display the data generated from this script

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
721 questions
Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
397 questions
Azure Cosmos DB
Azure Cosmos DB
An Azure NoSQL database service for app development.
1,913 questions
Azure Event Grid
Azure Event Grid
An Azure event routing service designed for high availability, consistent performance, and dynamic scale.
456 questions
Developer technologies | Visual Studio | Other
asked 2023-10-19T13:35:01.65+00:00
Given Mnisi 40 Reputation points
commented 2025-03-10T18:52:01.63+00:00
Prakash Mj 20 Reputation points
1 answer

Azure SQL DB not returning correct results

Hello All, I have a stream analytics job that is left outer joining an event hub dataset and a sql db reference table. When I left outer join the datasets, the result returns null: You can see the result in the picture. The column called LEDT should…

Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
397 questions
asked 2025-03-03T15:19:12.8+00:00
Woebbeking, William K 0 Reputation points
commented 2025-03-10T10:09:00.39+00:00
AnnuKumari-MSFT 34,556 Reputation points Microsoft Employee Moderator
1 answer One of the answers was accepted by the question author.

Azure Data Streaming Issue: Switching from Block Blobs to Append Blobs

I've recently made a change to my telemetry stream architecture that's causing some data loss, and I'm hoping to get some insights from those with experience. Current Setup & Issue Original configuration: Telemetry stream using Block Blobs New…

Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
397 questions
asked 2025-02-26T22:01:03.1966667+00:00
Annie Zhou 40 Reputation points Microsoft Employee
accepted 2025-03-03T18:42:04.3533333+00:00
Annie Zhou 40 Reputation points Microsoft Employee