405 questions with Azure Stream Analytics tags

Sort by: Updated
1 answer

When does Azure Stream Analytics watermark calculation use 'no events arrived' formula

The azure documentation for time handling in azure stream analytics states the following. When there's any incoming event, ... When there's no incoming event, ... I have the following doubts In the statement 'When there's no incoming event', who…

Azure Stream Analytics
Azure Stream Analytics

An Azure real-time analytics service designed for mission-critical workloads.

405 questions
asked 2026-03-07T10:28:39.4666667+00:00
Dhruv Singla 210 Reputation points
commented 2026-03-11T12:18:40.6833333+00:00
Marcin Policht 82,360 Reputation points MVP Volunteer Moderator
1 answer

Can the watermark go back in Azure Stream Analytics

The azure documentation for time handling in azure stream analytics states the following. When there's any incoming event, the watermark is the largest event time Stream Analytics has seen so far minus the out-of-order tolerance window size. When…

Azure Stream Analytics
Azure Stream Analytics

An Azure real-time analytics service designed for mission-critical workloads.

405 questions
asked 2026-03-07T14:34:20.2566667+00:00
Dhruv Singla 210 Reputation points
commented 2026-03-09T19:16:45.9166667+00:00
Dhruv Singla 210 Reputation points
1 answer

Clarifying the watermark formula for stream analytics when no data is received

The azure documentation for time handling in azure stream analytics states the following. When there's no incoming event, the watermark is the current estimated arrival time minus the late arrival tolerance window. The estimated arrival time is the time…

Azure Stream Analytics
Azure Stream Analytics

An Azure real-time analytics service designed for mission-critical workloads.

405 questions
asked 2026-03-06T12:31:07.85+00:00
Dhruv Singla 210 Reputation points
commented 2026-03-07T04:46:50.2833333+00:00
Dhruv Singla 210 Reputation points
3 answers

Unable to retrieve data from reference dataset in Azure Stream Analytics

I am trying to run my first Azure Streaming Analytics query: But when I test the query I get the message "There is no data from input 'referencedata'. Please make sure the input source has data and then try again." The reference dataset is in…

Azure Data Lake Storage
Azure Data Lake Storage

An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.

1,594 questions
Azure Storage
Azure Storage

Globally unique resources that provide access to data management services and serve as the parent namespace for the services.

3,800 questions
Azure Stream Analytics
Azure Stream Analytics

An Azure real-time analytics service designed for mission-critical workloads.

405 questions
asked 2023-04-28T20:16:53.94+00:00
James 0 Reputation points
answered 2026-02-27T20:58:06.4166667+00:00
Shelly Chen 0 Reputation points
1 answer

I need assistance with purchasing Azure capacities to generate embed tokens

I need assistance with purchasing Azure capacities to generate embed tokens

Azure Stream Analytics
Azure Stream Analytics

An Azure real-time analytics service designed for mission-critical workloads.

405 questions
asked 2025-11-05T21:48:13.9233333+00:00
Peter Fehler 0 Reputation points
answered 2026-02-11T12:04:23.49+00:00
mirsjerk global 0 Reputation points
2 answers

Clarification on Metrics to Use for Scaling Microsoft Fabric Capacity (Real-Time Intelligence - Eventstreams & Event Sources)

We are using Microsoft Fabric Real-Time Intelligence, specifically Eventstream and Event Source workloads. We would like official guidance on which metrics and thresholds should be monitored to determine when to scale our Fabric capacity up or…

Azure Stream Analytics
Azure Stream Analytics

An Azure real-time analytics service designed for mission-critical workloads.

405 questions
asked 2025-11-27T12:27:27.8166667+00:00
Anirudh Singh Bharti 20 Reputation points
answered 2025-12-02T06:23:13.76+00:00
Smaran Thoomu 33,920 Reputation points Microsoft External Staff Moderator
2 answers One of the answers was accepted by the question author.

Data Pipeline Using Stream Analytics Job with Event Hubs for Input and Output Dropping Events

I have a data pipeline that includes these services in sequence: Input Event Hub -> Stream Analytics Job (With a simple WHERE clause Filter) -> Output Event Hub -> Function App (With EventHubTrigger) I am sending a load test of 1000 events…

Azure Stream Analytics
Azure Stream Analytics

An Azure real-time analytics service designed for mission-critical workloads.

405 questions
asked 2025-10-31T21:36:11.58+00:00
Tarik Rashada 25 Reputation points
commented 2025-11-04T21:36:33.25+00:00
Tarik Rashada 25 Reputation points
2 answers One of the answers was accepted by the question author.

Struggling with Event Hub Errors: Unable to Trigger Functions After Changing Partition Count

I have built a system where I send messages from devices to IoT Hub, pass them through Stream Analytics, and trigger Functions from Event Hub. I conducted a series of tests at this point and confirmed that Functions were triggered successfully. Later, I…

Azure Event Hubs
Azure Event Hubs

An Azure real-time data ingestion service.

767 questions
Azure Stream Analytics
Azure Stream Analytics

An Azure real-time analytics service designed for mission-critical workloads.

405 questions
asked 2023-07-24T10:03:34.3733333+00:00
KURAMOTOAHUJATAIRA-3118 250 Reputation points
edited an answer 2025-10-30T14:56:05.29+00:00
Joost Lambregts 0 Reputation points
2 answers One of the answers was accepted by the question author.

missing events: how to prevent temporarily empty files being processed.

We're using Azure Stream Analytics with ADLS as the input source. Our source system (Kafka) creates files that are initially empty (0 bytes). After a short delay (milliseconds), data is flushed and the file is closed. However, Stream Analytics processes…

Azure Stream Analytics
Azure Stream Analytics

An Azure real-time analytics service designed for mission-critical workloads.

405 questions
asked 2025-10-20T10:12:38.8266667+00:00
hoi 25 Reputation points
accepted 2025-10-23T12:22:23.8466667+00:00
hoi 25 Reputation points
0 answers

Partition not working in case of Blob Input

I am creating a stream analytics job with blob input. I have partitioned folders and have set the partition option in the input settings. But it only works when partition value is a number and does not work for string values. i.e. not receiving events in…

Azure Stream Analytics
Azure Stream Analytics

An Azure real-time analytics service designed for mission-critical workloads.

405 questions
asked 2025-08-28T08:02:54.81+00:00
M Saad 36 Reputation points
commented 2025-09-02T07:37:03.2+00:00
M Saad 36 Reputation points
1 answer

Error encountered while storing reference data snapshot into the storage account

Error encountered while storing reference data snapshot into the storage account

Azure Stream Analytics
Azure Stream Analytics

An Azure real-time analytics service designed for mission-critical workloads.

405 questions
asked 2024-05-09T12:13:14.1633333+00:00
Kelele G Berhe 0 Reputation points
answered 2025-06-25T10:06:46.1666667+00:00
Bansari Oza 20 Reputation points
2 answers One of the answers was accepted by the question author.

How can I troubleshoot latency issues in Azure Stream Analytics job output?

I'm experiencing increased latency in the output of my Azure Stream Analytics job. The input is coming from an Event Hub and the output is going to an Azure SQL Database. I’ve checked that the Event Hub is receiving data in near real-time, but the…

Azure Stream Analytics
Azure Stream Analytics

An Azure real-time analytics service designed for mission-critical workloads.

405 questions
asked 2025-05-27T18:46:40.6766667+00:00
Stephen27 80 Reputation points
accepted 2025-06-24T10:30:42.1766667+00:00
Stephen27 80 Reputation points
2 answers

Which solution on Azure is better and why

Scenario 1 : when I am consuming data from Stream Analytics to Azure SQL via service bus, as these services was already in used in different Pipeline. Pic 1 Secenerio 2 : I am thinking to Leverage ADF to bring same data from ADLS Gen2 to Azure SQL. As…

Azure Stream Analytics
Azure Stream Analytics

An Azure real-time analytics service designed for mission-critical workloads.

405 questions
asked 2025-05-22T14:44:28.7666667+00:00
Relay 320 Reputation points
commented 2025-06-03T15:20:30.2666667+00:00
Chandra Boorla 15,470 Reputation points Microsoft External Staff Moderator
2 answers

How to fix this error Value cannot be null.\r\nParameter name: s", azure stream analytics

I'm onboarding datasets from Kafka. Everything works fine when I onboard up to 6 datasets. But when I try to add a 7th dataset, I get the following error from Azure Stream Analytics: "The streaming job failed: Value cannot be null. Parameter name:…

Azure Stream Analytics
Azure Stream Analytics

An Azure real-time analytics service designed for mission-critical workloads.

405 questions
asked 2025-05-28T14:17:47.5666667+00:00
Anonymous
edited a comment 2025-06-03T07:10:18.8366667+00:00
Venkat Reddy Navari 5,840 Reputation points Microsoft External Staff Moderator
1 answer

Low Level Design For Batch and Streaming Data Platform In Azure

Hello, I am trying to create Low level design Document for below mention diagram. May Someone please help me what all should be consider for each component. How to handle Error and Failure and Restartibility. Thank You So Much for your help.

Azure Stream Analytics
Azure Stream Analytics

An Azure real-time analytics service designed for mission-critical workloads.

405 questions
asked 2025-05-19T15:52:01.6033333+00:00
Relay 320 Reputation points
commented 2025-05-21T17:20:11.44+00:00
Ganesh Gurram 7,235 Reputation points Moderator
1 answer One of the answers was accepted by the question author.

How to do Low Level Design for Given HLD in Azure

I have created a High level design where I am consuming JSON file from Azure Stream Analytics to Azure SQL. What all are properties I should consider for creating Low Level Design for same. Please help me with your expertise knowledge. Thanks a lot

Azure Stream Analytics
Azure Stream Analytics

An Azure real-time analytics service designed for mission-critical workloads.

405 questions
asked 2025-05-18T03:57:50.1766667+00:00
Relay 320 Reputation points
accepted 2025-05-19T05:00:58.3366667+00:00
Relay 320 Reputation points
2 answers

Design Real Time Streaming with Azure

I am in process of designing a real time (15 sec latency) data streaming system. Please share your thoughts on Pros and Cons for below scenerio. I have to replace SAP Connector with Azure Tech stack with lowest latency for process data, as shown in pic…

Azure Stream Analytics
Azure Stream Analytics

An Azure real-time analytics service designed for mission-critical workloads.

405 questions
asked 2025-05-13T06:12:26.8833333+00:00
Relay 320 Reputation points
answered 2025-05-13T08:16:46.0866667+00:00
Anonymous
1 answer One of the answers was accepted by the question author.

Stream Analytics compatibility 1.2 - PARTITION BY PartitionId

Will the PARTITION BY PartitionId statement still ensure parallel processing (and make sure that input partition = output partition) for compatibility level 1.2 when we don't specify a partition key column? Our situation: we have 2 input eventhubs…

Azure Stream Analytics
Azure Stream Analytics

An Azure real-time analytics service designed for mission-critical workloads.

405 questions
asked 2025-05-12T10:53:56.6233333+00:00
Guusje 40 Reputation points
accepted 2025-05-12T12:02:49.27+00:00
Guusje 40 Reputation points
1 answer

How to fix We cannot connect to Event Hub partition [0] because the maximum number of allowed receivers per partition in a consumer group has been reached

We cannot connect to Event Hub partition [0] because the maximum number of allowed receivers per partition in a consumer group has been reached. Ensure that other Stream Analytics jobs or Service Bus Explorer are not using the same consumer group. The…

Azure Event Hubs
Azure Event Hubs

An Azure real-time data ingestion service.

767 questions
Azure Stream Analytics
Azure Stream Analytics

An Azure real-time analytics service designed for mission-critical workloads.

405 questions
asked 2025-02-12T16:07:20.29+00:00
h85824 0 Reputation points
commented 2025-04-29T16:34:32.18+00:00
Sander van de Velde | MVP 37,056 Reputation points MVP Volunteer Moderator
1 answer

Unable to connect kafka topic as input in Azure Stream Analytics Job

We are getting error while establishing connection with kafka in Azure Stream Analytics Exception thrown while trying to retrieve Kafka partition count for <

Azure Stream Analytics
Azure Stream Analytics

An Azure real-time analytics service designed for mission-critical workloads.

405 questions
asked 2025-04-16T10:04:36.4033333+00:00
Raghav, Omkar S 0 Reputation points
commented 2025-04-18T16:32:42.06+00:00
Chandra Boorla 15,470 Reputation points Microsoft External Staff Moderator