An Azure real-time analytics service designed for mission-critical workloads.
When does Azure Stream Analytics watermark calculation use 'no events arrived' formula
The azure documentation for time handling in azure stream analytics states the following. When there's any incoming event, ... When there's no incoming event, ... I have the following doubts In the statement 'When there's no incoming event', who…
Azure Stream Analytics
Can the watermark go back in Azure Stream Analytics
The azure documentation for time handling in azure stream analytics states the following. When there's any incoming event, the watermark is the largest event time Stream Analytics has seen so far minus the out-of-order tolerance window size. When…
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
Clarifying the watermark formula for stream analytics when no data is received
The azure documentation for time handling in azure stream analytics states the following. When there's no incoming event, the watermark is the current estimated arrival time minus the late arrival tolerance window. The estimated arrival time is the time…
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
Unable to retrieve data from reference dataset in Azure Stream Analytics
I am trying to run my first Azure Streaming Analytics query: But when I test the query I get the message "There is no data from input 'referencedata'. Please make sure the input source has data and then try again." The reference dataset is in…
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
Azure Storage
Globally unique resources that provide access to data management services and serve as the parent namespace for the services.
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
I need assistance with purchasing Azure capacities to generate embed tokens
I need assistance with purchasing Azure capacities to generate embed tokens
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
Clarification on Metrics to Use for Scaling Microsoft Fabric Capacity (Real-Time Intelligence - Eventstreams & Event Sources)
We are using Microsoft Fabric Real-Time Intelligence, specifically Eventstream and Event Source workloads. We would like official guidance on which metrics and thresholds should be monitored to determine when to scale our Fabric capacity up or…
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
Data Pipeline Using Stream Analytics Job with Event Hubs for Input and Output Dropping Events
I have a data pipeline that includes these services in sequence: Input Event Hub -> Stream Analytics Job (With a simple WHERE clause Filter) -> Output Event Hub -> Function App (With EventHubTrigger) I am sending a load test of 1000 events…
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
Struggling with Event Hub Errors: Unable to Trigger Functions After Changing Partition Count
I have built a system where I send messages from devices to IoT Hub, pass them through Stream Analytics, and trigger Functions from Event Hub. I conducted a series of tests at this point and confirmed that Functions were triggered successfully. Later, I…
Azure Event Hubs
An Azure real-time data ingestion service.
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
missing events: how to prevent temporarily empty files being processed.
We're using Azure Stream Analytics with ADLS as the input source. Our source system (Kafka) creates files that are initially empty (0 bytes). After a short delay (milliseconds), data is flushed and the file is closed. However, Stream Analytics processes…
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
Partition not working in case of Blob Input
I am creating a stream analytics job with blob input. I have partitioned folders and have set the partition option in the input settings. But it only works when partition value is a number and does not work for string values. i.e. not receiving events in…
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
Error encountered while storing reference data snapshot into the storage account
Error encountered while storing reference data snapshot into the storage account
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
How can I troubleshoot latency issues in Azure Stream Analytics job output?
I'm experiencing increased latency in the output of my Azure Stream Analytics job. The input is coming from an Event Hub and the output is going to an Azure SQL Database. I’ve checked that the Event Hub is receiving data in near real-time, but the…
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
Which solution on Azure is better and why
Scenario 1 : when I am consuming data from Stream Analytics to Azure SQL via service bus, as these services was already in used in different Pipeline. Pic 1 Secenerio 2 : I am thinking to Leverage ADF to bring same data from ADLS Gen2 to Azure SQL. As…
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
How to fix this error Value cannot be null.\r\nParameter name: s", azure stream analytics
I'm onboarding datasets from Kafka. Everything works fine when I onboard up to 6 datasets. But when I try to add a 7th dataset, I get the following error from Azure Stream Analytics: "The streaming job failed: Value cannot be null. Parameter name:…
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
Low Level Design For Batch and Streaming Data Platform In Azure
Hello, I am trying to create Low level design Document for below mention diagram. May Someone please help me what all should be consider for each component. How to handle Error and Failure and Restartibility. Thank You So Much for your help.
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
How to do Low Level Design for Given HLD in Azure
I have created a High level design where I am consuming JSON file from Azure Stream Analytics to Azure SQL. What all are properties I should consider for creating Low Level Design for same. Please help me with your expertise knowledge. Thanks a lot
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
Design Real Time Streaming with Azure
I am in process of designing a real time (15 sec latency) data streaming system. Please share your thoughts on Pros and Cons for below scenerio. I have to replace SAP Connector with Azure Tech stack with lowest latency for process data, as shown in pic…
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
Stream Analytics compatibility 1.2 - PARTITION BY PartitionId
Will the PARTITION BY PartitionId statement still ensure parallel processing (and make sure that input partition = output partition) for compatibility level 1.2 when we don't specify a partition key column? Our situation: we have 2 input eventhubs…
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
How to fix We cannot connect to Event Hub partition [0] because the maximum number of allowed receivers per partition in a consumer group has been reached
We cannot connect to Event Hub partition [0] because the maximum number of allowed receivers per partition in a consumer group has been reached. Ensure that other Stream Analytics jobs or Service Bus Explorer are not using the same consumer group. The…
Azure Event Hubs
An Azure real-time data ingestion service.
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
Unable to connect kafka topic as input in Azure Stream Analytics Job
We are getting error while establishing connection with kafka in Azure Stream Analytics Exception thrown while trying to retrieve Kafka partition count for <
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.