Moving data from one storage account to another using stream analytics is creating duplicate data

RossPerry-7177 0 Reputation points
2025-04-07T13:22:38.9766667+00:00

Hi,

I'm using Azure databricks for data analysis and have data going into a gen2 datalake storage account which then gets moved to another using the 'write once' mode on the output.

What I'm seeing is that data in the second account seems to be duplicating (all columns are the same) when I'm only using a simple query to move the data e.g. 'SELECT * into your_output From your_input'

What could be the cause of this? is it the write mode or something else?

Transact-SQL
Transact-SQL
A Microsoft extension to the ANSI SQL language that includes procedural programming, local variables, and various support functions.
4,704 questions
0 comments No comments
{count} votes

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.