5,318 questions with Azure Synapse Analytics tags

Sort by: Updated
0 answers

How to allow an integration pipeline to access a view in the serverless SQL Pool Built-in

I'm trying to build a pipeline. I want to use as the source dataset - data from the external table created against the parquet files stored in the Gen2 blob. I have the external tables and views setup and can access them in PowerBI via the Azure Synapse…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,318 questions
asked 2025-04-30T22:06:49.91+00:00
Steve McMasters 0 Reputation points
commented 2025-05-02T20:36:29.9233333+00:00
J N S S Kasyap 1,705 Reputation points Microsoft External Staff
0 answers

How to fix an established connection was aborted by the server error while making SFTP connection using Azure Synapse?

Hello Team, While we are trying to connect SFTP using SSH public key authentication we are getting following error. Established connection was aborted by the server let me share the steps which we followed so far to connect the sftp. [1] Open PuttyGen…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,318 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,464 questions
asked 2023-02-22T19:41:13.66+00:00
Nikunj Patel 61 Reputation points
commented 2025-05-02T18:02:28.6566667+00:00
JKU 0 Reputation points
1 answer One of the answers was accepted by the question author.

I am unable to publish changes in my Synapse workspace

M workspace is integrated with github. We've successfully published changes hundreds of times. Now we are getting an error "Error while publishing: Failed to getFolderInSingleRequest, folder: [workspace-name]. Reason: ae.data is undefined". …

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,318 questions
asked 2025-04-25T18:26:32.3766667+00:00
Jason Cox 20 Reputation points
accepted 2025-05-02T15:29:50.6733333+00:00
Jason Cox 20 Reputation points
0 answers

Deltalake change data feed on synapse notebook

Hi Team, Could you please help us we are looking to enable change data feed to existing delta file but it is not working, we have used below steps to enable. set spark.databricks.delta.properties.defaults.enableChangeDataFeed =…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,318 questions
asked 2025-05-02T06:06:55.0233333+00:00
commented 2025-05-02T11:26:10.2433333+00:00
2 answers

Azure Synapse CI/CD Pipeline Spark Pool Parameterization Issue

A Synapse Project with three notebooks is set up, each utilizing a Spark cluster, e.g., sparkuksdev. The notebooks are part of a pipeline where the Spark cluster is parameterized through a SQL Data Warehouse's Parameters table using…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,318 questions
asked 2025-04-24T11:09:51.4433333+00:00
Debbie Edwards 521 Reputation points
commented 2025-05-02T10:58:03.94+00:00
Venkat Reddy Navari 1,585 Reputation points Microsoft External Staff
0 answers

Create DB identity in synapse notebook

Hi, I want to create a Synapse notebook where can read data from Azure SQL server DB. So I need to connect the DB via jdbc and enter the user name and password like code below. Is there a way where I can store this username and password somewhere so that…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,318 questions
asked 2025-04-24T03:06:32.7566667+00:00
Lotus88 136 Reputation points
commented 2025-05-02T08:48:13.6666667+00:00
Dileep Raj Narayan Thumula 5 Reputation points Microsoft External Staff
2 answers

In Azure Synapse monitor Apache Spark Applications who or what is the submitter GUID?

In Synapse studio monitor Apache Spark Applications the same GUID - 2864980c-2195-47d6-bc42-d8b4ff8e3e11 - appears many times as the submitter and I cannot find out who or what this is. I have tried >az ad sp show --id…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,318 questions
asked 2025-04-14T13:28:23.2+00:00
Cooke, Richard (Allianz UK) 0 Reputation points
edited a comment 2025-05-02T08:25:24.0466667+00:00
Cooke, Richard (Allianz UK) 0 Reputation points
1 answer

Getting Error while publishing changes to Synapse release branch: Failed to getFolderInSingleRequest, folder: <synapse-dev-workspace-name>. Reason: Cannot read properties of undefined (reading 'repository')

I am getting the following error while publishing the latest changes from a branch to release branch: Publishing error Error while publishing: Failed to getFolderInSingleRequest, folder: cs-vn-uset2-syn-ecrm. Reason: Cannot read properties of undefined…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,318 questions
asked 2025-04-29T01:55:11.3766667+00:00
PATEL, SACHIN KUMAR 0 Reputation points
edited a comment 2025-05-02T08:23:59.51+00:00
phemanth 15,320 Reputation points Microsoft External Staff
0 answers

When I'm trying to add a table in an existing synapse link, my new table in waiting for snapshot state for long, after I check the log, I got the error message.Error 22724 severity 16 Error occurred while exporting initial snapshot to landing zone.

When I'm trying to add a table in an existing synapse link, my new table in waiting for snapshot state for long, after I check the log, I got the error message. Error 22724 severity 16 Error occurred while exporting initial snapshot to landing zone.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,318 questions
asked 2025-04-29T07:34:44.83+00:00
Vignesh K 20 Reputation points
commented 2025-05-02T05:31:22.61+00:00
Singireddi JagadishKumar 0 Reputation points Microsoft External Staff
1 answer

Azure Synapse Link for Dataverse Spark issues

I have set up a Azure Synapse Linked Service for Dataverse and the Lake Database got auto created in the Synapse workspace. I can also run a SQL script on any of the Dataverse tables that I included in the Link by right clicking them and using the select…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,318 questions
asked 2025-04-25T23:35:21.93+00:00
Broomfield, Darrien 0 Reputation points
commented 2025-05-02T03:23:05.8666667+00:00
Singireddi JagadishKumar 0 Reputation points Microsoft External Staff
1 answer One of the answers was accepted by the question author.

Local timestamp issue with Synpase notebook

Hi, I am using Synapse notebook to write a record with system update timestamp. I wrote the following code in the beginning of the notebook code to adjust timestamp to UTC+8. # Adjust timestamps to Asia/Singapore…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,318 questions
asked 2025-04-29T10:04:43.4766667+00:00
Lotus88 136 Reputation points
accepted 2025-05-02T00:58:54.2266667+00:00
Lotus88 136 Reputation points
2 answers

Pipeline to wait until spark cluster is available

Hello, We have a very small node cluster and due to multiple spark notebooks running at the same time the notebooks or pipeline fails with 6002 timedout error. Some notebooks do not start at all and fails. Is there a way we can queue the notebooks or…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,318 questions
asked 2025-04-23T15:31:40.7533333+00:00
Kumar, Arun 336 Reputation points
answered 2025-05-01T10:32:58.0733333+00:00
Dileep Raj Narayan Thumula 5 Reputation points Microsoft External Staff
1 answer

Can we use composite key while creating table structure using distribution as hash. If yes, kindly provide the syntax.

Can we use composite key while creating table structure using distribution as hash. If yes, kindly provide the syntax. SQL syntax to create table structure for composite keys including multiple columns using distribution as hash.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,318 questions
asked 2025-04-28T17:29:45.9966667+00:00
Dheeraj Singh 0 Reputation points
commented 2025-04-30T19:54:23.3266667+00:00
Chandra Boorla 12,080 Reputation points Microsoft External Staff
1 answer

Send email with attachment as part of synapse pipeline

Hi , We want to send an email with attachment present in container. Can you please let us know how we can achieve that. Thanks

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,318 questions
asked 2025-04-28T15:15:57.6533333+00:00
79571025 0 Reputation points
commented 2025-04-30T17:38:15.14+00:00
J N S S Kasyap 1,705 Reputation points Microsoft External Staff
1 answer

There are substantial concurrent MappingDataflow executions which is causing failures due to throttling under subscription

I am getting a few errors. Firstly, when I trigger a pipeline, I get the error in the title: Operation on target file failed: There are substantial concurrent MappingDataflow executions which is causing failures due to throttling under subscription…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,318 questions
asked 2025-04-14T09:54:51.0533333+00:00
Matthew Ethan Tam 0 Reputation points
commented 2025-04-30T11:48:26.0466667+00:00
Dileep Raj Narayan Thumula 5 Reputation points Microsoft External Staff
4 answers

How to send a mail notification for a failed pipeline in Azure Synapse Analytics?

How can I send a notification email to a specific email address without using a logic app when one of my Synapse Analytics pipelines fails? I would like to include the error message in the email notification.

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,554 questions
Azure Blob Storage
Azure Blob Storage
An Azure service that stores unstructured data in the cloud as blobs.
3,142 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,318 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,464 questions
asked 2024-03-20T15:48:58.53+00:00
Aditya Singh 160 Reputation points
commented 2025-04-30T06:47:54.5966667+00:00
Muthusamy, Nandha Kumar 0 Reputation points
1 answer

How can I access the Synapse REST API from Spark notebooks in a Synapse workspace deployed with a private endpoint?

I'm trying to access the Synapse REST API from Spark notebooks in my Synapse workspace, which is deployed with a private endpoint and has public network access disabled. When I attempt to call the API from within a notebook, I get the following…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,318 questions
asked 2025-04-24T06:02:59.9733333+00:00
Kartik Rana 21 Reputation points
commented 2025-04-30T04:27:34.55+00:00
Ganesh Gurram 6,460 Reputation points Microsoft External Staff
1 answer One of the answers was accepted by the question author.

How to export Artifacts ARM Template for a Azure Synapse Workspace?

Is there a possible way to export an "Artifacts ARM Template" from a specific resource? I have been trying to implement an Azure devops CI/CD Pipeline that migrates artifacts (Pipeline, dataflows and datasets) between Synpase workspaces (i.e.…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,318 questions
asked 2025-04-21T16:58:39.59+00:00
Napsty Dev 20 Reputation points
commented 2025-04-29T16:59:50.3533333+00:00
Napsty Dev 20 Reputation points
1 answer One of the answers was accepted by the question author.

Is Azure Synapse Analytics expected to support Spark 3.5 in the near future?

Is Azure Synapse Analytics expected to support Spark 3.5 in the near future? Spark 3.5 allows to use Delta Lake 3.0 version which improved overall performance significantly. https://delta.io/blog/delta-lake-performance/ Apache Spark 3.5 compatible…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,318 questions
asked 2025-02-10T15:39:23.9866667+00:00
Akjol Syeryekkhaan 20 Reputation points Microsoft Employee
commented 2025-04-29T15:51:53.8766667+00:00
Maramory Niaré 0 Reputation points
1 answer

How to transfer data across Tenants using Managed Identity authentication?

Hi All, I have a requirement to extract data from a source system in Tenant A to a target system in Tenant B. I have been granted Managed Identity (MI) access on the source. I'm using Azure Synapse Analytics to build the ETL pipeline for this data…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,318 questions
asked 2025-04-29T02:24:23.73+00:00
Narsimha Vangari (Capgemini America Inc) 0 Reputation points Microsoft External Staff
edited the question 2025-04-29T15:23:45.94+00:00
Nandan Hegde 35,026 Reputation points MVP