How to allow an integration pipeline to access a view in the serverless SQL Pool Built-in
I'm trying to build a pipeline. I want to use as the source dataset - data from the external table created against the parquet files stored in the Gen2 blob. I have the external tables and views setup and can access them in PowerBI via the Azure Synapse…
Azure Synapse Analytics
How to fix an established connection was aborted by the server error while making SFTP connection using Azure Synapse?
Hello Team, While we are trying to connect SFTP using SSH public key authentication we are getting following error. Established connection was aborted by the server let me share the steps which we followed so far to connect the sftp. [1] Open PuttyGen…
Azure Synapse Analytics
Azure Data Factory
I am unable to publish changes in my Synapse workspace
M workspace is integrated with github. We've successfully published changes hundreds of times. Now we are getting an error "Error while publishing: Failed to getFolderInSingleRequest, folder: [workspace-name]. Reason: ae.data is undefined". …
Azure Synapse Analytics
Deltalake change data feed on synapse notebook
Hi Team, Could you please help us we are looking to enable change data feed to existing delta file but it is not working, we have used below steps to enable. set spark.databricks.delta.properties.defaults.enableChangeDataFeed =…
Azure Synapse Analytics
Azure Synapse CI/CD Pipeline Spark Pool Parameterization Issue
A Synapse Project with three notebooks is set up, each utilizing a Spark cluster, e.g., sparkuksdev. The notebooks are part of a pipeline where the Spark cluster is parameterized through a SQL Data Warehouse's Parameters table using…
Azure Synapse Analytics

Create DB identity in synapse notebook
Hi, I want to create a Synapse notebook where can read data from Azure SQL server DB. So I need to connect the DB via jdbc and enter the user name and password like code below. Is there a way where I can store this username and password somewhere so that…
Azure Synapse Analytics
In Azure Synapse monitor Apache Spark Applications who or what is the submitter GUID?
In Synapse studio monitor Apache Spark Applications the same GUID - 2864980c-2195-47d6-bc42-d8b4ff8e3e11 - appears many times as the submitter and I cannot find out who or what this is. I have tried >az ad sp show --id…
Azure Synapse Analytics
Getting Error while publishing changes to Synapse release branch: Failed to getFolderInSingleRequest, folder: <synapse-dev-workspace-name>. Reason: Cannot read properties of undefined (reading 'repository')
I am getting the following error while publishing the latest changes from a branch to release branch: Publishing error Error while publishing: Failed to getFolderInSingleRequest, folder: cs-vn-uset2-syn-ecrm. Reason: Cannot read properties of undefined…
Azure Synapse Analytics
When I'm trying to add a table in an existing synapse link, my new table in waiting for snapshot state for long, after I check the log, I got the error message.Error 22724 severity 16 Error occurred while exporting initial snapshot to landing zone.
When I'm trying to add a table in an existing synapse link, my new table in waiting for snapshot state for long, after I check the log, I got the error message. Error 22724 severity 16 Error occurred while exporting initial snapshot to landing zone.
Azure Synapse Analytics
Azure Synapse Link for Dataverse Spark issues
I have set up a Azure Synapse Linked Service for Dataverse and the Lake Database got auto created in the Synapse workspace. I can also run a SQL script on any of the Dataverse tables that I included in the Link by right clicking them and using the select…
Azure Synapse Analytics
Local timestamp issue with Synpase notebook
Hi, I am using Synapse notebook to write a record with system update timestamp. I wrote the following code in the beginning of the notebook code to adjust timestamp to UTC+8. # Adjust timestamps to Asia/Singapore…
Azure Synapse Analytics
Pipeline to wait until spark cluster is available
Hello, We have a very small node cluster and due to multiple spark notebooks running at the same time the notebooks or pipeline fails with 6002 timedout error. Some notebooks do not start at all and fails. Is there a way we can queue the notebooks or…
Azure Synapse Analytics
Can we use composite key while creating table structure using distribution as hash. If yes, kindly provide the syntax.
Can we use composite key while creating table structure using distribution as hash. If yes, kindly provide the syntax. SQL syntax to create table structure for composite keys including multiple columns using distribution as hash.
Azure Synapse Analytics
Send email with attachment as part of synapse pipeline
Hi , We want to send an email with attachment present in container. Can you please let us know how we can achieve that. Thanks
Azure Synapse Analytics
There are substantial concurrent MappingDataflow executions which is causing failures due to throttling under subscription
I am getting a few errors. Firstly, when I trigger a pipeline, I get the error in the title: Operation on target file failed: There are substantial concurrent MappingDataflow executions which is causing failures due to throttling under subscription…
Azure Synapse Analytics
How to send a mail notification for a failed pipeline in Azure Synapse Analytics?
How can I send a notification email to a specific email address without using a logic app when one of my Synapse Analytics pipelines fails? I would like to include the error message in the email notification.
Azure Data Lake Storage
Azure Blob Storage
Azure Synapse Analytics
Azure Data Factory
How can I access the Synapse REST API from Spark notebooks in a Synapse workspace deployed with a private endpoint?
I'm trying to access the Synapse REST API from Spark notebooks in my Synapse workspace, which is deployed with a private endpoint and has public network access disabled. When I attempt to call the API from within a notebook, I get the following…
Azure Synapse Analytics
How to export Artifacts ARM Template for a Azure Synapse Workspace?
Is there a possible way to export an "Artifacts ARM Template" from a specific resource? I have been trying to implement an Azure devops CI/CD Pipeline that migrates artifacts (Pipeline, dataflows and datasets) between Synpase workspaces (i.e.…
Azure Synapse Analytics
Is Azure Synapse Analytics expected to support Spark 3.5 in the near future?
Is Azure Synapse Analytics expected to support Spark 3.5 in the near future? Spark 3.5 allows to use Delta Lake 3.0 version which improved overall performance significantly. https://delta.io/blog/delta-lake-performance/ Apache Spark 3.5 compatible…
Azure Synapse Analytics
How to transfer data across Tenants using Managed Identity authentication?
Hi All, I have a requirement to extract data from a source system in Tenant A to a target system in Tenant B. I have been granted Managed Identity (MI) access on the source. I'm using Azure Synapse Analytics to build the ETL pipeline for this data…
Azure Synapse Analytics
