I need to transfer data from an Azure SQL database in Tenant A to another Azure SQL database in Tenant B using Azure Data Factory. I want to use Service Principal authentication without relying on ...

Just came across a task and had to do some digging to find the answer: How to export Azure Synapse artifacts, more specifically pipelines, conserving their folder hierarchy, when Git integration is ...

I'm using a PySpark notebook inside of Azure Synapse. This is my schema definition qcew_schema = StructType([ StructField( 'area_fips', dataType = CharType(5), ...

I want to query a different subscription SQL Pool using SPark can I just use the same syntax or is additional configuration neccesary and if so how to? df = spark.read.option(Constants.SERVER, "&...

Anyone know how to call single notebook with different parameters parallel, and all notebooks should appear on spark UI to make the trouble shooting easier? I have one child notebook, calling from ...

When I try to access tables from a serverless SQL pool from my application I get the error. Msg 13807, Level 16, State 1, Line 1 Content of directory on path 'https://xxx.dfs.core.windows.net/xxx/...

I have a delta lake in azure blob storage. I want to read the data using serverless sql pool. My team mate already defined the views and he is able to access them without a problem. When I try to ...

I have a Azure Synapse Notebook and want to read parquest files from google cloud. I created a linked service to the google cloud. This works fine: I can test the connection with success. But how can ...

I need to extract data from a vendor API in Azure Data Factory using Service Principal authentication. In Web activity, I’m not sure what the correct resource value should be for external (non-...

I have SQL query that I'm trying to make work on Azure Synapse where the project is being built. But everything I try doesn't get the correct record count. The tables I have ingested onto Azure ...

I'm working on a Synapse pipeline that pulls data from the Azure Devops OData feed. The base query works fine in both the browser and Synapse, but it seems to ignore the $expand portion of the query ...

I want to extract "email" from JSON using ADF/Synapse. Below is the JSON that I want to flatten and extract all "email" which is in an object in a multidimensional array: { "...

Given XML with element that has both attribute and value, e.g. <root><elem attr="world">hello</elem></root> how can I parse both the attribute and the value in ...

I am trying to connect Synapse Analytics to an existing CosmosDB container. In official tutorials the code is simple, SELECT TOP 10 * FROM OPENROWSET( 'CosmosDB', 'Account=your-cosmosdb;...

I want to create a Synapse pipeline in which one of the activities is a lightweight, long-running job. Once it succeeds, the flow should proceed to the next activity. However, I don't see any activity ...