81 questions
0 votes
0 answers
42 views
How to set up cross tenant authentication using Service Principal without secret in ADF Linked service
I need to transfer data from an Azure SQL database in Tenant A to another Azure SQL database in Tenant B using Azure Data Factory. I want to use Service Principal authentication without relying on ...
0 votes
1 answer
80 views
Azure Synapse Linked service cannot preview table data
COPY statement input file schema discovery failed: Cannot process the file " https://my-storage-account.dfs.core.windows.net/a-folder/a-parquet-file.snappy.parquet " because it could not be ...
0 votes
2 answers
69 views
Azure datafactory dataset dynamic parameter
I've been trying to find out if it's possible to parameterize the linked service in an Azure Data Factory (ADF) dataset, similar to how we can parameterize the table name and schema name in a SQL ...
1 vote
1 answer
112 views
Creating a linked service with bicep file does not generate `encryptedCredential` property like the UI does
I have a bicep file that creates a linked service from a data factory to a storage account. It's pretty basic: module Storage 'linked_services/linked_services.bicep' = { name: 'AzureFileStorage' ...
1 vote
1 answer
66 views
Get ADF Linked Service SQL Server Username from Azure SQL Vault
I have two Azure keys vaults. One for password and one for username. I have to insert username value but I don’t know where I have to get it. How have I to insert username Azure key vault in this ...
0 votes
1 answer
182 views
terraform azurerm_data_factory_linked_service_azure_sql_database how should I configure use_managed_identity and credential_name
I try to create a linked_service using this terraform command: azurerm_data_factory_linked_service_azure_sql_database. The documentation says that we can use use_managed_identity (I use it as a ...
0 votes
1 answer
73 views
Able to read FileInfo, but cannot read contents within the file: urlopen error [Errno 5] Input/output error
I have 2 environments, Staging & Production. Both using the exact code, but one environment can read the contents within the file, while other cannot. I can see both FileInfo using 2 codes: Python:...
0 votes
1 answer
53 views
"Schema" property not found in Postgres Connector
I created a linked service in Azure Data Factory, it points to a remote Postgres database. The connection is working. But when I specify a particular schema under the title "Additional connection ...
0 votes
1 answer
108 views
Can we use one linked service in Azure synapse Analytics to access Oracle database by SID or Service Name
In our project we have a Oracle linked service created using connection type as SID. We have a requirement to connect to a Oracle database using Service name only. We want single linked service that ...
0 votes
1 answer
95 views
Can I run stored procedures from Azure Data Factory which are hosted on an on-premise SQL Database (via a Citrix Datacentre)
We have some production stored procedures which need executing in the middle of the day using our on-prem servers, is it possible for these to be trigger via an Azure Data Factory Pipeline on our ...
0 votes
2 answers
160 views
Definition File for a an AzDataFactoryV2LinkedService
I am writing some code to create some Azure ressource using the PowerShell CLI. Currently, I aim at setting up a LinkedService to pull some JSON data from a REST API. When I run the code, the linked ...
0 votes
1 answer
85 views
Is there any smart way to find out the SQL Server link from linked service of adf?
I wanted to find the SQL Servers are present in ADF or not but I am checking the ADF it through a resource group. Is there any smart way to find out the SQL Server link from linked service of ADF? I ...
0 votes
0 answers
210 views
How to filter SAP Data at source with Synapse/ADF CDC?
In Azure Synapse I'm using the SAP CDC Connector to connect to a S/4HANA system. My goal is to filter data on the source side before storing it in my ADLS Gen2, as there are certain data restrictions ...
1 vote
1 answer
386 views
Synapse Notebook to Azure SQL Database connection issue
created Linked service to Azure SQL database in Synapse Analytics that uses Authentication type " System Assigned Managed Identity". Than referencing it in PySpark Notebook. Method ...
1 vote
2 answers
958 views
Azure databricks clusters are failing to load while creating a linked service in azure data factory
This is the error I'm trying to learn azure data bricks, data factory... I'm trying to link the data bricks cluster to data factory, but the clusters are failing to load, I've entered the cluster ...