10,701 questions
0
votes
0
answers
34
views
Azure-SSIS IR fails to start with CatalogDbBelongsToAnotherIR – can one SSISDB be used by multiple IRs?
I created an Azure Data Factory and configured a new Azure-SSIS Integration Runtime (IR) using an existing Azure SQL Managed Instance that already contains an SSISDB catalog.
When I try to start the ...
0
votes
0
answers
46
views
ADF Copy Activity from Synapse to Azure SQL Causes 100% IO Utilization (CPU ~40%) and User Query Timeouts
I have an Azure Data Factory (ADF) Copy Activity that periodically copies a large volume of data from an Azure Synapse table into an Azure SQL database.
Whenever the copy activity runs, the IO ...
0
votes
0
answers
101
views
How can I automate loading .bak/.bacpac files from SFTP into Azure SQL and run post-load mapping scripts at low cost?
I’m trying to design a low-cost automated process for refreshing an Azure SQL database from backups that are delivered to an SFTP server.
I receive either .bak or .bacpac files via SFTP. I want to ...
0
votes
0
answers
49
views
How to BULK INSERT hex strings into a VARBINARY column in Azure SQL (from CSV) without staging?
I am loading data from Parquet into Azure SQL Database using this pipeline:
Parquet → PyArrow → CSV (Azure Blob) → BULK INSERT
One column in the Parquet file is binary (hashed passwords).
PyArrow CSV ...
- 1
Advice
0
votes
4
replies
109
views
Ways to Improve Bulk-Insert Throughput in Azure SQL
I’m attempting high-volume bulk inserts into Azure SQL, but the performance is lower than expected. One known factor is the Max Log Rate (MiB/s) limit, which depends on the service tier (see Microsoft’...
- 600
0
votes
1
answer
113
views
Entity Framework Core queries in an ASP.NET Core application targeting an Azure SQL database are running with wildly different runtimes
I have a web app using code-first EF Core.
One of the controllers needs to run what should be a simple query (basically SELECT TOP 1 * FROM companies WHERE id = @id; in EF terms,
var data = await ...
- 261
1
vote
1
answer
326
views
sp_delete_database_firewall_rule fails for greyed out firewall rules
I'm looking at the Networking settings for one or our Azure SQL servers, and I see some of them are greyed out.
Azure Portal shows a message "You can use TSQL to remove or modify greyed out rules....
- 1,090
0
votes
0
answers
83
views
How to get rid of $ShardName when using sp_execute_remote?
When using the sp_execute_remote to call the remote SQL command, the call adds the column $ShardName to the result data set.
Is there any way to suppress returning that extra column? Two reasons...
...
- 21.1k
0
votes
0
answers
86
views
Random Change tracking enabled error when deploying `DACPAC` using `DacFx`
We have a SQL Server Data Tools (SSDT) Visual Studio database project, and we deploy the DACPAC output using DacFx + PowerShell scripts.
In this project, we enable:
Database-level change tracking via ...
- 33.9k
-1
votes
2
answers
248
views
Azure SQL S0 Tier – Slow Update Performance During Peak IoT Data Processing
I'm using Azure SQL (Standard S0: 10 DTUs) to store data from various IoT devices.
Each IoT device sends messages to my Azure IoT Hub, which then triggers an Azure Function App. The Function App ...
- 763
0
votes
1
answer
95
views
Adding diagnosticSettings to Azure SQL Databases using Bicep loops
I am trying to set diagnosticSettings to an array of databases in bicep using for (db, i) in dataBaseArray.
At first I create the databases:
@batchSize(1)
resource sqlDatabases 'Microsoft.Sql/servers/...
- 119
0
votes
0
answers
30
views
Azure Function SQL Output Binding hangs on insert (Node.js) + need APIM policy to match OIDC oid/sub
I’m trying to insert rows into Azure SQL Database using Azure Functions SQL Output Binding (Node.js).
const { app, output } = require('@azure/functions');
const { z } = require('zod');
// SQL Output ...
0
votes
0
answers
84
views
Automatic tuning support at Azure SQL Database level via ARM template deployment
In my resource group I am trying to turn on auto-tuning via our ARM Template using this bit of JSON. What we'd like to know is, is if that restriction on PUT is from Org Policy and not just the fact ...
0
votes
0
answers
49
views
Can’t connect to Azure failover group listener endpoint
I configured a failover group with a SQL MI in West US and another SQL MI in West US 3. Each have their own VNET, subnets and NSG configured. The first SQL MI existed prior to creating the failover ...
- 691
0
votes
0
answers
162
views
How to exclude all complex columns in an Azure Data Factory data flow
Alright so I was going to test my pipeline/data flow where I'm querying a cosmos DB and putting some of that data into an Azure SQL DB table. When trying to do so, I came across this validation error ...
- 687