🐛 Problem
ADF pipeline "msexports_ExecuteETL" failing with the following error when processing Reservation Transaction information. (I have obscured the storage account name, billing account and billing profile from the below.
_Operation on target Get Existing Parquet Files failed: ADLS Gen2 operation failed for: Operation returned an invalid status code 'NotFound'. Account: 'STORAGEACCOUNTNAMEHERE'. FileSystem: 'ingestion'. Path: 'Transactions/2025/04/providers/microsoft.billing/billingaccounts/BILLINGACCOUNTID/billingprofiles/BILLINGPROFILEID'. ErrorCode: 'PathNotFound'. Message: 'The specified path does not exist.'. RequestId: '0ce578c0-101f-0088-5675-b4721f000000'. TimeStamp: 'Wed, 23 Apr 2025 17:27:37 GMT'._
The exported reservation transaction CSV had no records (just the column headers).
No directory structure created in ingestion folder for reservation transactions.
This is with an MCA agreement.
👣 Repro steps
- Export reservation transaction data to storage account.
- Review ADF pipeline monitoring.
- msexports_ExecuteETL will show an error as above.
- When looking at the ingestion container no transaction directory is created.
- Reservation transaction csv is still in the msexports container.
🤔 Expected
When transaction data is exported into the msexports container ADF pipeline should run without errors.
🐛 Problem
ADF pipeline "msexports_ExecuteETL" failing with the following error when processing Reservation Transaction information. (I have obscured the storage account name, billing account and billing profile from the below.
_Operation on target Get Existing Parquet Files failed: ADLS Gen2 operation failed for: Operation returned an invalid status code 'NotFound'. Account: 'STORAGEACCOUNTNAMEHERE'. FileSystem: 'ingestion'. Path: 'Transactions/2025/04/providers/microsoft.billing/billingaccounts/BILLINGACCOUNTID/billingprofiles/BILLINGPROFILEID'. ErrorCode: 'PathNotFound'. Message: 'The specified path does not exist.'. RequestId: '0ce578c0-101f-0088-5675-b4721f000000'. TimeStamp: 'Wed, 23 Apr 2025 17:27:37 GMT'._The exported reservation transaction CSV had no records (just the column headers).
No directory structure created in ingestion folder for reservation transactions.
This is with an MCA agreement.
👣 Repro steps
🤔 Expected
When transaction data is exported into the msexports container ADF pipeline should run without errors.