Is your feature request related to a problem or challenge? Please describe what you are trying to do.
In adlfs (fsspec), there are two valid conventions for specifying a canonical path to Azure Data Lake Gen2 storage, including the account name:
az://container@account.dfs.core.windows.net/path-part/file
abfs://container@account.dfs.core.windows.net/path-part/file
While object_store supports both the az and abfs protocols, it does not support specifying the account in the URL for the az protocol.
However, it does support this for the abfs protocol.
Describe the solution you'd like
I would like to be able to use the following URL convention with object_store, which improves compatibility with adlfs:
az://container@account.dfs.core.windows.net/path-part/file
Describe alternatives you've considered
The workaround is to remember that I need to use the abfs protocol in object_store based tools such as polars.
However, it would be nice to be able to use the az protocol for everything.
Is your feature request related to a problem or challenge? Please describe what you are trying to do.
In adlfs (fsspec), there are two valid conventions for specifying a canonical path to Azure Data Lake Gen2 storage, including the account name:
While
object_storesupports both theazandabfsprotocols, it does not support specifying the account in the URL for theazprotocol.However, it does support this for the
abfsprotocol.Describe the solution you'd like
I would like to be able to use the following URL convention with
object_store, which improves compatibility withadlfs:Describe alternatives you've considered
The workaround is to remember that I need to use the
abfsprotocol inobject_storebased tools such aspolars.However, it would be nice to be able to use the
azprotocol for everything.