Skip to content

storage blob copy start-batch needs "prefix" arg. Not pattern. #10924

@worldspawn

Description

@worldspawn

Is your feature request related to a problem? Please describe.
When trying to use start-batch I wanted to copy all files beginning with a prefix. Prefix in this case is how prefix is applied with this command:

az storage blob list --container-name $container --account-name testbullclip --prefix $_.name

This appears to do a performant query against blob storage. I get results in seconds. Start-batch doesn't this. It has --pattern, what --pattern does I couldn't say but it appears to be scanning every single blob name. My container has 1.34M blobs making the implementation of --pattern of no use at all.

Describe the solution you'd like
Use whatever magic the blob list --prefix arg is using with a new arg for start-batch called --prefix.

Describe alternatives you've considered
I've tried using azcopy but it has the same sort of implementation with --include-pattern.

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions