Skip to content

Use find/xargs when calculating branch_count#12

Merged
philrz merged 2 commits intomainfrom
xargs-branch-count
May 4, 2023
Merged

Use find/xargs when calculating branch_count#12
philrz merged 2 commits intomainfrom
xargs-branch-count

Conversation

@philrz
Copy link
Contributor

@philrz philrz commented May 3, 2023

A community zync user reported having a problem where migrate.sh showed a zq: Argument list too long error during the migration of a pool. The problem occurred because there were a very large number of files in the branches/ directory for the pool. This PR gets around the problem by using find and xargs to concatenate the many ZNG files together into a single input stream, which Zed permits.

@philrz philrz requested a review from nwt May 3, 2023 23:01
@philrz philrz self-assigned this May 3, 2023
Co-authored-by: Noah Treuhaft <noah.treuhaft@gmail.com>
@philrz philrz merged commit 2e89296 into main May 4, 2023
@philrz philrz deleted the xargs-branch-count branch May 4, 2023 18:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants