The current implementation ignores the max_recursion attribute in the selector. Seems like a useful thing to do.

In GCS it is more expensive to do ls foo/ and then recurse over the results than to do a ls -R foo/. The running time of a (recursive or non-recursive) operation is proportional to the number of objects in the prefix, not to the number of objects returned.

Therefore, the implementation will probably list all the objects and directories, and simply filter out those that are "too deep" in the recursion hierarchy.

Reporter: Carlos O'Ryan / @coryan
Assignee: Carlos O'Ryan / @coryan

Related issues:

• [C++] Add filesystem / IO implementation for Google Cloud Storage (is a child of)

PRs and other links:

• GitHub Pull Request #11969

_{Note: This issue was originally created as ARROW-15121. Please see the migration documentation for further details.}