-
Notifications
You must be signed in to change notification settings - Fork 4.5k
[Bug]: Python GCSFileSystem.delete does not recursively delete #27605
Copy link
Copy link
Closed
Description
What happened?
In the Python SDK, GCSFileSystem.delete suggests directories will be deleted recursively, but that doesn't appear to be the case...?
e.g.I have bucket blakely_dev and the following paths:
gs://blakely_dev/_staging/iteration/1/result
gs://blakely_dev/_staging/iteration/1/output-00000-of-00002
gs://blakely_dev/_staging/iteration/1/output-00001-of-00002
If I pass gs://blakely_dev/_staging/ to .delete(), despite it being a directory and a wildcard being appended if it ends with a /, the following .match() call within .delete() matches neither subdirectories nor the result or output-0000.* files.
Issue Priority
Priority: 3 (minor)
Issue Components
- Component: Python SDK
- Component: Java SDK
- Component: Go SDK
- Component: Typescript SDK
- Component: IO connector
- Component: Beam examples
- Component: Beam playground
- Component: Beam katas
- Component: Website
- Component: Spark Runner
- Component: Flink Runner
- Component: Samza Runner
- Component: Twister2 Runner
- Component: Hazelcast Jet Runner
- Component: Google Cloud Dataflow Runner
Reactions are currently unavailable