-
Notifications
You must be signed in to change notification settings - Fork 6.8k
Support cloud file system schemes in HDFS URIs #5988
Copy link
Copy link
Closed
Description
Note: Please use Issues only for bug reports. For questions, discussions, feature requests, etc. post to dev group: https://www.facebook.com/groups/rocksdb.dev
Expected behavior
When a cloud file system scheme is specified in HDFS URI, RocksDB should use the cloud file system for its storage.
Actual behavior
RocksDB is trying to use the default file system
Steps to reproduce the behavior
In Hadoop configuration, define the default file system as HDFS. Also, add configuration parameters for a cloud storage like GCS. In a program that uses RocksDB, create a HDFS environment by calling NewHdfsEnv() with a parameter like gs://mystorage for fsname. Set this HDFS environment in Options parameter passed to DB::Open.
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels