Skip to content

GEOWAVE-1723: "filesystem" datastore with pluggable data formatter#1724

Merged
rfecher merged 1 commit intolocationtech:masterfrom
rfecher:GEOWAVE-1723
May 15, 2020
Merged

GEOWAVE-1723: "filesystem" datastore with pluggable data formatter#1724
rfecher merged 1 commit intolocationtech:masterfrom
rfecher:GEOWAVE-1723

Conversation

@rfecher
Copy link
Copy Markdown
Contributor

@rfecher rfecher commented May 14, 2020

See issue #1723 for details.

Signed-off-by: Rich Fecher rich.fecher@blacklynx.tech

@rfecher rfecher requested a review from jdgarrett May 14, 2020 21:40
Copy link
Copy Markdown
Contributor

@jdgarrett jdgarrett left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Overall it looks good, to summarize all of my review notes:

  • There are a lot of missing copyright headers for new files
  • There are some lingering references to RocksDB
  • I have some concerns about integration tests where the file system data store is excluded or intermittently fails

Comment thread docs/content/commands/manpages/store/geowave-addstore.txt
Comment thread extensions/datastores/filesystem/pom.xml Outdated
import org.locationtech.geowave.core.store.api.DataStore;
import org.locationtech.geowave.datastore.filesystem.FileSystemStoreFactoryFamily;
import org.locationtech.geowave.datastore.filesystem.config.FileSystemOptions;
import org.locationtech.geowave.datastore.rocksdb.util.RocksDBClientCache;
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

RocksDB import.

@rfecher
Copy link
Copy Markdown
Contributor Author

rfecher commented May 15, 2020

I addressed the concerns. See comments regarding ITs failing, but they always pass locally for me so it is isolated to travis and more challenging to diagnose. I am running 2 passes of the rest of the tests on travis, the last one with secondary indexing enabled on all the tests so overall its pretty solid. But yes, I'd really prefer all tests to pass all the time on travis-ci. I can poke around more in the future if I have a spare cycle and renyone is welcome to poke around.

@rfecher rfecher requested a review from jdgarrett May 15, 2020 00:55
Copy link
Copy Markdown
Contributor

@jdgarrett jdgarrett left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There are some references to RocksDB in the following files, once those have been resolved it will be good to merge:

FileSystemDefaultConfigProvider.java
FileSystemOperations.java
FileSystemStoreTestEnvironment.java

Signed-off-by: Rich Fecher <rich.fecher@blacklynx.tech>
@rfecher rfecher requested a review from jdgarrett May 15, 2020 02:49
@rfecher
Copy link
Copy Markdown
Contributor Author

rfecher commented May 15, 2020

good catch - fixed those rocks references and squashed it back down to a single commit

@rfecher rfecher merged commit 167e2a3 into locationtech:master May 15, 2020
@rfecher rfecher deleted the GEOWAVE-1723 branch May 15, 2020 14:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants