Skip to content

Avoid serialization of field IDs when combining attributes with shared visibility #563

@dcy2003

Description

@dcy2003

Currently the Accumulo optimization to flatten fields sharing a common visibility attribute into a single column qualifier serializes/deserializes the original field IDs alongside the values. This approach increases the size required to store each feature and we also pay a performance penalty.

Investigate approaches to avoid the serialization/deserialization of field IDs while maintaining the ability to properly deconstruct the flattened value (preferably without knowledge of the data adapter) and support field level query filtering.

Ultimately this should result in a performance boost, but the tradeoff is additional complexity. Goal is to find the best approach to achieve this performance boost while minimizing complexity.

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions