The vectorized engine's inbox and outbox implementations need to do a good deal of serialization and deserialization, to transform the flatbuffer-encapsulated arrow batches into the vectorized engine's in-memory format.
The temporary memory used here is currently not memory accounted, which presents an issue because the temporary memory used can be quite large.
The vectorized engine's inbox and outbox implementations need to do a good deal of serialization and deserialization, to transform the flatbuffer-encapsulated arrow batches into the vectorized engine's in-memory format.
The temporary memory used here is currently not memory accounted, which presents an issue because the temporary memory used can be quite large.