-
Notifications
You must be signed in to change notification settings - Fork 4.1k
sql: make all processor cores vectorize-able #57268
Copy link
Copy link
Closed
Labels
C-cleanupTech debt, refactors, loose ends, etc. Solution not expected to significantly change behavior.Tech debt, refactors, loose ends, etc. Solution not expected to significantly change behavior.T-sql-queriesSQL Queries TeamSQL Queries Teammeta-issueContains a list of several other issues.Contains a list of several other issues.
Description
Currently, we have native support for or can wrap many processor core types; however, there are some exceptions that prohibit the vectorization of the whole flow if the "bad" core is present in the physical plan. This issue tracks addressing all of those.
-
LocalPlanNode- there is a WIP to address it, sql,colexec: add support for wrapping LocalPlanNode #55909
-
MetadataTestSenderandMetadataTestReceiver- I think we should remove these test processors entirely. Possibly colexec: add a way to propagate metadata in a streaming fashion #55758 is related.
-
ChangeAggregatorandChangeFrontier -
InvertedFilterer- wrapping of the inverted filterer is unsupported because the cFetcher always decodes the data coming from disk, and the row-execution framework just happens to work due to
EncDatum.encodedfield. opt: change the key column of inverted indexes to use a new column id and type #50695 was the original issue filed for it, it is now closed, yet I think the problem is still present.
- wrapping of the inverted filterer is unsupported because the cFetcher always decodes the data coming from disk, and the row-execution framework just happens to work due to
-
Backfiller,CSVWriter,Sampler,SampleAggregator- these processors don't implement
execinfra.RowSourceinterface, so they cannot be wrapped. They, however, use the DistSQL framework but are never - I think - planned in the flows containing other supported processors. Stats operators work is tracked in sql: implement vectorized operator for table statistics collection #41203.
- these processors don't implement
Jira issue: CRDB-2842
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
C-cleanupTech debt, refactors, loose ends, etc. Solution not expected to significantly change behavior.Tech debt, refactors, loose ends, etc. Solution not expected to significantly change behavior.T-sql-queriesSQL Queries TeamSQL Queries Teammeta-issueContains a list of several other issues.Contains a list of several other issues.