Skip to content

[VL][Spark 3.3+] support return metadataColumns from native scan insteads of fallback #2618

@gaoyangxiaozhu

Description

@gaoyangxiaozhu

Currently Velox didn't handle _metadata.* column of parquet/orc scan.

Below will fallback after this PR #2563 or return null

select _metadata.file_path, _metadata.file_size

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions