Skip to content

[VL] Large timestamp outside of range #7109

@ccat3z

Description

@ccat3z

Backend

VL (Velox)

Bug description

Timestamps that great then 32767 years without but do not overflow will be outside of range.

Seq(
  (1723240800675l)
).toDF("time")

spark.sql("""
  select from_unixtime(event_timestamp, 'HH') from test
""")

// vanilla: 56577-04-30 00:11:15
// gluten: Timestamp is outside of supported range of [-32767-01-01, 32767-12-31]

It may be because std::chrono::time_point is used in time conversion, which has range limitations.

Spark version

None

Spark configurations

No response

System information

No response

Relevant logs

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't workingtriage

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions