Skip to content

[C++][CSV] Timestamp parsing should accept any valid ISO 8601 without requiring custom parse strings #18786

@asfimport

Description

@asfimport

I was trying to read in some git logs and got this parse error for a column I had declared as timestamp type:

Error: Invalid: In CSV column #0: CSV conversion error to timestamp[s]: invalid value '2021-08-11T17:39:50-04:00'

This is valid ISO 8601 and is what git log produces with the I "strict ISO 8601 format" option (https://git-scm.com/docs/pretty-formats).

I see mentioned on ARROW-10343 that timezone indicators are not supported--is that still true? And I recognize that it's not trivial because a timestamp array has to have the same timezone for all values, so if some rows in this CSV had different timezones listed, we would have to handle that (converting everything to UTC is probably the most useful thing but technically loses information).

Reporter: Neal Richardson / @nealrichardson
Watchers: Rok Mihevc / @rok

Related issues:

Note: This issue was originally created as ARROW-13625. Please see the migration documentation for further details.

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions