Timestamps having different timezone cannot be represented in the same field of a schema
- Dominant language
- Rust
- Stars
- 9.3k
- Forks
- 2.4k
- Avg merge
- 3d 7h
- Merged PRs (30d)
- 344
Description
### Is your feature request related to a problem or challenge?
We should be able to handle the cases where timestamps with different timezone data are stored in the same field of a schema. However, `Field` struct holds a `DataType` info, and if we want to place a different timezone:
`ArrowError(InvalidArgumentError("column types must match schema types, expected Timestamp(Millisecond, Some(\"+03:00\")) but found Timestamp(Millisecond, None) at column index 0"))`
### Describe the solution you'd like
Timezone check for timestamps can be ignored while matching columns with the schema
### Describe alternatives you've considered
-
### Additional context
-
Contributor guide
Research direction
Start by locating the schema column-matching logic that compares Timestamp timezone metadata and read the surrounding tests. Reproduce the reported mismatch between Some("+03:00") and None, then verify that columns differing only in timezone metadata are accepted without allowing unrelated type differences.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- rust
- Domain
- data-engineering, databases
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100