[R][C++] DecodeRowGroups segfault calling dplyr::glimpse() or head() on a large dataset
- Dominant language
- C++
- Stars
- 17.1k
- Forks
- 4.3k
- Avg merge
- 3d 13h
- Merged PRs (30d)
- 88
Description
### Describe the bug, including details regarding any error messages, version, and platform.
Testing using 13.0.0
```
> library(arrow)
> library(dplyr)
> nyc_taxi <- open_dataset("~/data/nyc-taxi")
> glimpse(nyc_taxi)
FileSystemDataset with 122 Parquet files
[New Thread 0x7fffe2ffd6c0 (LWP 214018)]
[New Thread 0x7fffe21ff6c0 (LWP 214019)]
1,155,795,912 rows x 24 columns
[New Thread 0x7fff707ff6c0 (LWP 214020)]
[New Thread 0x7fff67fff6c0 (LWP 214021)]
[New Thread 0x7fff6d3ff6c0 (LWP 214022)]
[New Thread 0x7fff6cbfe6c0 (LWP 214023)]
[New Thread 0x7fff677fe6c0 (LWP 214024)]
[New Thread 0x7fff66ffd6c0 (LWP 214025)]
[New Thread 0x7fff667fc6c0 (LWP 214026)]
[New Thread 0x7fff65ffb6c0 (LWP 214027)]
[New Thread 0x7fff657fa6c0 (LWP 214028)]
[New Thread 0x7fff64ff96c0 (LWP 214029)]
[New Thread 0x7fff3ffff6c0 (LWP 214030)]
[New Thread 0x7fff377fe6c0 (LWP 214031)]
[New Thread 0x7fff3f7fe6c0 (LWP 214032)]
[New Thread 0x7fff3effd6c0 (LWP 214033)]
[New Thread 0x7fff3e7fc6c0 (LWP 214034)]
[New Thread 0x7fff37fff6c0 (LWP 214035)]
[New Thread 0x7fff18fff6c0 (LWP 214036)]
[New Thread 0x7fff07fff6c0 (LWP 214037)]
$ vendor_name "CMT", "CMT", "CMT", "CMT", "CMT", "CMT", "CM…
$ pickup_datetime 2012-01-20 14:09:36, 2012-01-20 14:54:10, 201…
$ dropoff_datetime 2012-01-20 14:42:25, 2012-01-20 15:06:55, 201…
$ passenger_count 1, 1, 1, 1, 1, 2, 2, 3, 2, 1, 3, 1, 1, 2, 1, …
$ trip_distance 11.10, 2.40, 0.50, 0.70, 0.70, 0.70, 2.60, 4.…
$ pickup_longitude -74.00585, -73.98633, -73.98338, -73.98165, -…
$ pickup_latitude 40.72679, 40.75760, 40.76664, 40.74691, 40.74…
$ rate_code "Standard rate", "Standard rate", "Standard r…
$ store_and_fwd "No", "No", "No", "No", "No", "No", "No", "No…
$ dropoff_longitude -73.86435, -74.00577, -73.99028, -73.98935, -…
$ dropoff_latitude 40.77001, 40.72636, 40.76496, 40.73708, 40.73…
$ payment_type NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, N…
$ fare_amount 29.7, 9.3, 4.1, 4.5, 4.5, 4.1, 9.7, 12.1, 5.3…
$ extra 0.0, 0.0, 0.0, 0.0, 0.5, 1.0, 0.5, 0.5, 0.5, …
$ mta_tax 0.5, 0.5, 0.5, 0.5, 0.5, 0.5, 0.5, 0.5, 0.5, …
$ tip_amount 6.04, 0.00, 1.38, 1.00, 0.00, 0.00, 0.00, 0.0…
$ tolls_amount 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, …
$ total_amount 36.24, 9.80, 5.98, 6.00, 5.50, 5.60, 10.70, 1…
$ improvement_surcharge NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, N…
$ congestion_surcharge NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, N…
$ pickup_location_id NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, N…
$ dropoff_location_id NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, N…
$ year 2012, 2012, 2012, 2012, 2012, 2012, 2012, 201…
$ month 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, …
>
Thread 15 "R" received signal SIGSEGV, Segmentation fault.
[Switching to Thread 0x7fff667fc6c0 (LWP 214026)]
0x00007fffef85bd41 in parquet::arrow::(anonymous namespace)::FileReaderImpl::DecodeRowGroups(std::shared_ptr, std::vector > const&, std::vector > const&, arrow::internal::Executor*) ()
```
### Component(s)
R
Contributor guide
Assessment
This issue has not been assessed yet.