apache / apache/arrow

Reading NetCDF files using arrow in R

Open
#14,180 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
C++
Stars
17.1k
Forks
4.3k
Avg merge
3d 18h
Merged PRs (30d)
91

Description

I would like to know if it is possible to read a NetCDF file stored in AWS s3 using the arrow library in R. If yes, could you provide some guidance on how to do it? Could you please also confirm if arrow would download the whole file as a temporary file first, even if I am only interested in a data chunk?

Thank you!

Contributor guide

Open the contributing guide

Research direction

Start by checking whether the R Arrow API supports reading NetCDF files from AWS S3, then investigate the documented behavior for accessing only a data chunk versus downloading the whole file. Done means providing a clear, verified answer or identifying the documentation gap and the relevant guidance to add.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, r
Domain
cloud, data
Issue type
Documentation
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.