JuliaParallel / JuliaParallel/Elly.jl

How to read distributed files using hdfs_blocks?

Open
#50 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Julia
Stars
45
Forks
12
PR merge metrics
No merged PRs in 30d

Description

Great package!

the tutorial on hdfs just mentions that you can work with it distributedly, however the example stays a bit cryptic
```
julia> hdfs_blocks(huge_file)
1-element Array{Tuple{UInt64,Array},1}:
(0x0000000000000000, AbstractString["node1"])
(0x0000000007d00000, AbstractString["node2"])
(0x000000000fa00000, AbstractString["node3"])
```
Can you help me on how to proceed with this output in order to read respective files?
Thanks a lot

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.