Map-Reduce syntax for language
- Dominant language
- C
- Stars
- 5
- Forks
- 1
- PR merge metrics
- No merged PRs in 30d
Description
I recommend skimming [MapReduce on Wikipedia](http://en.wikipedia.org/wiki/MapReduce) and [Map-Reduce examples for MongoDB](http://docs.mongodb.org/manual/core/map-reduce/) to get a feel of what it is usually used for and how.
Goals with this shell:
- Multi-process (`fork()`, `exec()`, etc) Map-Reduce style queries
- Implicitly Multi-core scripting, awesome!
- `Map` function could be `n` # of pipes to other commands
- `Map(k1,v1) → list(k2,v2)`
- `Reduce` function should take a list of inputs that are piped to it and aggregate results
- `Reduce(k2, list (v2)) → list(v3)`
- Syntax for auto-piping to file to be used by Map sub-function
- Some programs only access files and do not work with `stdin`, so there should be a special accessor syntax for `stdin` and for as file, without requiring to use another pipe to another shell script
- File should be temporary and stored in the Operating System's respective temporary file directory
- Pipes within Map and Reduce functions
- Map function could have 3 parallel calls, however, those 3 calls could be a grouped representation of sequential (series) or calls to other functions.
- For instance, one of the Map sub-calls could be to get the last name given the input, and _then_ pipe that to another step where it will ALL-CAPS that outputted last name.
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.