Glavin001 / Glavin001/MrShell

Map-Reduce syntax for language

Open
#2 7 comments 0 reactions 1 assignee Claimed by @Glavin001 View on GitHub
help wanted question
Dominant language
C
Stars
5
Forks
1
PR merge metrics
No merged PRs in 30d

Description

I recommend skimming [MapReduce on Wikipedia](http://en.wikipedia.org/wiki/MapReduce) and [Map-Reduce examples for MongoDB](http://docs.mongodb.org/manual/core/map-reduce/) to get a feel of what it is usually used for and how.

Goals with this shell:
- Multi-process (`fork()`, `exec()`, etc) Map-Reduce style queries
- Implicitly Multi-core scripting, awesome!
- `Map` function could be `n` # of pipes to other commands
- `Map(k1,v1) → list(k2,v2)`
- `Reduce` function should take a list of inputs that are piped to it and aggregate results
- `Reduce(k2, list (v2)) → list(v3)`
- Syntax for auto-piping to file to be used by Map sub-function
- Some programs only access files and do not work with `stdin`, so there should be a special accessor syntax for `stdin` and for as file, without requiring to use another pipe to another shell script
- File should be temporary and stored in the Operating System's respective temporary file directory
- Pipes within Map and Reduce functions
- Map function could have 3 parallel calls, however, those 3 calls could be a grouped representation of sequential (series) or calls to other functions.
- For instance, one of the Map sub-calls could be to get the last name given the input, and _then_ pipe that to another step where it will ALL-CAPS that outputted last name.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.