Additional basic functions beyond .map to allow for more functional programming

🚀 The feature

For IterDataPipe, the .map maps a function over the items of an iterable. where the function has the form

f: Any -> Any

Other basic building blocks could be .pipe, .iter_map and .comsume. where

• .pipe would take f: Iterable -> Iterable
• .iter_map takes f: Any -> Iterable
• .comsume takes f: Iterable -> Any

Motivation, pitch

Such an approach would allow for more flexible functional programming and would reduce most currently provided IterDataPipe classes to a simple functional call. For example

The Enumerator class would become

dp.pipe(enumerate)

This would immediately enable to use all itertools functions in this context.

The TarArchiveLoader could become

def iter_from_tar_archive(fd):
    .<code to yield files from tar archive >
dp.iter_map(iter_from_tar_archive)

I believe using this approach, almost all provided classes could be written using less boilerplate using generator functions (essentially just writing the code inside __iter__ as a standalone generator function, possibly curried for convenience if other parameters are being used).

Would be great to hear if this was considered? Thanks!

Alternatives

The .pipe can already be written as

dp2 = IterableWrapper(enumerate(dp)) 

but I believe this would be a lot less nice than the above

dp.pipe(enumerate)

Additional context

No response

Start by reviewing the existing IterDataPipe API and the IterableWrapper, Enumerator, and TarArchiveLoader examples named in the issue. Clarify the semantics and scope of pipe, iter_map, and consume, then establish the expected API and coverage before implementation; the issue currently presents a design proposal rather than a defined change.