51zero / 51zero/eel-sdk

EEL DSL for a CLI shell

Open
#211 2 comments 0 reactions 0 assignees View on GitHub
enhancement help wanted
Dominant language
Scala
Stars
147
Forks
32
PR merge metrics
No merged PRs in 30d

Description

EEL DSL for a CLI shell

- A Scala DSL for EEL commands.
- The Scala REPL to be used as an interactive shell
- Scala variables, loops and conditional statements can be combined with DSL commands to easily script tasks
- A bootstrap shell script called *eel-shell* similar to *spark-shell* - will automatically import the eel DSL packages
- Also automatically import OS packages to allow for OS commands to be run and combined with the DSL

*Import*

Import data with options from an EEL source to a sink

import from jdbc
with driver=blah,url=blah,sql=blah
to hive
with db=blah,table=blah

Import from jdbc
with driver=blah,url=blah,sql=blah
to Parquet
with path=blah

*Export*

Export data with options to an EEL sink from a source

export to hive
with db=blah,table=blah
from jdbc
with driver=blah,url=blah,sql=blah

export to hive
with db=blah,table=blah
from Parquet
with path=blah

- Note allow a *transform* sub-command at the appropriate place to do custom transformations on the underlying rows in the frame.

More commands to follow....

Contributor guide

No contributing guide indexed for this repository

Research direction

Look for existing CLI or shell-related code in the repository, possibly under src/main/scala/com/fiftyzero/eel. Check for any existing DSL implementations or REPL integration. The bootstrap script 'eel-shell' would need to be created, likely in a scripts/ directory. Understanding the EEL SDK's core data import/export commands is essential before designing the DSL syntax and integration with Scala REPL.

Written by the indexing model from the issue text.

Assessment

Tech stack
hadoop, kafka, scala
Domain
cli, data-engineering, tooling
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.