51zero / 51zero/eel-sdk

EEL DSL for a CLI shell

Aperta
#211 2 commenti 0 reazioni 0 assegnatari Vedi su GitHub
enhancement help wanted
Lingua principale
Scala
Stelle
147
Fork
32
Metriche di merge delle PR
Nessuna PR unita negli ultimi 30g

Descrizione

EEL DSL for a CLI shell

- A Scala DSL for EEL commands.
- The Scala REPL to be used as an interactive shell
- Scala variables, loops and conditional statements can be combined with DSL commands to easily script tasks
- A bootstrap shell script called *eel-shell* similar to *spark-shell* - will automatically import the eel DSL packages
- Also automatically import OS packages to allow for OS commands to be run and combined with the DSL

*Import*

Import data with options from an EEL source to a sink

import from jdbc
with driver=blah,url=blah,sql=blah
to hive
with db=blah,table=blah

Import from jdbc
with driver=blah,url=blah,sql=blah
to Parquet
with path=blah

*Export*

Export data with options to an EEL sink from a source

export to hive
with db=blah,table=blah
from jdbc
with driver=blah,url=blah,sql=blah

export to hive
with db=blah,table=blah
from Parquet
with path=blah

- Note allow a *transform* sub-command at the appropriate place to do custom transformations on the underlying rows in the frame.

More commands to follow....

Guida per i contributori

Nessuna guida per i contributori indicizzata per questo repository

Direzione di ricerca

Look for existing CLI or shell-related code in the repository, possibly under src/main/scala/com/fiftyzero/eel. Check for any existing DSL implementations or REPL integration. The bootstrap script 'eel-shell' would need to be created, likely in a scripts/ directory. Understanding the EEL SDK's core data import/export commands is essential before designing the DSL syntax and integration with Scala REPL.

Scritto dal modello di indicizzazione a partire dal testo della issue.

Valutazione

Stack tecnologico
hadoop, kafka, scala
Ambito
cli, data-engineering, tooling
Tipo di issue
Funzionalità
Difficoltà
5/5
Tempo stimato
Più di una settimana
Stato di attività
Ferma
Chiarezza
Abbastanza chiara
Idoneità per principianti
25/100

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.