51zero / 51zero/eel-sdk

EEL DSL for a CLI shell

Abierto
#211 2 comentarios 0 reacciones 0 asignados Ver en GitHub
enhancement help wanted
Lenguaje dominante
Scala
Estrellas
147
Forks
32
Métricas de merge de PR
Sin PR fusionados en 30 d

Descripción

EEL DSL for a CLI shell

- A Scala DSL for EEL commands.
- The Scala REPL to be used as an interactive shell
- Scala variables, loops and conditional statements can be combined with DSL commands to easily script tasks
- A bootstrap shell script called *eel-shell* similar to *spark-shell* - will automatically import the eel DSL packages
- Also automatically import OS packages to allow for OS commands to be run and combined with the DSL

*Import*

Import data with options from an EEL source to a sink

import from jdbc
with driver=blah,url=blah,sql=blah
to hive
with db=blah,table=blah

Import from jdbc
with driver=blah,url=blah,sql=blah
to Parquet
with path=blah

*Export*

Export data with options to an EEL sink from a source

export to hive
with db=blah,table=blah
from jdbc
with driver=blah,url=blah,sql=blah

export to hive
with db=blah,table=blah
from Parquet
with path=blah

- Note allow a *transform* sub-command at the appropriate place to do custom transformations on the underlying rows in the frame.

More commands to follow....

Guía de contribución

No hay ninguna guía de contribución indexada para este repositorio

Línea de trabajo

Look for existing CLI or shell-related code in the repository, possibly under src/main/scala/com/fiftyzero/eel. Check for any existing DSL implementations or REPL integration. The bootstrap script 'eel-shell' would need to be created, likely in a scripts/ directory. Understanding the EEL SDK's core data import/export commands is essential before designing the DSL syntax and integration with Scala REPL.

Escrito por el modelo de indexación a partir del texto del issue.

Evaluación

Stack tecnológico
hadoop, kafka, scala
Área
cli, data-engineering, tooling
Tipo de issue
Nueva funcionalidad
Dificultad
5/5
Tiempo estimado
Más de una semana
Estado de actividad
Estancado
Claridad
Bastante claro
Aptitud para principiantes
25/100

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.