51zero / 51zero/eel-sdk

EEL DSL for a CLI shell

未关闭
#211 2 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看
enhancement help wanted
主要语言
Scala
星标
147
派生
32
PR 合并指标
30 天内没有已合并 PR

描述

EEL DSL for a CLI shell

- A Scala DSL for EEL commands.
- The Scala REPL to be used as an interactive shell
- Scala variables, loops and conditional statements can be combined with DSL commands to easily script tasks
- A bootstrap shell script called *eel-shell* similar to *spark-shell* - will automatically import the eel DSL packages
- Also automatically import OS packages to allow for OS commands to be run and combined with the DSL

*Import*

Import data with options from an EEL source to a sink

import from jdbc
with driver=blah,url=blah,sql=blah
to hive
with db=blah,table=blah

Import from jdbc
with driver=blah,url=blah,sql=blah
to Parquet
with path=blah

*Export*

Export data with options to an EEL sink from a source

export to hive
with db=blah,table=blah
from jdbc
with driver=blah,url=blah,sql=blah

export to hive
with db=blah,table=blah
from Parquet
with path=blah

- Note allow a *transform* sub-command at the appropriate place to do custom transformations on the underlying rows in the frame.

More commands to follow....

贡献指南

这个仓库没有索引到贡献指南

调研方向

Look for existing CLI or shell-related code in the repository, possibly under src/main/scala/com/fiftyzero/eel. Check for any existing DSL implementations or REPL integration. The bootstrap script 'eel-shell' would need to be created, likely in a scripts/ directory. Understanding the EEL SDK's core data import/export commands is essential before designing the DSL syntax and integration with Scala REPL.

由索引模型根据 Issue 内容生成。

评估

技术栈
hadoop, kafka, scala
领域
cli, data-engineering, tooling
Issue 类型
功能
难度
5/5
预计耗时
一周以上
活跃度
停滞
描述清晰度
基本清楚
新手友好度
25/100

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。