apache / apache/incubator-xtable

[Support] Request: Ability to Invoke Scala Code for Operations in oneTable

Open
#353 21 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
1.2k
Forks
212
Avg merge
4d 9h
Merged PRs (30d)
16

Description

Hello,

I hope this message finds you well.

I'm currently in the midst of experimenting with oneTable and conducting some proof of concept work. As I delve deeper into this, I've encountered a few questions, and I was hoping to seek some guidance. Please forgive me if some of these questions seem basic; I'm earnestly striving to expand my knowledge about oneTable.

One of the queries I have pertains to the invocation of Scala code instead of the following command:

```

java \
-jar ./jar/utilities-0.1.0-beta1-bundled.jar \
--dataset ./my_config.yaml
```

The reason behind this inquiry is that, during regular write operations, I typically utilize Scala code to execute tasks on AWS Glue for table synchronization.

I would greatly appreciate any insights or suggestions you might have regarding this matter.

Thank you for your time and assistance.

Contributor guide

No contributing guide indexed for this repository

Research direction

The issue names the utilities-0.1.0-beta1-bundled.jar command, my_config.yaml, Scala write operations, and AWS Glue, but no source files or tests. Start by tracing how the existing Java command and Glue-based synchronization are invoked, then clarify the expected Scala entry point and define done as an agreed, reproducible invocation path documented or implemented in the project.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, java, scala
Domain
cloud, data-engineering
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.