Could we supply the method that convert spark sql dataframe to tensorflow-java ByteNdArray object ?
Open
Nobody has claimed this yet.
- Dominant language
- Java
- Stars
- 928
- Forks
- 227
- PR merge metrics
- No merged PRs in 30d
Description
Hi :
Now I etl the raw data use spark sql generate the dataframe , I want to convert the spark dataframe object to ByteNdArray object for tensorflow model input
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
No file, test, entry point, input schema, or expected conversion behavior is specified. Start by locating the existing Spark SQL DataFrame and ByteNdArray integration points in tensorflow-java, then clarify the supported types and API shape. Done would require an agreed conversion path and tests for the supported DataFrame inputs.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java, spark, tensorflow
- Domain
- data, machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100