apache / apache/datafusion-comet
[COMET NATIVE WRITER] write path implements onTaskCommit API correctly
Open
area:writer
bug
priority:low
spark sql tests
- Dominant language
- Scala
- Stars
- 1.3k
- Forks
- 373
- Avg merge
- 2d 4h
- Merged PRs (30d)
- 198
Description
### Describe the bug
Fix spark test `write path implements onTaskCommit API correctly` when comet native writer is enabled
### Steps to reproduce
_No response_
### Expected behavior
_No response_
### Additional context
_No response_
Contributor guide
Research direction
Locate the Spark test named “write path implements onTaskCommit API correctly” and run it with the Comet native writer enabled. Trace the write path and onTaskCommit handling exposed by the failure, then confirm the test passes with native writer enabled.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- scala, spark
- Domain
- data-engineering, testing-qa
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100