apache / apache/datafusion-comet
Comet writer doesn't create _SUCCESS file
Open
area:writer
bug
priority:medium
- Dominant language
- Scala
- Stars
- 1.3k
- Forks
- 373
- Avg merge
- 2d 4h
- Merged PRs (30d)
- 198
Description
### Describe the bug
Currently Comet creates data files but skips completele `_SUCCESS` file which Apache Spark used to write to mark the write is final and complete. A lot of usets relies on this file
### Steps to reproduce
_No response_
### Expected behavior
_No response_
### Additional context
_No response_
Contributor guide
Assessment
This issue has not been assessed yet.