kestra-io / kestra-io/plugin-serdes
maxRecordSize error with CsvToIon
Open
area/plugin
good first issue
- Dominant language
- Java
- Stars
- 1
- Forks
- 20
- Avg merge
- 1d 18h
- Merged PRs (30d)
- 36
Description
### Describe the issue
When changing the 'maxFieldSize' value to 1073741824 (1 GB), the error `maxRecordSize must be >= maxFieldSize` appears (maxBufferSize is already set to 2147483647 (2 GB)).
### Environment
- Kestra Version: 1.3.30
Contributor guide
No contributing guide indexed for this repository
Research direction
Start at the CsvToIon entry point and inspect how maxFieldSize, maxRecordSize, and maxBufferSize are validated. Reproduce the error with maxFieldSize set to 1073741824 and maxBufferSize set to 2147483647; done means a valid 1 GB maxFieldSize configuration no longer triggers an incorrect maxRecordSize error.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- data-engineering
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Quiet
- Clarity
- Needs clarification
- Newbie friendliness
- 45/100