Aiven-Open / Aiven-Open/cloud-storage-connectors-for-apache-kafka
Support dynamic fields partitioned without requiring Avro scheme
Open
S3
- Dominant language
- Java
- Stars
- 58
- Forks
- 39
- Avg merge
- 2d 10h
- Merged PRs (30d)
- 5
Description
Currently, the partitioning capbilities in Aiven are very limited and doesn't enable dynamic partition like AWS firehose support https://aws.amazon.com/blogs/big-data/kinesis-data-firehose-now-supports-dynamic-partitioning-to-amazon-s3/.
I guess it could also support as third implementation like similar to https://github.com/canelmas/kafka-connect-field-and-time-partitioner
Contributor guide
Assessment
This issue has not been assessed yet.