Aiven-Open / Aiven-Open/tiered-storage-for-apache-kafka
many error logs output when fetching data from AWS S3
- 主要語言
- Java
- 星號
- 239
- 分支
- 59
- PR 合併指標
- 30 天內沒有已合併 PR
描述
# What happened?
When fetching data from AWS S3, I saw many error messages with interrupt exception. Although the data is fetched successfully and data is correct, I think we should try to fix the issue. If it's expected, maybe we should catch the exception and do some custom handling?
configs:
```
[2024-08-30 15:04:52,250] INFO RemoteStorageManagerConfig values:
chunk.size = 4194304
compression.enabled = false
compression.heuristic.enabled = false
custom.metadata.fields.include = []
encryption.enabled = false
key.prefix =
key.prefix.mask = false
metrics.num.samples = 2
metrics.recording.level = INFO
metrics.sample.window.ms = 30000
segment.manifest.cache.retention.ms = 3600000
segment.manifest.cache.size = 1000
storage.backend.class = class io.aiven.kafka.tieredstorage.storage.s3.S3Storage
(org.apache.kafka.common.config.AbstractConfig)
[2024-08-30 15:04:52,253] INFO S3StorageConfig values:
aws.access.key.id = [hidden]
aws.certificate.check.enabled = true
aws.checksum.check.enabled = false
aws.credentials.provider.class = null
aws.secret.access.key = [hidden]
s3.api.call.attempt.timeout = null
s3.api.call.timeout = null
s3.bucket.name = [hidden]
s3.endpoint.url = null
s3.multipart.upload.part.size = 5242880
s3.path.style.access.enabled = null
s3.region = ap-southeast-2
(org.apache.kafka.common.config.AbstractConfig)
```
errors logs: https://gist.github.com/showuon/8ff9e18b062c7392c6e2b189f045dc3f
# What did you expect to happen?
No error logs.
# What else do we need to know?
N/A
貢獻指南
評估
這個 Issue 還沒有評估資料。