Aiven-Open / Aiven-Open/tiered-storage-for-apache-kafka

many error logs output when fetching data from AWS S3

未關閉
#584 3 則留言 0 個 reaction 已指派 0 人 在 GitHub 檢視
主要語言
Java
星號
239
分支
59
PR 合併指標
30 天內沒有已合併 PR

描述

# What happened?

When fetching data from AWS S3, I saw many error messages with interrupt exception. Although the data is fetched successfully and data is correct, I think we should try to fix the issue. If it's expected, maybe we should catch the exception and do some custom handling?

configs:
```
[2024-08-30 15:04:52,250] INFO RemoteStorageManagerConfig values:
chunk.size = 4194304
compression.enabled = false
compression.heuristic.enabled = false
custom.metadata.fields.include = []
encryption.enabled = false
key.prefix =
key.prefix.mask = false
metrics.num.samples = 2
metrics.recording.level = INFO
metrics.sample.window.ms = 30000
segment.manifest.cache.retention.ms = 3600000
segment.manifest.cache.size = 1000
storage.backend.class = class io.aiven.kafka.tieredstorage.storage.s3.S3Storage
(org.apache.kafka.common.config.AbstractConfig)
[2024-08-30 15:04:52,253] INFO S3StorageConfig values:
aws.access.key.id = [hidden]
aws.certificate.check.enabled = true
aws.checksum.check.enabled = false
aws.credentials.provider.class = null
aws.secret.access.key = [hidden]
s3.api.call.attempt.timeout = null
s3.api.call.timeout = null
s3.bucket.name = [hidden]
s3.endpoint.url = null
s3.multipart.upload.part.size = 5242880
s3.path.style.access.enabled = null
s3.region = ap-southeast-2
(org.apache.kafka.common.config.AbstractConfig)
```

errors logs: https://gist.github.com/showuon/8ff9e18b062c7392c6e2b189f045dc3f

# What did you expect to happen?

No error logs.

# What else do we need to know?

N/A

貢獻指南

開啟貢獻指南

評估

這個 Issue 還沒有評估資料。

把新 issue 寄到你的電子郵件信箱

精選適合新手參與的 GitHub issue 摘要。