Aiven-Open / Aiven-Open/tiered-storage-for-apache-kafka

many error logs output when fetching data from AWS S3

オープン
#584 コメント 3 件 リアクション 0 件 担当者 0 名 GitHub で見る
主要言語
Java
スター
239
フォーク
59
PR マージ指標
30日以内にマージされた PR はありません

説明

# What happened?

When fetching data from AWS S3, I saw many error messages with interrupt exception. Although the data is fetched successfully and data is correct, I think we should try to fix the issue. If it's expected, maybe we should catch the exception and do some custom handling?

configs:
```
[2024-08-30 15:04:52,250] INFO RemoteStorageManagerConfig values:
chunk.size = 4194304
compression.enabled = false
compression.heuristic.enabled = false
custom.metadata.fields.include = []
encryption.enabled = false
key.prefix =
key.prefix.mask = false
metrics.num.samples = 2
metrics.recording.level = INFO
metrics.sample.window.ms = 30000
segment.manifest.cache.retention.ms = 3600000
segment.manifest.cache.size = 1000
storage.backend.class = class io.aiven.kafka.tieredstorage.storage.s3.S3Storage
(org.apache.kafka.common.config.AbstractConfig)
[2024-08-30 15:04:52,253] INFO S3StorageConfig values:
aws.access.key.id = [hidden]
aws.certificate.check.enabled = true
aws.checksum.check.enabled = false
aws.credentials.provider.class = null
aws.secret.access.key = [hidden]
s3.api.call.attempt.timeout = null
s3.api.call.timeout = null
s3.bucket.name = [hidden]
s3.endpoint.url = null
s3.multipart.upload.part.size = 5242880
s3.path.style.access.enabled = null
s3.region = ap-southeast-2
(org.apache.kafka.common.config.AbstractConfig)
```

errors logs: https://gist.github.com/showuon/8ff9e18b062c7392c6e2b189f045dc3f

# What did you expect to happen?

No error logs.

# What else do we need to know?

N/A

コントリビューションガイド

コントリビューションガイドを開く

評価

この issue はまだ評価されていません。

新しい issue をメールで受け取る

初心者向けの GitHub issue を短くまとめたダイジェスト。