ClickHouse / ClickHouse/ClickHouse

Very Broad Permissions Requirement in 'Integrating S3 with ClickHouse'

Open
#84,357 0 comments 1 reaction 0 assignees View on GitHub
comp-documentation external
Dominant language
C++
Stars
49.9k
Forks
9k
Avg merge
21h 32m
Merged PRs (30d)
515

Description

### Company or project name

_No response_

### Describe the issue

In the following doc https://clickhouse.com/docs/integrations/s3#configuring-s3-for-clickhouse-use
While setting up s3 with correct permissions, we see that the suggested IAM policy has broad * permissions requirement.

```
"Action" : "s3:*",
```

While there is mention of following.
> You should work with your security team to determine the permissions to be used, consider these as a starting point.

There is no documentation on what features of Clickhouse requires what privileges. While adding such a disk for clickhouse cold storage policy, I saw this error in server start.

```
Cannot print extra info for Poco::Exception (version 25.3.1.2703 (official build))
2025.07.24 09:15:46.976958 [ 1 ] {} Application: std::exception. Code: 1001, type: std::__1::filesystem::filesystem_error, e.what() = filesystem error: in cre
ate_directories: Permission denied ["/var/lib/clickhouse/disks/some_backup"], Stack trace (when copying this message, always include the lines below):
0. std::system_error::system_error(std::error_code, String const&) @ 0x00000000176bc81c
1. std::filesystem::filesystem_error::filesystem_error[abi:ne190107](String const&, std::filesystem::path const&, std::error_code) @ 0x000000000d5dc92c
2. void std::filesystem::__throw_filesystem_error[abi:ne190107](String&, std::filesystem::path const&,
std::error_code const&) @ 0x000000001767741c
3. std::filesystem::detail::ErrorHandler::report(std::error_code const&) const @ 0x000000001767a1c4
4. std::filesystem::__create_directories(std::filesystem::path const&, std::error_code*) @ 0x000000001767a9b4
5. std::filesystem::__create_directories(std::filesystem::path const&, std::error_code*) @ 0x000000001767a980
```

It would be exceedingly painful to derive this from hit and trial. hence would request the required privileges since that would be known to core dev team

### Additional context

_No response_

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.