Randomly receive S3 error from CubeStore when building pre-aggregation data
- Dominant language
- Rust
- Stars
- 20.8k
- Forks
- 2.1k
- Avg merge
- 1d 2h
- Merged PRs (30d)
- 181
Description
**Describe the bug**
When the refresh worker builds pre-aggregation data from source Athena and store them to CubeStore. We randomly receive the below error:
```
statusCode: 400, type: , msg: Error: Error during create table: CREATE TABLE prod_pre_aggregations.inspection_rollup_main20210601_d0of0vji_lbon14ip_1h6m94u (`inspection__author_id` varchar(255), `inspection__organisation_id` varchar(255), `inspection__owner_id` varchar(255), `inspection__site_id` varchar(255), `inspection__status` int, `inspection__template_id` varchar(255), `inspection__conducted_at_day` timestamp, `inspection__count` bigint, `inspection__count_duration` bigint, `inspection__count_score` bigint, `inspection__duration_sum` real, `inspection__score_percentage_sum` real) WITH (input_format = 'csv_no_header') LOCATION ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?: User: Create table failed: Internal: AWS S3 error: custom: missing field `Bucket`
```
**To Reproduce**
1. Use Athena as the data source
2. Enable pre-aggregation & scheduled refresh workers
3. Receive AWS S3 error from CubeStore randomly
**Expected behavior**
There should be no error from CubeStore.
**Screenshots**
If applicable, add screenshots to help explain your problem.
**Minimally reproducible Cube Schema**
N/A
**Version:**
[0.29.28]
**Additional context**
Add any other context about the problem here.
Contributor guide
Assessment
This issue has not been assessed yet.