cube-js / cube-js/cube

Randomly receive S3 error from CubeStore when building pre-aggregation data

Open
#4,473 22 comments 4 reactions 2 assignees Claimed by @igorlukanin View on GitHub
docs
Dominant language
Rust
Stars
20.8k
Forks
2.1k
Avg merge
1d 2h
Merged PRs (30d)
181

Description

**Describe the bug**

When the refresh worker builds pre-aggregation data from source Athena and store them to CubeStore. We randomly receive the below error:

```
statusCode: 400, type: , msg: Error: Error during create table: CREATE TABLE prod_pre_aggregations.inspection_rollup_main20210601_d0of0vji_lbon14ip_1h6m94u (`inspection__author_id` varchar(255), `inspection__organisation_id` varchar(255), `inspection__owner_id` varchar(255), `inspection__site_id` varchar(255), `inspection__status` int, `inspection__template_id` varchar(255), `inspection__conducted_at_day` timestamp, `inspection__count` bigint, `inspection__count_duration` bigint, `inspection__count_score` bigint, `inspection__duration_sum` real, `inspection__score_percentage_sum` real) WITH (input_format = 'csv_no_header') LOCATION ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?: User: Create table failed: Internal: AWS S3 error: custom: missing field `Bucket`
```

**To Reproduce**
1. Use Athena as the data source
2. Enable pre-aggregation & scheduled refresh workers
3. Receive AWS S3 error from CubeStore randomly

**Expected behavior**
There should be no error from CubeStore.

**Screenshots**
If applicable, add screenshots to help explain your problem.

**Minimally reproducible Cube Schema**
N/A

**Version:**
[0.29.28]

**Additional context**
Add any other context about the problem here.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.