ERROR [cubestore::remotefs::cleanup] error while getting created time for file - creation time is not available for the filesystem
- Dominant language
- Rust
- Stars
- 20.8k
- Forks
- 2.1k
- Avg merge
- 1d 2h
- Merged PRs (30d)
- 181
Description
**Describe the bug**
While the Refresh Worker is performing pre-aggregations, we get multiple of this error
ERROR [cubestore::remotefs::cleanup] error while getting created time for file "919-sgnl1jjo.parquet":creation time is not available for the filesystem
For every intermediary file created by the pre-aggregation process, CUBESTORE is also performing cleanup of these files. It is failing to purge these files due to this issue - Creation time is not available for the filesystem.
**To Reproduce**
Steps to reproduce the behavior:
1. Run Docker containers as following
Start the container for Router in VM1
Start the container for Worker1 in VM2
Start the container for Worker2 in VM3
Start the container for RefreshWorker in VM2
Start the container for API in VM3
2. The Router, Worker1, Worker2 is configured with the CUBESTORE_REMOTE_DIR to /cube/remote, and a shared network monted volume //data as /cube/remote for these containers
3. Pre-aggregations are automatically started, and after sometime we can start to see the the temporary files were not cleaned up due to this error.
**Expected behavior**
These files are successfully cleaned up by the [cubestore::remotefs::cleanup] process.
**Version:**
Docker image cube/cubestore:latest
**Additional context**
Is it safe to clear these files manually ? Also, Are we missing any additional parameters to be set while starting up the RefreshWorker the job ?
Contributor guide
Assessment
This issue has not been assessed yet.