apache / apache/datafusion

Running tests uses 50.1GB of disk space on Ubuntu

Open
#11,105 7 comments 1 reaction 0 assignees View on GitHub
bug
Dominant language
Rust
Stars
9.3k
Forks
2.4k
Avg merge
3d 7h
Merged PRs (30d)
344

Description

### Describe the bug

I just cloned datafusion and tried `cargo t` on my ubuntu desktop, to check things were working properly.

It crashed.

I restarted, and it seems datafusion is using 50.1GB to just run tests.

The `examples` directory seems to be the biggest culpret.

![image](https://github.com/apache/datafusion/assets/4039449/abe755ab-44a2-4b41-bbfa-c98ce28bd8b2)

### To Reproduce

Just clone and run `cargo t` on Ubuntu (no idea if this is limited to linux).

### Expected behavior

Humm, I guess in principle this isn't a show stopper, but seems somewhat unfortunate.

If there's an easy/low impact way to reduce disk usage, it might be useful.

### Additional context

_No response_

Contributor guide

Open the contributing guide

Research direction

Start by cloning DataFusion on Ubuntu and reproducing the issue with `cargo t`, then inspect disk usage with particular attention to the `examples` directory mentioned in the report. Compare which test-related artifacts consume space and verify that any reduction preserves successful test execution without the reported excessive usage.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
build-system, testing
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
42/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.