apache / apache/gluten

Make Gluten project size small

Open
#4,976 3 comments 1 reaction 0 assignees View on GitHub
enhancement
Dominant language
Scala
Stars
1.6k
Forks
657
Avg merge
2d 14h
Merged PRs (30d)
80

Description

### Description

It now contains 257MB even if we clone the latest commit
`git clone --depth 1 https://github.com/apache/incubator-gluten.git`

the biggest directories are:
```
27M ./docs/image/gluten_golden_file_upload.png
29M ./gluten-core/src/test/resources/tpch-data
30M ./backends-clickhouse/src/test/resources/tpch-data-bucket/parquet_bucket
40M ./gluten-celeborn/clickhouse/src/test/resources/tpch-data-ch
```

I think we can unify the test data and reduce some unnecessary image size.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.