4paradigm / 4paradigm/OpenMLDB

Do not package Python library for OpenMLDB Spark distribution

Open
#1,352 1 comment 0 reactions 1 assignee Claimed by @tobegit3hub View on GitHub
enhancement
Dominant language
C++
Stars
1.7k
Forks
331
Avg merge
12d 12h
Merged PRs (30d)
1

Description

Now the pacakge command will package Python files which make release file large.

```
./dev/make-distribution.sh --name openmldbspark --tgz -Phadoop-2.7 -Pyarn -Pallinone
```

Contributor guide

Open the contributing guide

Research direction

The issue points to the distribution script at `./dev/make-distribution.sh`. Examine this script to understand how Python files are included in the packaging. Look for sections that handle Python dependencies or packaging steps. The goal is to modify the script to exclude Python library files, reducing the final release tarball size. Test by running the provided command and verifying the output size.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, shell, spark
Domain
build-system, release
Issue type
Refactor
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Stale
Clarity
Clearly specified
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.