snowflakedb / snowflakedb/snowpark-python
SNOW-651322: Snowpark with Pandas as a Lambda layer - Library size issues
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 341
- Forks
- 155
- Avg merge
- 4d 16h
- Merged PRs (30d)
- 27
Description
What is the current behavior?
I need to add "Snowpark with Pandas" as an AWS Lambda layer, however the size of the python lib goes above 250MB so i can not use it.
What is the desired behavior?
Please give a trim down version of the library so size of the python lib stays below 250MB
How would this improve snowflake-snowpark-python?
Please give a trim down version of the library so size of the python lib stays below 250MB
References, Other Background
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reproducing the Snowpark with Pandas AWS Lambda packaging described in the issue and measuring the Python library against the 250 MB limit. No files or tests are named, so identify the packaging entry points and determine the scope of a trimmed library. Done means a defined Snowpark/Pandas package remains below 250 MB for Lambda use.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- aws, pandas, python
- Domain
- cloud, data-engineering
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100