stackabletech / stackabletech/spark-k8s-operator
Document python requirements install will not work in offline cluster
Nobody has claimed this yet.
- Dominant language
- Rust
- Stars
- 72
- Forks
- 4
- Avg merge
- 2d 15h
- Merged PRs (30d)
- 15
Description
We do a pip install in the requirements container https://github.com/stackabletech/spark-k8s-operator/blob/2113e1cfc5309ec0ea6594c266c0d4fa25f0abd9/rust/operator-binary/src/spark_k8s_controller.rs#L185.
We should document that if pip requirements are given, this will not work in offline mode somewhere here https://github.com/stackabletech/spark-k8s-operator/blob/main/docs/modules/spark-k8s/pages/job_dependencies.adoc#spark-native-package-coordinates-and-python-requirements
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Read docs/modules/spark-k8s/pages/job_dependencies.adoc at the section on Spark-native package coordinates and Python requirements, then check the pip install path in rust/operator-binary/src/spark_k8s_controller.rs around line 185. Done means the documentation clearly states that supplying pip requirements does not work in offline mode.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python, rust
- Domain
- documentation
- Issue type
- Documentation
- Difficulty
- 1/5
- Estimated time
- Under an hour
- Activity status
- Stale
- Clarity
- Clearly specified
- Newbie friendliness
- 50/100