OvertureMaps / OvertureMaps/schema
PySpark test suite is not self-contained
Open
@sethfitz is already working on this.
Since Jul 22, 2026.
- Dominant language
- Python
- Stars
- 213
- Forks
- 22
- Avg merge
- 3d 3h
- Merged PRs (30d)
- 31
Description
Summary
The uv workspace is meant to give an identical, reproducible test environment,
but the PySpark test suite depends on machine env state in two ways:
- Spark/JVM configuration leaks in from the shell.
SPARK_HOMEand a
family of related variables are honored by PySpark's launcher and the JVM,
so a system-wide Spark install or exported JVM flags change or break
every test session. - The JVM itself is not part of the venv. The
pysparkwheel bundles
Spark's jars and launcher scripts but no Java runtime; the tests silently
rely on whateverjavathe machine resolves.
Both are the same underlying problem: the uv venv does not fully own the test
runtime.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.