Add options to control caching in Spark Jobs
Offen
Conformance
feature
priority: undecided
Standardization
under discussion
- Vorherrschende Sprache
- Scala
- Sterne
- 33
- Forks
- 16
- PR-Merge-Kennzahlen
- Keine gemergten PRs in 30 T.
Beschreibung
## Background
Currently, Standardization and Conformance uses the default caching strategy (provided by `df.cache()`). For some jobs (very big files), different cache modes may be preferrable, including turning off cache altogether.
## Feature
Add an option to Standardization and Conformance to control cache strategy. One of the strategies should be no caching at all.
Beitragsleitfaden
Bewertung
Dieses Issue wurde noch nicht bewertet.