Add options to control caching in Spark Jobs
Ouverte
Conformance
feature
priority: undecided
Standardization
under discussion
- Langage dominant
- Scala
- Étoiles
- 33
- Forks
- 16
- Métriques de merge des PR
- Aucune PR mergée en 30 j
Description
## Background
Currently, Standardization and Conformance uses the default caching strategy (provided by `df.cache()`). For some jobs (very big files), different cache modes may be preferrable, including turning off cache altogether.
## Feature
Add an option to Standardization and Conformance to control cache strategy. One of the strategies should be no caching at all.
Guide de contribution
Ouvrir le guide de contribution
Évaluation
Cette issue n'a pas encore été évaluée.