Add options to control caching in Spark Jobs
Abierto
Conformance
feature
priority: undecided
Standardization
under discussion
- Lenguaje dominante
- Scala
- Estrellas
- 33
- Forks
- 16
- Métricas de merge de PR
- Sin PR fusionados en 30 d
Descripción
## Background
Currently, Standardization and Conformance uses the default caching strategy (provided by `df.cache()`). For some jobs (very big files), different cache modes may be preferrable, including turning off cache altogether.
## Feature
Add an option to Standardization and Conformance to control cache strategy. One of the strategies should be no caching at all.
Guía de contribución
Evaluación
Este issue todavía no se ha evaluado.