Spark 3.x
Abierto
Epic
priority: high
- Lenguaje dominante
- Scala
- Estrellas
- 33
- Forks
- 16
- Métricas de merge de PR
- Sin PR fusionados en 30 d
Descripción
## Background
We need to move on higher version of Spark
## Goal
Making Enceladus working with Spark 3.0
## Expected Task List [Optional]
A list of expected issues that will be needed to achieve this Epic
1. Figure out dependencies are ready
2. Cross-compilation for Scala 2.11 and 2.12
3. How it will work on prem? Spark 3 with Hadoop 2
**NB! Don't forget to assign the Epic into a Milestone**
Guía de contribución
Línea de trabajo
Start by checking whether the dependencies support Spark 3.0, then investigate cross-compilation for Scala 2.11 and 2.12. Review how Spark 3.0 should run on-premises with Hadoop 2. Done means Enceladus works with Spark 3.0 across the required Scala versions and deployment environment.
Escrito por el modelo de indexación a partir del texto del issue.
Evaluación
- Stack tecnológico
- hadoop, scala, spark
- Área
- data-engineering, distributed-systems
- Tipo de issue
- Nueva funcionalidad
- Dificultad
- 5/5
- Tiempo estimado
- Más de una semana
- Estado de actividad
- Estancado
- Claridad
- Bastante claro
- Aptitud para principiantes
- 20/100