Spark 3.x
- Langage dominant
- Scala
- Étoiles
- 33
- Forks
- 16
- Métriques de merge des PR
- Aucune PR mergée en 30 j
Description
## Background
We need to move on higher version of Spark
## Goal
Making Enceladus working with Spark 3.0
## Expected Task List [Optional]
A list of expected issues that will be needed to achieve this Epic
1. Figure out dependencies are ready
2. Cross-compilation for Scala 2.11 and 2.12
3. How it will work on prem? Spark 3 with Hadoop 2
**NB! Don't forget to assign the Epic into a Milestone**
Guide de contribution
Ouvrir le guide de contribution
Piste de recherche
Start by checking whether the dependencies support Spark 3.0, then investigate cross-compilation for Scala 2.11 and 2.12. Review how Spark 3.0 should run on-premises with Hadoop 2. Done means Enceladus works with Spark 3.0 across the required Scala versions and deployment environment.
Rédigé par le modèle d'indexation à partir du texte de l'issue.
Évaluation
- Stack technique
- hadoop, scala, spark
- Domaine
- data-engineering, distributed-systems
- Type d'issue
- Fonctionnalité
- Difficulté
- 5/5
- Temps estimé
- Plus d'une semaine
- Activité
- À l'abandon
- Clarté
- Plutôt claire
- Accessibilité débutants
- 20/100