InseeFrLab / InseeFrLab/helm-charts-interactive-services

spark submit et variables S3 : spark.hadoop.fs.*

Open
#81 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Mustache
Stars
21
Forks
35
Avg merge
1m
Merged PRs (30d)
1

Description

Hello,

we should duplicate all variables fs.* existing in our core-site.xml and put them into spark-default.conf.
For launching application via spark-submit it will help

Contributor guide

Open the contributing guide

Research direction

Locate the chart templates or configuration files that render core-site.xml and spark-default.conf. Compare the existing fs.* variables in core-site.xml with the Spark configuration used by spark-submit, then verify that the corresponding spark.hadoop.fs.* settings are present in spark-default.conf.

Written by the indexing model from the issue text.

Assessment

Tech stack
spark
Domain
devops, infrastructure
Issue type
Feature
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.