apache / apache/livy

{”msg”:“Rejected, Reason: Blacklisted configuration values in session config: spark.submit.deployMode”}

Open
#441 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Scala
Stars
963
Forks
625
Avg merge
6d 21h
Merged PRs (30d)
6

Description

spark version 3.5.1
livy version. 0.8.0

Requesting through the Api gets the following return

org.springframework.web.client.HttpClientErrorException$BadRequest: 400 Bad Request: "{"msg":"Rejected, Reason: Blacklisted configuration values in session config: spark.submit.deployMode"}"

But I don't see any error reported in the logs, is it incompatible with spark 3.5.1

BTW, I also set up`conf/spark-blacklist.conf` and it doesn't seem to be taking effect

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the API request that rejects spark.submit.deployMode and inspect how conf/spark-blacklist.conf is loaded and applied. Compare the configured blacklist with the rejection response and verify the behavior using the relevant logs or a repeated API request.

Written by the indexing model from the issue text.

Assessment

Tech stack
scala, spark
Domain
api, backend, security
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.