{”msg”:“Rejected, Reason: Blacklisted configuration values in session config: spark.submit.deployMode”}
- Dominant language
- Scala
- Stars
- 963
- Forks
- 625
- Avg merge
- 6d 21h
- Merged PRs (30d)
- 6
Description
spark version 3.5.1
livy version. 0.8.0
Requesting through the Api gets the following return
org.springframework.web.client.HttpClientErrorException$BadRequest: 400 Bad Request: "{"msg":"Rejected, Reason: Blacklisted configuration values in session config: spark.submit.deployMode"}"
But I don't see any error reported in the logs, is it incompatible with spark 3.5.1
BTW, I also set up`conf/spark-blacklist.conf` and it doesn't seem to be taking effect
Contributor guide
No contributing guide indexed for this repository
Research direction
Start with the API request that rejects spark.submit.deployMode and inspect how conf/spark-blacklist.conf is loaded and applied. Compare the configured blacklist with the rejection response and verify the behavior using the relevant logs or a repeated API request.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- scala, spark
- Domain
- api, backend, security
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100