Error[Failed to launch livy session, session status is dead] on connecting to spark through livy using R

I am using sparklyr version [1.7.8](https://github.com/sparklyr/sparklyr)
and latest livy version in master branch [incubator-livy](https://github.com/apache/incubator-livy)

On connecting to spark through livy using R

> library(sparklyr)
> sc <- spark_connect(master = "local", method = "livy", version ="3.1.1")

Command is throwing an error:

> Error in livy_connection(master, config, app_name, version, hadoop_version, :
> Failed to launch livy session, session status is dead

Could anyone please help me understand what could the issue be.

Start by reproducing the sparklyr 1.7.8 connection command against Livy master with Spark 3.1.1, then trace why the Livy session reaches the dead state. Done means identifying the configuration or compatibility cause and confirming a successful R connection to Spark.

Written by the indexing model from the issue text.