Investigate perf improvements using NVidia plugin

To utilise the NVidia GPU, use:

```
"runArgs": [
"--gpus",
"all"
],
```

in the devcontainer,

and then:

```
builder = (
SparkSession.builder.appName(workload_name)
.master("local[*]")
...
.config("spark.plugins", "com.nvidia.spark.SQLPlugin")
)

extra_packages = ["com.nvidia:rapids-4-spark_2.12:24.06.0"]

spark = configure_spark_with_delta_pip(builder, extra_packages=extra_packages).getOrCreate()
```