Azure / Azure/azureml-examples
Missing explanations to Spark Context
- Dominant language
- Jupyter Notebook
- Stars
- 2k
- Forks
- 1.7k
- Avg merge
- 18h 18m
- Merged PRs (30d)
- 2
Description
example: https://github.com/Azure/azureml-examples/blob/main/python-sdk/tutorials/automl-with-databricks/automl-databricks-local-with-deployment.ipynb
description: The notebook uses `sc` as the spark context, but does not explain or show how that is supposed to be created or where it is coming from. My guess is that this would be the SparkContext class as an object from `pyspark` but it would be useful to spell it out.
## Additional context
Although not the responsibility of this repo, [the docs are pointing back](https://docs.microsoft.com/en-us/azure/machine-learning/how-to-configure-databricks-automl-environment) to these notebooks which are referenced as _"the only notebooks that work with Azure Databaricks"_
Contributor guide
Assessment
This issue has not been assessed yet.