Azure / Azure/azureml-examples

Missing explanations to Spark Context

Open
#950 0 comments 1 reaction 0 assignees View on GitHub
example issue
Dominant language
Jupyter Notebook
Stars
2k
Forks
1.7k
Avg merge
18h 18m
Merged PRs (30d)
2

Description

example: https://github.com/Azure/azureml-examples/blob/main/python-sdk/tutorials/automl-with-databricks/automl-databricks-local-with-deployment.ipynb
description: The notebook uses `sc` as the spark context, but does not explain or show how that is supposed to be created or where it is coming from. My guess is that this would be the SparkContext class as an object from `pyspark` but it would be useful to spell it out.

## Additional context
Although not the responsibility of this repo, [the docs are pointing back](https://docs.microsoft.com/en-us/azure/machine-learning/how-to-configure-databricks-automl-environment) to these notebooks which are referenced as _"the only notebooks that work with Azure Databaricks"_

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.