GoogleCloudPlatform / GoogleCloudPlatform/training-data-analyst
gcloud SDK, a better solution reproducible environmental variables?
- Dominant language
- Jupyter Notebook
- Stars
- 8.6k
- Forks
- 6.1k
- Avg merge
- 4h 44m
- Merged PRs (30d)
- 2
Description
I've been doing the
> Machine Learning with TensorFlow on Google Cloud Platform
course on coursera. While working through labs in the course, I have noticed that the strategies for configuring the gcloud sdk are not very robust. Perhaps it is because they are intended to be run on GCP in datalab, but I like doing them on my computer or VMs: datalab itself has been showing non-responsive UI, which may be caused poor network latency, or my persistent use of firefox.
Anyhow, moving onward, there doesn't seem to be a place in the documentation with an advised way of automating the setup of a GCP config, and I have broke quite a few gcloud configurations by running scripts like the one [here](https://github.com/GoogleCloudPlatform/training-data-analyst/blob/master/courses/machine_learning/feateng/feateng.ipynb). It changes the project id, bucket and region in my currently open config. These configurations are proving quite tedious to keep an eye on.
I know terraform and other devops tools offer partial solutions, but this really feels like something that should be native. Does anyone have suggestions on how we could improve the scripts used for setting up GCP environmental variables to stop them from being set on-top of existing configs, but to use a temporary one that belongs exclusively to the script?
Perhaps it is possible to set all of these variables with the python api, and avoid changing any of the configs that are used for bash calls.
Contributor guide
Assessment
This issue has not been assessed yet.