CSCfi / CSCfi/spark-openshift

cannot unmarshal string into Go struct field DeploymentConfigSpec.spec.replicas of type int32

Open
#22 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Dockerfile
Stars
9
Forks
9
PR merge metrics
No merged PRs in 30d

Description

I'm getting below error message. I see that jupyter-notebook and spark-master were created but no worker was created in OpenShift. Thanks in advanced!

```
$ oc process -f spark-template.yml -p CLUSTER_NAME=sample-etl -p USERNAME=johndoe -p PASSWORD=$(oc whoami -t) -p WORKER_REPLICAS=1 | oc apply -f -
persistentvolumeclaim/sample-etl-pvc created
secret/sample-etl-secret created
configmap/sample-etl-nginx-config-spark created
configmap/sample-etl-nginx-config-jupyter created
configmap/sample-etl-jupyter-notebook-config created
service/sample-etl-spark-master created
service/sample-etl-spark-master-ui created
service/sample-etl-jupyter-notebook created
route.route.openshift.io/sample-etl-spark-master-route created
route.route.openshift.io/sample-etl-jupyter-notebook-route created
deploymentconfig.apps.openshift.io/sample-etl-spark-master created
deploymentconfig.apps.openshift.io/sample-etl-jupyter-notebook created
Error from server (BadRequest): error when creating "STDIN": DeploymentConfig in version "v1" cannot be handled as a DeploymentConfig: json: cannot unmarshal string into Go struct field DeploymentConfigSpec.spec.replicas of type int32
```

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with spark-template.yml and run the supplied oc process ... | oc apply -f - command in an OpenShift environment. Trace the WORKER_REPLICAS value into the DeploymentConfig definition and compare it with the reported replicas type error. Done means the worker DeploymentConfig is accepted and a worker is created.

Written by the indexing model from the issue text.

Assessment

Tech stack
jupyter-notebook, spark
Domain
infrastructure
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.