Azure / Azure/azure-quickstart-templates

spark-on-ubuntu broken: can't find storage account

Open
#2,333 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Bicep
Stars
14.9k
Forks
16.2k
Avg merge
6d 21h
Merged PRs (30d)
6

Description

[Template Name goes here](Template link goes here)
### Issue Details

Here is my parameters.json:

azuredeploy.parameters.json

``` json
{
"$schema": "http://schema.management.azure.com/schemas/2015-01-01/deploymentParameters.json#",
"contentVersion": "1.0.0.0",
"parameters": {
"adminUsername": {
"value": "alp"
},
"adminPassword": {
"value": "...."
},
"virtualNetworkName": {
"value": "sparkClustVnet"
},
"subnetName": {
"value": "Subnet1"
},
"addressPrefix": {
"value": "10.0.0.0/16"
},
"subnetPrefix": {
"value": "10.0.0.0/24"
},
"sparkVersion": {
"value": "1.3.0"
},
"sparkClusterName": {
"value": "spark-cluster-ahmet"
},
"sparkNodeIPAddressPrefix": {
"value": "10.0.0.1"
},
"sparkSlaveNodeIPAddressPrefix": {
"value": "10.0.0.3"
},
"jumpbox": {
"value": "enabled"
},
"tshirtSize": {
"value": "S"
}
}
}
```

I get an error after a few resources are deployed, saying storage account is not found. But it is actually there and created at least 1-2 minutes ago before I got an error.

@CognosysTech any ideas?

```
info: Resource 'nicsl0' of type 'Microsoft.Network/networkInterfaces' provisioning status is Succeeded
info: Resource 'jumpbox-resources' of type 'Microsoft.Resources/deployments' provisioning status is Succeeded
info: Resource 'jumpbox' of type 'Microsoft.Compute/virtualMachines' provisioning status is Succeeded
info: Resource 'nicJumpbox' of type 'Microsoft.Network/networkInterfaces' provisioning status is Succeeded
info: Resource 'publicIP' of type 'Microsoft.Network/publicIPAddresses' provisioning status is Succeeded
info: Resource 'nvzyelldwrqtustorage' of type 'Microsoft.Storage/storageAccounts' provisioning status is Succeeded
info: Resource 'nic0' of type 'Microsoft.Network/networkInterfaces' provisioning status is Succeeded
info: Resource 'shared-resources' of type 'Microsoft.Resources/deployments' provisioning status is Succeeded
info: Resource 'sparkCluserAS' of type 'Microsoft.Compute/availabilitySets' provisioning status is Succeeded
info: Resource 'sparkClustVnet' of type 'Microsoft.Network/virtualNetworks' provisioning status is Succeeded

error: Deployment provisioning state was not successful
error: The Resource 'Microsoft.Storage/storageAccounts/nvzyelldwrqtustorage'
under resource group 'ahmet-test1' was not found.
data: DeploymentName : azuredeploy
data: ResourceGroupName : ahmet-test1
data: ProvisioningState : Failed
data: Timestamp : 2016-08-10T21:33:22.408Z
data: Mode : Incremental
data: CorrelationId : 6f2b5327-17be-4ec5-b15f-7f113a728233
data: DeploymentParameters :
data: Name Type Value
data: ----------------------------- ------------ -------------------
data: adminUsername String alp
data: adminPassword SecureString undefined
data: imagePublisher String Canonical
data: imageOffer String UbuntuServer
data: imageSKU String 14.04.2-LTS
data: virtualNetworkName String sparkClustVnet
data: addressPrefix String 10.0.0.0/16
data: subnetName String Subnet1
data: subnetPrefix String 10.0.0.0/24
data: sparkVersion String 1.3.0
data: sparkClusterName String spark-cluster-ahmet
data: sparkNodeIPAddressPrefix String 10.0.0.1
data: sparkSlaveNodeIPAddressPrefix String 10.0.0.3
data: jumpbox String enabled
data: tshirtSize String S
info: group deployment create command OK
```

> ![image](https://cloud.githubusercontent.com/assets/159209/17572108/d7ae78ee-5f07-11e6-87dc-0cb7bc7f782c.png)
>
> ![image](https://cloud.githubusercontent.com/assets/159209/17572175/04a81620-5f08-11e6-821c-d9a23c24fda7.png)

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by locating the Spark-on-Ubuntu template referenced by the issue and reproduce the deployment with the supplied azuredeploy.parameters.json values. Trace the dependency between the Microsoft.Storage/storageAccounts resource and the Spark deployment, and consider the issue done when the template deploys successfully without the storage account not-found error.

Written by the indexing model from the issue text.

Assessment

Tech stack
azure, spark
Domain
cloud, infrastructure
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.