Azure / Azure/azure-quickstart-templates
spark-on-ubuntu broken: can't find storage account
- Dominant language
- Bicep
- Stars
- 14.9k
- Forks
- 16.2k
- Avg merge
- 6d 21h
- Merged PRs (30d)
- 6
Description
[Template Name goes here](Template link goes here)
### Issue Details
Here is my parameters.json:
azuredeploy.parameters.json
``` json
{
"$schema": "http://schema.management.azure.com/schemas/2015-01-01/deploymentParameters.json#",
"contentVersion": "1.0.0.0",
"parameters": {
"adminUsername": {
"value": "alp"
},
"adminPassword": {
"value": "...."
},
"virtualNetworkName": {
"value": "sparkClustVnet"
},
"subnetName": {
"value": "Subnet1"
},
"addressPrefix": {
"value": "10.0.0.0/16"
},
"subnetPrefix": {
"value": "10.0.0.0/24"
},
"sparkVersion": {
"value": "1.3.0"
},
"sparkClusterName": {
"value": "spark-cluster-ahmet"
},
"sparkNodeIPAddressPrefix": {
"value": "10.0.0.1"
},
"sparkSlaveNodeIPAddressPrefix": {
"value": "10.0.0.3"
},
"jumpbox": {
"value": "enabled"
},
"tshirtSize": {
"value": "S"
}
}
}
```
I get an error after a few resources are deployed, saying storage account is not found. But it is actually there and created at least 1-2 minutes ago before I got an error.
@CognosysTech any ideas?
```
info: Resource 'nicsl0' of type 'Microsoft.Network/networkInterfaces' provisioning status is Succeeded
info: Resource 'jumpbox-resources' of type 'Microsoft.Resources/deployments' provisioning status is Succeeded
info: Resource 'jumpbox' of type 'Microsoft.Compute/virtualMachines' provisioning status is Succeeded
info: Resource 'nicJumpbox' of type 'Microsoft.Network/networkInterfaces' provisioning status is Succeeded
info: Resource 'publicIP' of type 'Microsoft.Network/publicIPAddresses' provisioning status is Succeeded
info: Resource 'nvzyelldwrqtustorage' of type 'Microsoft.Storage/storageAccounts' provisioning status is Succeeded
info: Resource 'nic0' of type 'Microsoft.Network/networkInterfaces' provisioning status is Succeeded
info: Resource 'shared-resources' of type 'Microsoft.Resources/deployments' provisioning status is Succeeded
info: Resource 'sparkCluserAS' of type 'Microsoft.Compute/availabilitySets' provisioning status is Succeeded
info: Resource 'sparkClustVnet' of type 'Microsoft.Network/virtualNetworks' provisioning status is Succeeded
error: Deployment provisioning state was not successful
error: The Resource 'Microsoft.Storage/storageAccounts/nvzyelldwrqtustorage'
under resource group 'ahmet-test1' was not found.
data: DeploymentName : azuredeploy
data: ResourceGroupName : ahmet-test1
data: ProvisioningState : Failed
data: Timestamp : 2016-08-10T21:33:22.408Z
data: Mode : Incremental
data: CorrelationId : 6f2b5327-17be-4ec5-b15f-7f113a728233
data: DeploymentParameters :
data: Name Type Value
data: ----------------------------- ------------ -------------------
data: adminUsername String alp
data: adminPassword SecureString undefined
data: imagePublisher String Canonical
data: imageOffer String UbuntuServer
data: imageSKU String 14.04.2-LTS
data: virtualNetworkName String sparkClustVnet
data: addressPrefix String 10.0.0.0/16
data: subnetName String Subnet1
data: subnetPrefix String 10.0.0.0/24
data: sparkVersion String 1.3.0
data: sparkClusterName String spark-cluster-ahmet
data: sparkNodeIPAddressPrefix String 10.0.0.1
data: sparkSlaveNodeIPAddressPrefix String 10.0.0.3
data: jumpbox String enabled
data: tshirtSize String S
info: group deployment create command OK
```
> 
>
> 
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by locating the Spark-on-Ubuntu template referenced by the issue and reproduce the deployment with the supplied azuredeploy.parameters.json values. Trace the dependency between the Microsoft.Storage/storageAccounts resource and the Spark deployment, and consider the issue done when the template deploys successfully without the storage account not-found error.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- azure, spark
- Domain
- cloud, infrastructure
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100