Azure / Azure/azure-quickstart-templates
"VM has reported a failure when processing extension 'installsparkmaster'. Error message: \"Enable failed: failed to execute command: command terminated with exit status=127\"."
- Dominant language
- Bicep
- Stars
- 14.9k
- Forks
- 16.2k
- Avg merge
- 6d 21h
- Merged PRs (30d)
- 6
Description
--------------------MESSAGE FROM ADMIN, DELETE BEFORE SUBMITTING----------------------
Sorry to hear you had a bad experience with one of the templates :worried: But, in case you're just asking a question, we're happy to help. You can also check if the question might already have been asked here https://github.com/Azure/azure-quickstart-templates/issues?utf8=%E2%9C%93&q=is%3Aissue
We've created an outline of recommended sections to fill out that will help make this Pull Request awesome!
--------------------MESSAGE FROM ADMIN, DELETE BEFORE SUBMITTING----------------------
[Template Name goes here](Template link goes here)
### Issue Details
Followed the steps and was able to create VMs (jumpbox, master, slaves) but the custom install script is failing.
### Repro steps (*if necessary, delete otherwise*)
1. New-AzureRmResourceGroup -Name "azureSparkCluster" -Location 'West US 2'
2. Login to azure and create the resource group and create a Storage Account with a unique name.
3. Put that Storage Account name inside shared-resources.json and jumpbox-resources.json
4. New-AzureRmResourceGroupDeployment -Name azureSparkClusterDep1 -ResourceGroupName "azureSparkCluster" -TemplateFile C:\userName\SparkOnUbuntuAzure\Customized\azuredeploy.json -TemplateParameterFile C:\username\SparkOnUbuntuAzure\Customized\azuredeploy-parameters.json -Verbose
5. Result attached below
New-AzureRmResourceGroupDeployment : 11:35:06 PM - Resource Microsoft.Compute/virtualMachines/extensions 'slavevm0/installsparkslave' failed with
message '{
"status": "Failed",
"error": {
"code": "ResourceDeploymentFailure",
"message": "The resource operation completed with terminal provisioning state 'Failed'.",
"details": [
{
"code": "VMExtensionProvisioningError",
"message": "VM has reported a failure when processing extension 'installsparkslave'. Error message: \"Enable failed: failed to execute
command: command terminated with exit status=127\"."
}
]
}
}'
At line:1 char:1
+ New-AzureRmResourceGroupDeployment -Name azureSparkClusterDep1 -Resou ...
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
+ CategoryInfo : NotSpecified: (:) [New-AzureRmResourceGroupDeployment], Exception
+ FullyQualifiedErrorId : Microsoft.Azure.Commands.ResourceManager.Cmdlets.Implementation.NewAzureResourceGroupDeploymentCmdlet
New-AzureRmResourceGroupDeployment : 11:35:07 PM - VM has reported a failure when processing extension 'installsparkslave'. Error message: "Enable
failed: failed to execute command: command terminated with exit status=127".
At line:1 char:1
+ New-AzureRmResourceGroupDeployment -Name azureSparkClusterDep1 -Resou ...
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
+ CategoryInfo : NotSpecified: (:) [New-AzureRmResourceGroupDeployment], Exception
+ FullyQualifiedErrorId : Microsoft.Azure.Commands.ResourceManager.Cmdlets.Implementation.NewAzureResourceGroupDeploymentCmdlet
New-AzureRmResourceGroupDeployment : 11:35:07 PM - Template output evaluation skipped: at least one resource deployment operation failed. Please list
deployment operations for details. Please see https://aka.ms/arm-debug for usage details.
At line:1 char:1
+ New-AzureRmResourceGroupDeployment -Name azureSparkClusterDep1 -Resou ...
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
+ CategoryInfo : NotSpecified: (:) [New-AzureRmResourceGroupDeployment], Exception
+ FullyQualifiedErrorId : Microsoft.Azure.Commands.ResourceManager.Cmdlets.Implementation.NewAzureResourceGroupDeploymentCmdlet
New-AzureRmResourceGroupDeployment : 11:35:07 PM - Template output evaluation skipped: at least one resource deployment operation failed. Please list
deployment operations for details. Please see https://aka.ms/arm-debug for usage details.
At line:1 char:1
+ New-AzureRmResourceGroupDeployment -Name azureSparkClusterDep1 -Resou ...
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
+ CategoryInfo : NotSpecified: (:) [New-AzureRmResourceGroupDeployment], Exception
+ FullyQualifiedErrorId : Microsoft.Azure.Commands.ResourceManager.Cmdlets.Implementation.NewAzureResourceGroupDeploymentCmdlet
DeploymentName : azureSparkClusterDep1
ResourceGroupName : azureSparkCluster
ProvisioningState : Failed
Timestamp : 9/21/2017 4:35:05 AM
Mode : Incremental
TemplateLink :
Parameters :
Name Type Value
=============== ========================= ==========
adminUsername String plasparkadmin
adminPassword SecureString
imagePublisher String Canonical
imageOffer String UbuntuServer
imageSKU String 14.04.2-LTS
virtualNetworkName String myVNETspark
addressPrefix String 10.0.0.0/16
subnetName String Subnet-1
subnetPrefix String 10.0.0.0/24
sparkVersion String 1.2.1
sparkClusterName String spark-arm-cluster
sparkNodeIPAddressPrefix String 10.0.0.1
sparkSlaveNodeIPAddressPrefix String 10.0.0.3
jumpbox String enabled
tshirtSize String S
Outputs :
DeploymentDebugLogLevel :
Contributor guide
No contributing guide indexed for this repository
Research direction
Start with shared-resources.json, jumpbox-resources.json, azuredeploy.json, and azuredeploy-parameters.json, then reproduce the deployment using the listed PowerShell commands. Trace the installsparkmaster and installsparkslave extension steps and their custom install script; done means the Spark cluster deployment completes without the exit-status-127 extension failure.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- azure, powershell, spark, ubuntu
- Domain
- cloud, infrastructure
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100