Azure / Azure/azure-quickstart-templates

"VM has reported a failure when processing extension 'installsparkmaster'. Error message: \"Enable failed: failed to execute command: command terminated with exit status=127\"."

Open
#3,907 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Bicep
Stars
14.9k
Forks
16.2k
Avg merge
6d 21h
Merged PRs (30d)
6

Description

--------------------MESSAGE FROM ADMIN, DELETE BEFORE SUBMITTING----------------------

Sorry to hear you had a bad experience with one of the templates :worried: But, in case you're just asking a question, we're happy to help. You can also check if the question might already have been asked here https://github.com/Azure/azure-quickstart-templates/issues?utf8=%E2%9C%93&q=is%3Aissue

We've created an outline of recommended sections to fill out that will help make this Pull Request awesome!

--------------------MESSAGE FROM ADMIN, DELETE BEFORE SUBMITTING----------------------

[Template Name goes here](Template link goes here)

### Issue Details
Followed the steps and was able to create VMs (jumpbox, master, slaves) but the custom install script is failing.

### Repro steps (*if necessary, delete otherwise*)
1. New-AzureRmResourceGroup -Name "azureSparkCluster" -Location 'West US 2'
2. Login to azure and create the resource group and create a Storage Account with a unique name.
3. Put that Storage Account name inside shared-resources.json and jumpbox-resources.json
4. New-AzureRmResourceGroupDeployment -Name azureSparkClusterDep1 -ResourceGroupName "azureSparkCluster" -TemplateFile C:\userName\SparkOnUbuntuAzure\Customized\azuredeploy.json -TemplateParameterFile C:\username\SparkOnUbuntuAzure\Customized\azuredeploy-parameters.json -Verbose
5. Result attached below
New-AzureRmResourceGroupDeployment : 11:35:06 PM - Resource Microsoft.Compute/virtualMachines/extensions 'slavevm0/installsparkslave' failed with
message '{
"status": "Failed",
"error": {
"code": "ResourceDeploymentFailure",
"message": "The resource operation completed with terminal provisioning state 'Failed'.",
"details": [
{
"code": "VMExtensionProvisioningError",
"message": "VM has reported a failure when processing extension 'installsparkslave'. Error message: \"Enable failed: failed to execute
command: command terminated with exit status=127\"."
}
]
}
}'
At line:1 char:1
+ New-AzureRmResourceGroupDeployment -Name azureSparkClusterDep1 -Resou ...
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
+ CategoryInfo : NotSpecified: (:) [New-AzureRmResourceGroupDeployment], Exception
+ FullyQualifiedErrorId : Microsoft.Azure.Commands.ResourceManager.Cmdlets.Implementation.NewAzureResourceGroupDeploymentCmdlet

New-AzureRmResourceGroupDeployment : 11:35:07 PM - VM has reported a failure when processing extension 'installsparkslave'. Error message: "Enable
failed: failed to execute command: command terminated with exit status=127".
At line:1 char:1
+ New-AzureRmResourceGroupDeployment -Name azureSparkClusterDep1 -Resou ...
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
+ CategoryInfo : NotSpecified: (:) [New-AzureRmResourceGroupDeployment], Exception
+ FullyQualifiedErrorId : Microsoft.Azure.Commands.ResourceManager.Cmdlets.Implementation.NewAzureResourceGroupDeploymentCmdlet

New-AzureRmResourceGroupDeployment : 11:35:07 PM - Template output evaluation skipped: at least one resource deployment operation failed. Please list
deployment operations for details. Please see https://aka.ms/arm-debug for usage details.
At line:1 char:1
+ New-AzureRmResourceGroupDeployment -Name azureSparkClusterDep1 -Resou ...
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
+ CategoryInfo : NotSpecified: (:) [New-AzureRmResourceGroupDeployment], Exception
+ FullyQualifiedErrorId : Microsoft.Azure.Commands.ResourceManager.Cmdlets.Implementation.NewAzureResourceGroupDeploymentCmdlet

New-AzureRmResourceGroupDeployment : 11:35:07 PM - Template output evaluation skipped: at least one resource deployment operation failed. Please list
deployment operations for details. Please see https://aka.ms/arm-debug for usage details.
At line:1 char:1
+ New-AzureRmResourceGroupDeployment -Name azureSparkClusterDep1 -Resou ...
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
+ CategoryInfo : NotSpecified: (:) [New-AzureRmResourceGroupDeployment], Exception
+ FullyQualifiedErrorId : Microsoft.Azure.Commands.ResourceManager.Cmdlets.Implementation.NewAzureResourceGroupDeploymentCmdlet

DeploymentName : azureSparkClusterDep1
ResourceGroupName : azureSparkCluster
ProvisioningState : Failed
Timestamp : 9/21/2017 4:35:05 AM
Mode : Incremental
TemplateLink :
Parameters :
Name Type Value
=============== ========================= ==========
adminUsername String plasparkadmin
adminPassword SecureString
imagePublisher String Canonical
imageOffer String UbuntuServer
imageSKU String 14.04.2-LTS
virtualNetworkName String myVNETspark
addressPrefix String 10.0.0.0/16
subnetName String Subnet-1
subnetPrefix String 10.0.0.0/24
sparkVersion String 1.2.1
sparkClusterName String spark-arm-cluster
sparkNodeIPAddressPrefix String 10.0.0.1
sparkSlaveNodeIPAddressPrefix String 10.0.0.3
jumpbox String enabled
tshirtSize String S

Outputs :
DeploymentDebugLogLevel :

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with shared-resources.json, jumpbox-resources.json, azuredeploy.json, and azuredeploy-parameters.json, then reproduce the deployment using the listed PowerShell commands. Trace the installsparkmaster and installsparkslave extension steps and their custom install script; done means the Spark cluster deployment completes without the exit-status-127 extension failure.

Written by the indexing model from the issue text.

Assessment

Tech stack
azure, powershell, spark, ubuntu
Domain
cloud, infrastructure
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.