Azure / Azure/azure-cli

VMSS NotFound when retrieving nic list

Open
#28,258 11 comments 0 reactions 2 assignees Claimed by @zhoxing-ms View on GitHub
act-observability-squad Auto-Assign Azure CLI Team Compute question
Dominant language
Python
Stars
4.6k
Forks
3.5k
Avg merge
3d 2h
Merged PRs (30d)
60

Description

### Describe the bug

We have an existing ADO pipeline that creates a VMSS (based on Linux images) and then later tries to retreive the list of NICs for the VMSS

This used to work just fine, but lately (since 01/18/2024) it receives a NotFound error. I can see the VMSS resource in Azure Portal though. This also repros from my local machine.

### Related command

az vmss nic list

### Errors

(NotFound) Resource /subscriptions/d71c7216-6409-45f8-be15-35cf57b8527c/resourceGroups/hpc-image-validation-5680c3-rg/providers/Microsoft.Compute/virtualMachineScaleSets/compute-1705972559 not found.
Code: NotFound
Message: Resource /subscriptions/d71c7216-6409-45f8-be15-35cf57b8527c/resourceGroups/hpc-image-validation-5680c3-rg/providers/Microsoft.Compute/virtualMachineScaleSets/compute-1705972559 not found.

### Issue script & Debug output

az vmss nic list --resource-group hpc-image-validation-5680c3-rg --vmss-name compute-1705972559 --debug
cli.knack.cli: Command arguments: ['vmss', 'nic', 'list', '--resource-group', 'hpc-image-validation-5680c3-rg', '--vmss-name', 'compute-1705972559', '--debug']
cli.knack.cli: __init__ debug log:
Enable color in terminal.
cli.knack.cli: Event: Cli.PreExecute []
cli.knack.cli: Event: CommandParser.OnGlobalArgumentsCreate [, , ]
cli.knack.cli: Event: CommandInvoker.OnPreCommandTableCreate []
cli.azure.cli.core: Modules found from index for 'vmss': ['azure.cli.command_modules.vm']
cli.azure.cli.core: Loading command modules:
cli.azure.cli.core: Name Load Time Groups Commands
cli.azure.cli.core: vm 0.708 59 274
cli.azure.cli.core: Total (1) 0.708 59 274
cli.azure.cli.core: Loaded 59 groups, 274 commands.
cli.azure.cli.core: Found a match in the command table.
cli.azure.cli.core: Raw command : vmss nic list
cli.azure.cli.core: Command table: vmss nic list
cli.knack.cli: Event: CommandInvoker.OnPreCommandTableTruncate []
cli.azure.cli.core.azlogging: metadata file logging enabled - writing logs to 'C:\Users\\.azure\commands\2024-01-26.13-47-15.vmss_nic_list.1352.log'.
az_command_data_logger: command args: vmss nic list --resource-group {} --vmss-name {} --debug
cli.knack.cli: Event: CommandInvoker.OnPreArgumentLoad [.add_subscription_parameter at 0x0000027DCA852520>]
cli.knack.cli: Event: CommandInvoker.OnPostArgumentLoad []
cli.knack.cli: Event: CommandInvoker.OnPostCommandTableCreate [.add_ids_arguments at 0x0000027DCA8BC5E0>, .add_cache_arguments at 0x0000027DCA8BC720>]
cli.knack.cli: Event: CommandInvoker.OnCommandTableLoaded []
cli.knack.cli: Event: CommandInvoker.OnPreParseArgs []
cli.knack.cli: Event: CommandInvoker.OnPostParseArgs [, , .parse_ids_arguments at 0x0000027DCA8BC680>]
cli.azure.cli.core.auth.persistence: build_persistence: location='C:\\Users\\\\.azure\\msal_token_cache.bin', encrypt=True
cli.azure.cli.core.auth.binary_cache: load: C:\Users\\.azure\msal_http_cache.bin
urllib3.util.retry: Converted retries value: 1 -> Retry(total=1, connect=None, read=None, redirect=None, status=None)
msal.authority: openid_config = {'token_endpoint': 'https://login.microsoftonline.com/72f988bf-86f1-41af-91ab-2d7cd011db47/oauth2/v2.0/token', 'token_endpoint_auth_methods_supported': ['client_secret_post', 'private_key_jwt', 'client_secret_basic'], 'jwks_uri': 'https://login.microsoftonline.com/72f988bf-86f1-41af-91ab-2d7cd011db47/discovery/v2.0/keys', 'response_modes_supported': ['query', 'fragment', 'form_post'], 'subject_types_supported': ['pairwise'], 'id_token_signing_alg_values_supported': ['RS256'], 'response_types_supported': ['code', 'id_token', 'code id_token', 'id_token token'], 'scopes_supported': ['openid', 'profile', 'email', 'offline_access'], 'issuer': 'https://login.microsoftonline.com/72f988bf-86f1-41af-91ab-2d7cd011db47/v2.0', 'request_uri_parameter_supported': False, 'userinfo_endpoint': 'https://graph.microsoft.com/oidc/userinfo', 'authorization_endpoint': 'https://login.microsoftonline.com/72f988bf-86f1-41af-91ab-2d7cd011db47/oauth2/v2.0/authorize', 'device_authorization_endpoint': 'https://login.microsoftonline.com/72f988bf-86f1-41af-91ab-2d7cd011db47/oauth2/v2.0/devicecode', 'http_logout_supported': True, 'frontchannel_logout_supported': True, 'end_session_endpoint': 'https://login.microsoftonline.com/72f988bf-86f1-41af-91ab-2d7cd011db47/oauth2/v2.0/logout', 'claims_supported': ['sub', 'iss', 'cloud_instance_name', 'cloud_instance_host_name', 'cloud_graph_host_name', 'msgraph_host', 'aud', 'exp', 'iat', 'auth_time', 'acr', 'nonce', 'preferred_username', 'name', 'tid', 'ver', 'at_hash', 'c_hash', 'email'], 'kerberos_endpoint': 'https://login.microsoftonline.com/72f988bf-86f1-41af-91ab-2d7cd011db47/kerberos', 'tenant_region_scope': 'WW', 'cloud_instance_name': 'microsoftonline.com', 'cloud_graph_host_name': 'graph.windows.net', 'msgraph_host': 'graph.microsoft.com', 'rbac_url': 'https://pas.windows.net'}
msal.application: Broker enabled? False
cli.azure.cli.core.auth.credential_adaptor: CredentialAdaptor.get_token: scopes=('https://management.core.windows.net//.default',), kwargs={}
cli.azure.cli.core.auth.msal_authentication: UserCredential.get_token: scopes=('https://management.core.windows.net//.default',), claims=None, kwargs={}
msal.application: Cache hit an AT
msal.telemetry: Generate or reuse correlation_id: eb33ef0b-cd9c-4281-b609-fb4eeb4f58e0
cli.azure.cli.core.sdk.policies: Request URL: 'https://management.azure.com/subscriptions/d71c7216-6409-45f8-be15-35cf57b8527c/resourceGroups/hpc-image-validation-5680c3-rg/providers/microsoft.Compute/virtualMachineScaleSets/compute-1705972559/networkInterfaces?api-version=2016-03-30'
cli.azure.cli.core.sdk.policies: Request method: 'GET'
cli.azure.cli.core.sdk.policies: Request headers:
cli.azure.cli.core.sdk.policies: 'Accept': 'application/json'
cli.azure.cli.core.sdk.policies: 'x-ms-client-request-id': '77a7ec47-bc94-11ee-a6b9-c8348e3bdd30'
cli.azure.cli.core.sdk.policies: 'CommandName': 'vmss nic list'
cli.azure.cli.core.sdk.policies: 'ParameterSetName': '--resource-group --vmss-name --debug'
cli.azure.cli.core.sdk.policies: 'User-Agent': 'AZURECLI/2.56.0 (MSI) (AAZ) azsdk-python-core/1.28.0 Python/3.11.5 (Windows-10-10.0.22621-SP0)'
cli.azure.cli.core.sdk.policies: 'Authorization': '*****'
cli.azure.cli.core.sdk.policies: Request body:
cli.azure.cli.core.sdk.policies: This request has no body
urllib3.connectionpool: Starting new HTTPS connection (1): management.azure.com:443
urllib3.connectionpool: https://management.azure.com:443 "GET /subscriptions/d71c7216-6409-45f8-be15-35cf57b8527c/resourceGroups/hpc-image-validation-5680c3-rg/providers/microsoft.Compute/virtualMachineScaleSets/compute-1705972559/networkInterfaces?api-version=2016-03-30 HTTP/1.1" 404 275
cli.azure.cli.core.sdk.policies: Response status: 404
cli.azure.cli.core.sdk.policies: Response headers:
cli.azure.cli.core.sdk.policies: 'Cache-Control': 'no-cache'
cli.azure.cli.core.sdk.policies: 'Pragma': 'no-cache'
cli.azure.cli.core.sdk.policies: 'Content-Length': '275'
cli.azure.cli.core.sdk.policies: 'Content-Type': 'application/json; charset=utf-8'
cli.azure.cli.core.sdk.policies: 'Expires': '-1'
cli.azure.cli.core.sdk.policies: 'x-ms-request-id': 'c22ba393-9ced-4585-a2aa-95f2fcf01045'
cli.azure.cli.core.sdk.policies: 'x-ms-correlation-request-id': '4c6543d1-df95-4b21-a281-2e83021437dc'
cli.azure.cli.core.sdk.policies: 'x-ms-arm-service-request-id': 'd6f98a2f-9a65-4517-85be-d5cc1b4a68df'
cli.azure.cli.core.sdk.policies: 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains'
cli.azure.cli.core.sdk.policies: 'x-ms-ratelimit-remaining-subscription-reads': '11999'
cli.azure.cli.core.sdk.policies: 'x-ms-routing-request-id': 'WESTUS2:20240126T214716Z:4c6543d1-df95-4b21-a281-2e83021437dc'
cli.azure.cli.core.sdk.policies: 'X-Content-Type-Options': 'nosniff'
cli.azure.cli.core.sdk.policies: 'X-Cache': 'CONFIG_NOCACHE'
cli.azure.cli.core.sdk.policies: 'X-MSEdge-Ref': 'Ref A: 97725676BE654B2295C44703B309F1D8 Ref B: CO6AA3150217009 Ref C: 2024-01-26T21:47:16Z'
cli.azure.cli.core.sdk.policies: 'Date': 'Fri, 26 Jan 2024 21:47:16 GMT'
cli.azure.cli.core.sdk.policies: Response content:
cli.azure.cli.core.sdk.policies: {
"error": {
"code": "NotFound",
"message": "Resource /subscriptions/d71c7216-6409-45f8-be15-35cf57b8527c/resourceGroups/hpc-image-validation-5680c3-rg/providers/Microsoft.Compute/virtualMachineScaleSets/compute-1705972559 not found.",
"details": []
}
}
cli.azure.cli.core.azclierror: Traceback (most recent call last):
File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\knack/cli.py", line 233, in invoke
File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/__init__.py", line 663, in execute
File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/__init__.py", line 726, in _run_jobs_serially
File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/__init__.py", line 710, in _run_job
File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/aaz/_paging.py", line 87, in __next__
File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/aaz/_paging.py", line 43, in __next__
File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/aaz/_command.py", line 250, in executor_wrapper
File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure\cli\command_modules\vm\aaz_compact\latest\vmss\nic\__cmds.py", line 64, in _execute_operations
File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure\cli\command_modules\vm\aaz_compact\latest\vmss\nic\__cmds.py", line 89, in __call__
File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/aaz/_operation.py", line 329, in on_error
azure.core.exceptions.ResourceNotFoundError: (NotFound) Resource /subscriptions/d71c7216-6409-45f8-be15-35cf57b8527c/resourceGroups/hpc-image-validation-5680c3-rg/providers/Microsoft.Compute/virtualMachineScaleSets/compute-1705972559 not found.
Code: NotFound
Message: Resource /subscriptions/d71c7216-6409-45f8-be15-35cf57b8527c/resourceGroups/hpc-image-validation-5680c3-rg/providers/Microsoft.Compute/virtualMachineScaleSets/compute-1705972559 not found.

cli.azure.cli.core.azclierror: (NotFound) Resource /subscriptions/d71c7216-6409-45f8-be15-35cf57b8527c/resourceGroups/hpc-image-validation-5680c3-rg/providers/Microsoft.Compute/virtualMachineScaleSets/compute-1705972559 not found.
Code: NotFound
Message: Resource /subscriptions/d71c7216-6409-45f8-be15-35cf57b8527c/resourceGroups/hpc-image-validation-5680c3-rg/providers/Microsoft.Compute/virtualMachineScaleSets/compute-1705972559 not found.
az_command_data_logger: (NotFound) Resource /subscriptions/d71c7216-6409-45f8-be15-35cf57b8527c/resourceGroups/hpc-image-validation-5680c3-rg/providers/Microsoft.Compute/virtualMachineScaleSets/compute-1705972559 not found.
Code: NotFound
Message: Resource /subscriptions/d71c7216-6409-45f8-be15-35cf57b8527c/resourceGroups/hpc-image-validation-5680c3-rg/providers/Microsoft.Compute/virtualMachineScaleSets/compute-1705972559 not found.
cli.knack.cli: Event: Cli.PostExecute []
az_command_data_logger: exit code: 3
cli.__main__: Command ran in 3.113 seconds (init: 0.835, invoke: 2.278)
telemetry.main: Begin splitting cli events and extra events, total events: 1
telemetry.client: Accumulated 0 events. Flush the clients.
telemetry.main: Finish splitting cli events and extra events, cli events: 1
telemetry.save: Save telemetry record of length 3828 in cache
telemetry.main: Begin creating telemetry upload process.
telemetry.process: Creating upload process: "C:\Program Files\Microsoft SDKs\Azure\CLI2\python.exe C:\Program Files\Microsoft SDKs\Azure\CLI2\Lib\site-packages\azure\cli\telemetry\__init__.pyc C:\Users\\.azure"
telemetry.process: Return from creating process
telemetry.main: Finish creating telemetry upload process.

### Expected behavior

Expected list of NICs attached to this VMSS

### Environment Summary

This is the output from my local machine which also repros the issue. ADO build pool machine config unknown:

azure-cli 2.56.0

core 2.56.0
telemetry 1.1.0

Dependencies:
msal 1.24.0b2
azure-mgmt-resource 23.1.0b2

Python location 'C:\Program Files\Microsoft SDKs\Azure\CLI2\python.exe'
Extensions directory 'C:\Users\\.azure\cliextensions'

Python (Windows) 3.11.5 (tags/v3.11.5:cce6ba9, Aug 24 2023, 14:38:34) [MSC v.1936 64 bit (AMD64)]

### Additional context

_No response_

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.