Azure / Azure/azure-sdk-for-python

Experiment: Translating Azure SDK mgmt. plane Scenario Tests from .NET to Python

Open
#44,864 0 comments 0 reactions 1 assignee Claimed by @msyyc View on GitHub
Mgmt test-enhancement
Dominant language
Python
Stars
5.6k
Forks
3.4k
Avg merge
1d 22h
Merged PRs (30d)
182

Description

With the evolution of LLMs, we are seeing significantly improved semantic understanding of SDK code, especially when it comes to end-to-end service usage and scenario-driven flows rather than isolated API calls.

In the Azure SDK today:

The .NET SDK mgmt. SDK has relatively rich scenario test coverage that exercises real-world service workflows.

And the Python mgmt. SDK largely lacks equivalent scenario tests, which limits:

Confidence in SDK correctness from a user-workflow perspective
Cross-language consistency of SDK usage patterns
This also impacts LLMs in learning and explaining python SDK service scenarios.

Proposal:
Run an experiment to verify whether Azure SDK mgmt. plane scenario tests written in .NET can be translated into Python SDK scenario tests, with acceptable quality and maintainability.
The goal is to validate feasibility and identify constraints to build the base for large-scale adoption to fill the gap.

For the Initial Experiment, select 2-3 representative services that already have the well-defined .NET management-plane scenario tests and Python SDK support, then translate all their scenario tests into python.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.