Azure / Azure/azure-sdk-tools

[Typespec Authoring] remove client side limitation in azsdk_typespec_consult tool

Open
#13,761 0 comments 0 reactions 1 assignee Claimed by @chunyu3 View on GitHub
AzSDK Tools Agent dev inner loop needs-triage Scenario 2
Dominant language
C#
Stars
135
Forks
260
Avg merge
3d 1h
Merged PRs (30d)
144

Description

Currently, the server side simply truncates the content when it exceeds the length limit. This raises a concern that the returned answer may be inaccurate because it is based on a truncated question. That is why we enforce a length limit on the tool side.
e.g.
https://github.com/Azure/azure-sdk-tools/blob/10cb315e39573016d79bfda3a0e813f2d7a3db01/tools/azsdk-cli/Azure.Sdk.Tools.Cli/Models/AzureSdkKnowledgeAICompletion/Message.cs#L23

We are considering enhancements on the backend side, where the service would return an error instead of automatically truncating the inputhttps://github.com/Azure/azure-sdk-pr/issues/2518.
Once the backend service is improved, we may remove the limitation enforced by the tool.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.