Azure / Azure/azure-sdk-tools

Investigate sparse checkout negative glob performance

Open
#3,154 2 comments 0 reactions 1 assignee Assigned to @benbp View on GitHub
Central-EngSys
Dominant language
C#
Stars
135
Forks
260
Avg merge
1d 22h
Merged PRs (30d)
115

Description

Looking through some of the NET pipelines (e.g. https://dev.azure.com/azure-sdk/internal/_build/results?buildId=1508998&view=logs&j=a9d5a44a-ac8b-5cae-adb6-1f4d702c5074&t=a13353de-67f0-5622-a4d7-6ae66778033f) I noticed that when sparse checkout includes the negative glob for test recordings, it actually takes much longer than when just including the whole service directory (see the generate matrix job). It's possible the server side CPU cost of the negative glob is not saving time here, at least for service directories with a smaller recording blob size (for example, text analytics vs. storage).

It's possible that sparse checkout should default to inclusive only when checking out a service directory, unless specifically marked as excluded by the service for when blobs are hundreds of MB in size.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.