actions / actions/toolkit

Test failures in `@actions/exec` package when run under MacOS

Open
#1,859 4 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

bug
Dominant language
TypeScript
Stars
5.9k
Forks
1.8k
PR merge metrics
No merged PRs in 30d

Description

Sometime between 2024-10-08 and 2024-10-28 there are three unit tests from the @actions/exec package which have started failing when run specifically on MacOS.

The failures do not appear to be related to any code changes in the repo (I can repro the issue with exactly the same code which was running successfully on October 8th). My guess is that the failures may have something to do with the runner image. The last passing test was running under macos-14-arm64@20240922.1 while the failures are occurring under macos-14-arm64@20241007.259.

The three failing tests are the following:

One interesting data point . . . these same tests will PASS when run in GitHub Actions if I change the runner type from macos-latest to macos-latest-large:

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with packages/exec/tests/exec.test.ts at the three named tests around lines 360, 406, and 460, then compare the linked passing and failing GitHub Actions runs and macOS runner images. Reproduce the failures on macos-14-arm64 and compare with macos-latest-large. Done means the cause is identified and the three tests pass reliably on the affected runner configuration.

Written by the indexing model from the issue text.

Assessment

Tech stack
github-actions, typescript
Domain
ci-cd, testing-qa
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
42/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.