Automattic / Automattic/jetpack
CLI: Add ability to skip tests for status command
- Dominant language
- PHP
- Stars
- 1.8k
- Forks
- 898
- Avg merge
- 1d 18h
- Merged PRs (30d)
- 774
Description
#### Is your feature request related to a problem? Please describe.
Yes. After the latest update, a hosting partner began experiencing a problem with the `test__server_port_value`. Specifically, the test was skipped properly when ran via CLI, but when ran via an endpoint that called CLI, the test failed. In this case, a workaround was to unset the SERVER values that the test looks for.
#### Describe the solution you'd like
it would have been ideal if the hosting partner could optionally skip the `test__server_port_value` or just skip all of the tests and test the connection alone OR if `Jetpack::is_active()` is true.
#### Describe alternatives you've considered
#### Additional context
Here's a screenshot of the skipped test that was shared with us.

It would be ideal if, along with `--skip-theme`, we could do something like `--skip-tests` or `--skip-test=test__server_port_value,test__outbound_http`.
Contributor guide
Research direction
Start at the status CLI command and inspect how the existing --skip-theme option handles tests. Compare the requested behavior for --skip-tests and selective skipping of test__server_port_value and test__outbound_http. Done means the status command can test only the connection or omit the requested tests without reproducing the reported failure.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- php
- Domain
- cli, testing
- Issue type
- Feature
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100