[CI] Test against raw dev bits for faster turnaround and early problem detection
- Dominant language
- Dart
- Stars
- 224
- Forks
- 94
- Avg merge
- 4d 3h
- Merged PRs (30d)
- 2
Description
dart-setup now supports using raw dev bits: https://github.com/dart-lang/setup-dart/issues/29
Add testing in CI against raw dev bits that are available sooner than release bits, so we can
1) detect problems earlier
2) test against new features in SDK and speed up development cycle
3) not miss testing against SDK build that end up in Flutter, to prevent dwds and SDK combination in Flutter not being tested by webdev CI.
Questions to address:
- do we fail the CI on failures with raw bits? (can just try failing first and changing later)
- how do we label/conditionally execute tests that will only pass starting from a certain version? We currently add and remove labels for tests, which can miss some behavior - such as error testing in case of unsupported functionality.
Contributor guide
Research direction
Start by reviewing the repository's existing CI configuration and dart-setup's raw dev bits support described in issue 29. Determine how raw-bit failures and version-specific tests should be handled; done means CI exercises available raw SDK builds and the chosen failure and labeling behavior is documented and working.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- dart, github-actions
- Domain
- ci-cd
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100