dart-lang / dart-lang/webdev

[CI] Test against raw dev bits for faster turnaround and early problem detection

Open
#1,357 0 comments 0 reactions 0 assignees View on GitHub
P3
Dominant language
Dart
Stars
224
Forks
94
Avg merge
4d 3h
Merged PRs (30d)
2

Description

dart-setup now supports using raw dev bits: https://github.com/dart-lang/setup-dart/issues/29

Add testing in CI against raw dev bits that are available sooner than release bits, so we can

1) detect problems earlier
2) test against new features in SDK and speed up development cycle
3) not miss testing against SDK build that end up in Flutter, to prevent dwds and SDK combination in Flutter not being tested by webdev CI.

Questions to address:
- do we fail the CI on failures with raw bits? (can just try failing first and changing later)
- how do we label/conditionally execute tests that will only pass starting from a certain version? We currently add and remove labels for tests, which can miss some behavior - such as error testing in case of unsupported functionality.

Contributor guide

Open the contributing guide

Research direction

Start by reviewing the repository's existing CI configuration and dart-setup's raw dev bits support described in issue 29. Determine how raw-bit failures and version-specific tests should be handled; done means CI exercises available raw SDK builds and the chosen failure and labeling behavior is documented and working.

Written by the indexing model from the issue text.

Assessment

Tech stack
dart, github-actions
Domain
ci-cd
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.