apache / apache/beam

Add new matcher to check output file content for WordCountIT and WindowedWordCountIT

Open
#18,674 0 comments 0 reactions 0 assignees View on GitHub
P3 tests
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
2d 2h
Merged PRs (30d)
205

Description

Test use case like [https://github.com/apache/beam/pull/4755#discussion_r173254182](https://github.com/apache/beam/pull/4755#discussion_r173254182) shows that verify lines of output for integration test makes the validation and debugging easier than simple verify checksum. We'd like to add a new matcher (like FileContentMatcher) to very lines given expected files.

This matcher can be applied to ITs that already use FileChecksumMatcher (etc. WordCountIT and WindowedWordCountIT).

Imported from Jira [BEAM-3810](https://issues.apache.org/jira/browse/BEAM-3810). Original Jira may contain additional context.
Reported by: markflyhigh.

Contributor guide

Open the contributing guide

Research direction

Start by reading the existing FileContentMatcher and FileChecksumMatcher implementations, then inspect WordCountIT and WindowedWordCountIT to see how checksum validation is configured. Review the linked pull request discussion for expected line-by-line behavior. Done means the new matcher validates output lines against expected files and can be used by both integration tests.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
testing-qa
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.