apache / apache/beam

Beam repo build fails in Windows OS

Open
#18,372 0 comments 0 reactions 0 assignees View on GitHub
bug core java P3 windows
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
2d 2h
Merged PRs (30d)
205

Description

Need to run unit tests in Windows OS.

Currently, many unit tests fail when doing "mvn clean install" in Windows OS.

[ERROR] Errors:
[ERROR] AvroSourceTest.testCreationWithSchema:403 ? IllegalState Unable to fin
d regist...
[ERROR] AvroSourceTest.testGetCurrentFromUnstartedReader:305 ? IllegalState Un
able to ...
[ERROR] AvroSourceTest.testGetProgressFromUnstartedReader:204 ? IllegalState U
nable to...
[ERROR] AvroSourceTest.testMultipleFiles:390 ? IllegalState Unable to find reg
istrar f...
[ERROR] AvroSourceTest.testProgress:225 ? IllegalState Unable to find registra
r for c
[ERROR] AvroSourceTest.testProgressEmptySource:278 ? IllegalState Unable to fi
nd regis...
[ERROR] AvroSourceTest.testReadMetadataWithCodecs:676 ? IllegalState Unable to
find re...
[ERROR] AvroSourceTest.testReadSchemaString:688 ? IllegalState Unable to find
registra...
[ERROR] AvroSourceTest.testReadWithDifferentCodecs:158 ? IllegalState Unable t
o find r...
[ERROR] AvroSourceTest.testSchemaIsInterned:460 ? IllegalState Unable to find
registra...
[ERROR] AvroSourceTest.testSchemaStringIsInterned:441 ? IllegalState Unable to
find re...
[ERROR] AvroSourceTest.testSchemaUpdate:425 ? IllegalState Unable to find regi
strar fo...
[ERROR] AvroSourceTest.testSplitAtFraction:176 ? IllegalState Unable to find r
egistrar...
[ERROR] AvroSourceTest.testSplitAtFractionExhaustive:322 ? IllegalState Unable
to find...
[ERROR] AvroSourceTest.testSplitsWithSmallBlocks:341 ? IllegalState Unable to
find reg...
[ERROR] CompressedSourceTest.testEmptyGzipProgress:646 ? IllegalState Unable t
o find r...
[ERROR] CompressedSourceTest.testGzipProgress:673 ? IllegalState Unable to fin
d regist...
[ERROR] CompressedSourceTest.testSplittableProgress:739 ? IllegalState Unable
to find ...
[ERROR] CompressedSourceTest.testUncompressedFileIsSplittable:333 ? IllegalSta
te Unabl...
[ERROR] CompressedSourceTest.testUnsplittable:715 ? IllegalState Unable to fin
d regist...
[ERROR] FileBasedSinkTest.testCopyToOutputFiles:301 ? IllegalState Unable to f
ind regi...
[ERROR] FileBasedSinkTest.testFinalize:154-\>generateTemporaryFilesForFinalize:
189 ? IO
[ERROR] FileBasedSinkTest.testFinalizeMultipleCalls:161-\>generateTemporaryFile
sForFinalize:189 ? IO
[ERROR] FileBasedSinkTest.testFinalizeWithIntermediateState:171-\>generateTempo
raryFilesForFinalize:189 ? IO
[ERROR] FileBasedSourceTest.testCloseUnstartedFilePatternReader:390 ? IllegalS
tate Una...
[ERROR] FileBasedSourceTest.testEstimatedSizeOfFile:746 ? IllegalState Unable
to find ...
[ERROR] FileBasedSourceTest.testEstimatedSizeOfFilePattern:772 ? IllegalState
Unable t...
[ERROR] FileBasedSourceTest.testFractionConsumedWhenReadingFilepattern:422 ? I
llegalState
[ERROR] FileBasedSourceTest.testFullyReadFilePattern:370 ? IllegalState Unable
to find...
[ERROR] FileBasedSourceTest.testFullyReadFilePatternFirstRecordEmpty:461 ? Ill
egalState
[ERROR] FileBasedSourceTest.testFullyReadSingleFile:346 ? IllegalState Unable
to find ...
[ERROR] FileBasedSourceTest.testReadAllSplitsOfFilePattern:792 ? IllegalState
Unable t...
[ERROR] FileBasedSourceTest.testReadAllSplitsOfSingleFile:681 ? IllegalState U
nable to...
[ERROR] FileBasedSourceTest.testReadEverythingFromFileWithSplits:502 ? Illegal
State Un...
[ERROR] FileBasedSourceTest.testReadFileWithSplitsWithEmptyRange:578 ? Illegal
State Un...
[ERROR] FileBasedSourceTest.testReadRangeAtEnd:659 ? IllegalState Unable to fi
nd regis...
[ERROR] FileBasedSourceTest.testReadRangeAtMiddle:637 ? IllegalState Unable to
find re...
[ERROR] FileBasedSourceTest.testReadRangeAtStart:472 ? IllegalState Unable to
find reg...
[ERROR] FileBasedSourceTest.testReadRangeFromFileWithSplitsFromMiddle:546 ? Il
legalState
[ERROR] FileBasedSourceTest.testReadRangeFromFileWithSplitsFromMiddleOfHeader:
615 ? IllegalState
[ERROR] FileBasedSourceTest.testReadRangeFromFileWithSplitsFromStart:517 ? Ill
egalState
[ERROR] FileBasedSourceTest.testSplitAtFraction:815 ? IllegalState Unable to f
ind regi...
[ERROR] FileBasedSourceTest.testSplitAtFractionExhaustive:834 ? IllegalState U
nable to...
[ERROR] FileBasedSourceTest.testToStringFile:842 ? IllegalState Unable to find
registr...
[ERROR] FileSystemsTest.testCopyIgnoreMissingFiles:138 ? IllegalState Unable t
o find r...
[ERROR] FileSystemsTest.testDeleteIgnoreMissingFiles:104 ? IllegalState Unable
to find...
[ERROR] FileSystemsTest.testGetLocalFileSystem:66-\>toLocalResourceId:229 ? Inv
alidPath
[ERROR] FileSystemsTest.testRenameIgnoreMissingFiles:184 ? IllegalState Unable
to find...
[ERROR] LocalFileSystemTest.testMatchMultipleWithFileExtension:238-\>matchGlobW
ithPathPrefix:338 ? InvalidPath
[ERROR] LocalFileSystemTest.testMatchMultipleWithSubdirectoryExpansion:276-\>ma
tchGlobWithPathPrefix:338 ? InvalidPath
[ERROR] LocalFileSystemTest.testMatchMultipleWithoutSubdirectoryExpansion:255-
\>matchGlobWithPathPrefix:338 ? InvalidPath
[ERROR] LocalFileSystemTest.testMatchPatternNone:213-\>matchGlobWithPathPrefix:
338 ? InvalidPath
[ERROR] LocalFileSystemTest.testMatchWithDirectoryFiltersOutDirectory:288-\>mat
chGlobWithPathPrefix:338 ? InvalidPath
[ERROR] LocalFileSystemTest.testMatchWithoutParentDirectory:299 ? InvalidPath
Illegal ...
[ERROR] LocalResourceIdTest.testResolveInWindowsOS:190-\>toResourceIdentifier:2
75 ? InvalidPath
[ERROR] LocalResourceIdTest.testResolveInvalidNotDirectory:165 ? IllegalState
Expected...
[ERROR] LocalResourceIdTest.testResourceIdTester:265 ? IllegalArgument baseDir
ectory C...
[ERROR] TextIOTest.testInitialSplitAutoModeTxt:1046 ? IllegalState Unable to f
ind regi...
[ERROR] TextIOTest.testInitialSplitGzipModeTxt:1081 ? IllegalState Unable to f
ind regi...
[ERROR] TextIOTest.testProgressAfterSplitting:858 ? IllegalState Unable to fin
d regist...
[ERROR] TextIOTest.testProgressEmptyFile:802 ? IllegalState Unable to find reg
istrar f...
[ERROR] TextIOTest.testProgressTextFile:822 ? IllegalState Unable to find regi
strar fo...
[ERROR] TextIOTest.testReadEmptyLines:912-\>runTestReadWithData:967 ? IllegalSt
ate Unab...
[ERROR] TextIOTest.testReadFileWithCarriageReturnAndLineFeedDelimiter:930-\>run
TestReadWithData:967 ? IllegalState
[ERROR] TextIOTest.testReadFileWithCarriageReturnAndLineFeedDelimiterAndNonEmp
tyBytesAtEnd:955-\>runTestReadWithData:967 ? IllegalState
[ERROR] TextIOTest.testReadFileWithCarriageReturnDelimiter:924-\>runTestReadWit
hData:967 ? IllegalState
[ERROR] TextIOTest.testReadFileWithCarriageReturnDelimiterAndNonEmptyBytesAtEn
d:948-\>runTestReadWithData:967 ? IllegalState
[ERROR] TextIOTest.testReadFileWithLineFeedDelimiter:918-\>runTestReadWithData:
967 ? IllegalState
[ERROR] TextIOTest.testReadFileWithLineFeedDelimiterAndNonEmptyBytesAtEnd:942-
\>runTestReadWithData:967 ? IllegalState
[ERROR] TextIOTest.testReadFileWithMixedDelimiters:936-\>runTestReadWithData:96
7 ? IllegalState
[ERROR] TextIOTest.testReadFileWithMixedDelimitersAndNonEmptyBytesAtEnd:961-\>r
unTestReadWithData:967 ? IllegalState
[ERROR] TextIOTest.testSplittingSourceWithCarriageReturnAndLineFeedDelimiter:9
93 ? IllegalState
[ERROR] TextIOTest.testSplittingSourceWithCarriageReturnAndLineFeedDelimiterAn
dNonEmptyBytesAtEnd:1021 ? IllegalState
[ERROR] TextIOTest.testSplittingSourceWithCarriageReturnDelimiter:986 ? Illega
lState U...
[ERROR] TextIOTest.testSplittingSourceWithCarriageReturnDelimiterAndNonEmptyBy
tesAtEnd:1013 ? IllegalState
[ERROR] TextIOTest.testSplittingSourceWithEmptyLines:974 ? IllegalState Unable
to find...
[ERROR] TextIOTest.testSplittingSourceWithLineFeedDelimiter:980 ? IllegalState
Unable ...
[ERROR] TextIOTest.testSplittingSourceWithLineFeedDelimiterAndNonEmptyBytesAtE
nd:1006 ? IllegalState
[ERROR] TextIOTest.testSplittingSourceWithMixedDelimiters:1000 ? IllegalState
Unable t...
[ERROR] TextIOTest.testSplittingSourceWithMixedDelimitersAndNonEmptyBytesAtEnd
:1027 ? IllegalState
[ERROR] TransformTreeTest.testCompositeCapture:127 ? IllegalState Unable to fi
nd regis...
[ERROR] FileChecksumMatcherTest.testMatcherThatUsesCustomizedTemplate:137 ? In
validPath
[ERROR] FileChecksumMatcherTest.testMatcherThatVerifiesFileWithEmptyContent:12
0 ? InvalidPath
[ERROR] FileChecksumMatcherTest.testMatcherThatVerifiesMultipleFiles:108 ? Inv
alidPath
[ERROR] FileChecksumMatcherTest.testMatcherThatVerifiesSingleFile:93 ? Runtime
Failed ...
[ERROR] NumberedShardedFileTest.setup:60 ? InvalidPath Illegal char <*\> at ind
ex 57: C...
[ERROR] NumberedShardedFileTest.setup:60 ? InvalidPath Illegal char <*\> at ind
ex 57: C...
[ERROR] NumberedShardedFileTest.setup:60 ? InvalidPath Illegal char <*\> at ind
ex 57: C...
[ERROR] NumberedShardedFileTest.setup:60 ? InvalidPath Illegal char <*\> at ind
ex 57: C...
[ERROR] NumberedShardedFileTest.setup:60 ? InvalidPath Illegal char <*\> at ind
ex 57: C...
[ERROR] NumberedShardedFileTest.setup:60 ? InvalidPath Illegal char <*\> at ind
ex 57: C...
[ERROR] NumberedShardedFileTest.setup:60 ? InvalidPath Illegal char <*\> at ind
ex 56: C...
[ERROR] NumberedShardedFileTest.setup:60 ? InvalidPath Illegal char <*\> at ind
ex 57: C...
[ERROR] NumberedShardedFileTest.setup:60 ? InvalidPath Illegal char <*\> at ind
ex 57: C...
[INFO]
[ERROR] Tests run: 2302, Failures: 12, Errors: 94, Skipped: 1

Imported from Jira [BEAM-2299](https://issues.apache.org/jira/browse/BEAM-2299). Original Jira may contain additional context.
Reported by: peihe0@gmail.com.

Contributor guide

Open the contributing guide

Research direction

Start by running "mvn clean install" on Windows and group the failures across AvroSourceTest, FileBasedSourceTest, FileSystemsTest, LocalFileSystemTest, LocalResourceIdTest, TextIOTest, and NumberedShardedFileTest. Trace the reported InvalidPath, registrar, and filesystem errors to their test setup and implementation entry points. Done means the Windows build completes with the reported tests passing.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
build-system, operating-systems, testing-qa
Issue type
Bug
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.