open-source-parsers / open-source-parsers/jsoncpp

Different test result with meson and cmake/ninja build?

Open
#1,136 4 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

bug build build or testing
Dominant language
C++
Stars
8.9k
Forks
2.7k
Avg merge
31m
Merged PRs (30d)
1

Description

After cmake build, the default tests are OK

ninja 
....
Testing BuilderTest/settings: OK
Testing IteratorTest/convert: OK
Testing IteratorTest/decrement: OK
Testing IteratorTest/reverseIterator: OK
Testing IteratorTest/distance: OK
Testing IteratorTest/nullValues: OK
Testing IteratorTest/staticStringKey: OK
Testing IteratorTest/names: OK
Testing IteratorTest/indexes: OK
Testing IteratorTest/constness: OK
Testing RValueTest/moveConstruction: OK
Testing FuzzTest/fuzzDoesntCrash: OK
Testing MemberTemplateAs/BehavesSameAsNamedAs: OK
Testing MemberTemplateIs/BehavesSameAsNamedIs: OK
All 114 tests passed

To Reproduce

Claus-MBP:.build-jsoncpp-Debug clausklein$ ninja test
[0/1] Running tests...
Test project /Users/clausklein/Workspace/cpp/.build-jsoncpp-Debug
    Start 1: jsoncpp_readerwriter
1/3 Test #1: jsoncpp_readerwriter ................   Passed    4.36 sec
    Start 2: jsoncpp_readerwriter_json_checker
2/3 Test #2: jsoncpp_readerwriter_json_checker ...***Failed    1.73 sec
    Start 3: jsoncpp_test
3/3 Test #3: jsoncpp_test ........................   Passed    0.02 sec

67% tests passed, 1 tests failed out of 3

Total Test time (real) =   6.15 sec

The following tests FAILED:
	  2 - jsoncpp_readerwriter_json_checker (Failed)
Errors while running CTest
FAILED: CMakeFiles/test.util 
cd /Users/clausklein/Workspace/cpp/.build-jsoncpp-Debug && /opt/local/bin/ctest --force-new-ctest-process
ninja: build stopped: subcommand failed.
Claus-MBP:.build-jsoncpp-Debug clausklein$ 

Expected behavior

Claus-MBP:build clausklein$ ninja test
[0/1] Running all tests.
1/2 unittest_jsoncpp_test                   OK       0.03 s 
2/2 unittest_jsontestrunner                 OK       3.56 s 

Ok:                    2
Expected Fail:         0
Fail:                  0
Unexpected Pass:       0
Skipped:               0
Timeout:               0

Full log written to /Users/clausklein/Workspace/cpp/jsoncpp/build/meson-logs/testlog.txt
Claus-MBP:build clausklein$ 

Desktop (please complete the following information):

  • OSX: Darwin Kernel Version 15.6.0
  • commit edf528edfa66fd02f54f81ae341592f50e61c39f (HEAD -> master, origin/master, origin/HEAD)
  • ninja version ("1.9.0")

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Reproduce the CMake/Ninja run and inspect the failing CTest target jsoncpp_readerwriter_json_checker, then compare it with the passing Meson tests and meson-logs/testlog.txt. Determine why the test results differ on the reported macOS environment; done means both build systems report all tests passing.

Written by the indexing model from the issue text.

Assessment

Tech stack
cmake, cpp
Domain
build-system, testing-qa
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.