Breaking nightly CI

Note that the nightly CI is still breaking, due to failing test cases in some underlying repositories. Will further investigate soon when have time.

2022-04-29T12:03:52.8614013Z 4: ________________________ ERROR collecting test session _________________________
2022-04-29T12:03:52.8614967Z 4: /usr/local/lib/python3.8/dist-packages/pluggy/_hooks.py:265: in __call__
2022-04-29T12:03:52.8615412Z 4:     return self._hookexec(self.name, self.get_hookimpls(), kwargs, firstresult)
2022-04-29T12:03:52.8615935Z 4: /usr/local/lib/python3.8/dist-packages/pluggy/_manager.py:80: in _hookexec
2022-04-29T12:03:52.8616347Z 4:     return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
2022-04-29T12:03:52.8616862Z 4: /usr/local/lib/python3.8/dist-packages/_pytest/python.py:206: in pytest_collect_file
2022-04-29T12:03:52.8617263Z 4:     module: Module = ihook.pytest_pycollect_makemodule(
2022-04-29T12:03:52.8617765Z 4: /usr/local/lib/python3.8/dist-packages/_pytest/config/compat.py:67: in fixed_hook
2022-04-29T12:03:52.8618084Z 4:     return hook(**kw)
2022-04-29T12:03:52.8618503Z 4: /usr/local/lib/python3.8/dist-packages/pluggy/_hooks.py:265: in __call__
2022-04-29T12:03:52.8618912Z 4:     return self._hookexec(self.name, self.get_hookimpls(), kwargs, firstresult)
2022-04-29T12:03:52.8619750Z 4: /usr/local/lib/python3.8/dist-packages/pluggy/_manager.py:80: in _hookexec
2022-04-29T12:03:52.8620154Z 4:     return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
2022-04-29T12:03:52.8620751Z 4: /opt/ros/galactic/lib/python3.8/site-packages/launch_testing/pytest/hooks.py:179: in pytest_pycollect_makemodule
2022-04-29T12:03:52.8621205Z 4:     return pytest.Module.from_parent(parent, fspath=path)
2022-04-29T12:03:52.8621692Z 4: /usr/local/lib/python3.8/dist-packages/_pytest/nodes.py:633: in from_parent
2022-04-29T12:03:52.8622112Z 4:     return super().from_parent(parent=parent, fspath=fspath, path=path, **kw)
2022-04-29T12:03:52.8622627Z 4: /usr/local/lib/python3.8/dist-packages/_pytest/nodes.py:264: in from_parent
2022-04-29T12:03:52.8622974Z 4:     return cls._create(parent=parent, **kw)
2022-04-29T12:03:52.8623425Z 4: /usr/local/lib/python3.8/dist-packages/_pytest/nodes.py:140: in _create
2022-04-29T12:03:52.8623759Z 4:     return super().__call__(*k, **kw)
2022-04-29T12:03:52.8624203Z 4: /usr/local/lib/python3.8/dist-packages/_pytest/nodes.py:588: in __init__
2022-04-29T12:03:52.8624562Z 4:     path = _imply_path(type(self), path, fspath=fspath)
2022-04-29T12:03:52.8625276Z 4: /usr/local/lib/python3.8/dist-packages/_pytest/nodes.py:110: in _imply_path
2022-04-29T12:03:52.8625596Z 4:     warnings.warn(
2022-04-29T12:03:52.8626171Z 4: E   pytest.PytestRemovedIn8Warning: The (fspath: py.path.local) argument to Module is deprecated. Please use the (path: pathlib.Path) argument instead.
2022-04-29T12:03:52.8627296Z 4: E   See https://docs.pytest.org/en/latest/deprecations.html#fspath-argument-for-node-constructors-replaced-with-pathlib-path
2022-04-29T12:03:52.8628160Z 4: - generated xml file: /home/runner/work/rmf/rmf/ros_ws/build/rmf_fleet_adapter_python/test_results/rmf_fleet_adapter_python/test_types.xunit.xml -
2022-04-29T12:03:52.8628633Z 4: =========================== short test summary info ============================
2022-04-29T12:03:52.8629128Z 4: ERROR ../.. - pytest.PytestRemovedIn8Warning: The (fspath: py.path.local) arg...
2022-04-29T12:03:52.8629550Z 4: !!!!!!!!!!!!!!!!!!!! Interrupted: 1 error during collection !!!!!!!!!!!!!!!!!!!!
2022-04-29T12:03:52.8629888Z 4: =============================== 1 error in 0.51s ===============================
2022-04-29T12:03:52.8630214Z 4: -- run_test.py: return code 2
2022-04-29T12:03:52.8630854Z 4: -- run_test.py: verify result file '/home/runner/work/rmf/rmf/ros_ws/build/rmf_fleet_adapter_python/test_results/rmf_fleet_adapter_python/test_types.xunit.xml'
2022-04-29T12:03:52.8631337Z 4/5 Test #4: test_types .......................***Failed    1.52 sec
2022-04-29T12:03:52.8631592Z test 5
2022-04-29T12:03:52.8631800Z     Start 5: test_vehicletraits
2022-04-29T12:03:52.8631959Z 
2022-04-29T12:03:52.8633999Z 5: Test command: /usr/bin/python3 "-u" "/opt/ros/galactic/share/ament_cmake_test/cmake/run_test.py" "/home/runner/work/rmf/rmf/ros_ws/build/rmf_fleet_adapter_python/test_results/rmf_fleet_adapter_python/test_vehicletraits.xunit.xml" "--package-name" "rmf_fleet_adapter_python" "--output-file" "/home/runner/work/rmf/rmf/ros_ws/build/rmf_fleet_adapter_python/ament_cmake_pytest/test_vehicletraits.txt" "--command" "/usr/bin/python3" "-u" "-m" "pytest" "/home/runner/work/rmf/rmf/ros_ws/src/rmf/rmf_ros2/rmf_fleet_adapter_python/tests/unit/test_vehicletraits.py" "-o" "cache_dir=/home/runner/work/rmf/rmf/ros_ws/build/rmf_fleet_adapter_python/ament_cmake_pytest/test_vehicletraits/.cache" "--junit-xml=/home/runner/work/rmf/rmf/ros_ws/build/rmf_fleet_adapter_python/test_results/rmf_fleet_adapter_python/test_vehicletraits.xunit.xml" "--junit-prefix=rmf_fleet_adapter_python" "-We"
2022-04-29T12:03:52.8635344Z 5: Test timeout computed to be: 120
2022-04-29T12:03:52.8636001Z 5: -- run_test.py: invoking following command in '/home/runner/work/rmf/rmf/ros_ws/build/rmf_fleet_adapter_python':
2022-04-29T12:03:52.8637340Z 5:  - /usr/bin/python3 -u -m pytest /home/runner/work/rmf/rmf/ros_ws/src/rmf/rmf_ros2/rmf_fleet_adapter_python/tests/unit/test_vehicletraits.py -o cache_dir=/home/runner/work/rmf/rmf/ros_ws/build/rmf_fleet_adapter_python/ament_cmake_pytest/test_vehicletraits/.cache --junit-xml=/home/runner/work/rmf/rmf/ros_ws/build/rmf_fleet_adapter_python/test_results/rmf_fleet_adapter_python/test_vehicletraits.xunit.xml --junit-prefix=rmf_fleet_adapter_python -We
2022-04-29T12:03:52.8638423Z 5: ============================= test session starts ==============================
2022-04-29T12:03:52.8638859Z 5: platform linux -- Python 3.8.10, pytest-7.1.2, pluggy-1.0.0
2022-04-29T12:03:52.8639274Z 5: cachedir: build/rmf_fleet_adapter_python/ament_cmake_pytest/test_vehicletraits/.cache
2022-04-29T12:03:52.8639653Z 5: rootdir: /home/runner/work/rmf/rmf/ros_ws
2022-04-29T12:03:52.8640543Z 5: plugins: ament-copyright-0.10.6, launch-testing-ros-0.14.2, ament-flake8-0.10.6, ament-lint-0.10.6, ament-xmllint-0.10.6, launch-testing-0.17.0, ament-pep257-0.10.6, rerunfailures-10.2, colcon-core-0.6.1, repeat-0.9.1, cov-3.0.0, mock-3.7.0
2022-04-29T12:03:52.8641103Z 5: collected 0 items / 1 error
2022-04-29T12:03:52.8641334Z 5: 
2022-04-29T12:03:52.8641580Z 5: ==================================== ERRORS ====================================
2022-04-29T12:03:52.8641892Z 5: ________________________ ERROR collecting test session _________________________
2022-04-29T12:03:52.8642371Z 5: /usr/local/lib/python3.8/dist-packages/pluggy/_hooks.py:265: in __call__
2022-04-29T12:03:52.8642896Z 5:     return self._hookexec(self.name, self.get_hookimpls(), kwargs, firstresult)
2022-04-29T12:03:52.8643423Z 5: /usr/local/lib/python3.8/dist-packages/pluggy/_manager.py:80: in _hookexec
2022-04-29T12:03:52.8643812Z 5:     return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
2022-04-29T12:03:52.8644339Z 5: /usr/local/lib/python3.8/dist-packages/_pytest/python.py:206: in pytest_collect_file
2022-04-29T12:03:52.8644741Z 5:     module: Module = ihook.pytest_pycollect_makemodule(
2022-04-29T12:03:52.8645233Z 5: /usr/local/lib/python3.8/dist-packages/_pytest/config/compat.py:67: in fixed_hook
2022-04-29T12:03:52.8645570Z 5:     return hook(**kw)
2022-04-29T12:03:52.8645994Z 5: /usr/local/lib/python3.8/dist-packages/pluggy/_hooks.py:265: in __call__
2022-04-29T12:03:52.8646407Z 5:     return self._hookexec(self.name, self.get_hookimpls(), kwargs, firstresult)
2022-04-29T12:03:52.8646906Z 5: /usr/local/lib/python3.8/dist-packages/pluggy/_manager.py:80: in _hookexec
2022-04-29T12:03:52.8647312Z 5:     return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
2022-04-29T12:03:52.8647912Z 5: /opt/ros/galactic/lib/python3.8/site-packages/launch_testing/pytest/hooks.py:179: in pytest_pycollect_makemodule
2022-04-29T12:03:52.8648347Z 5:     return pytest.Module.from_parent(parent, fspath=path)
2022-04-29T12:03:52.8648849Z 5: /usr/local/lib/python3.8/dist-packages/_pytest/nodes.py:633: in from_parent
2022-04-29T12:03:52.8649268Z 5:     return super().from_parent(parent=parent, fspath=fspath, path=path, **kw)
2022-04-29T12:03:52.8649784Z 5: /usr/local/lib/python3.8/dist-packages/_pytest/nodes.py:264: in from_parent
2022-04-29T12:03:52.8650135Z 5:     return cls._create(parent=parent, **kw)
2022-04-29T12:03:52.8650587Z 5: /usr/local/lib/python3.8/dist-packages/_pytest/nodes.py:140: in _create
2022-04-29T12:03:52.8650919Z 5:     return super().__call__(*k, **kw)
2022-04-29T12:03:52.8651345Z 5: /usr/local/lib/python3.8/dist-packages/_pytest/nodes.py:588: in __init__
2022-04-29T12:03:52.8651723Z 5:     path = _imply_path(type(self), path, fspath=fspath)
2022-04-29T12:03:52.8652202Z 5: /usr/local/lib/python3.8/dist-packages/_pytest/nodes.py:110: in _imply_path
2022-04-29T12:03:52.8652507Z 5:     warnings.warn(
2022-04-29T12:03:52.8652981Z 5: E   pytest.PytestRemovedIn8Warning: The (fspath: py.path.local) argument to Module is deprecated. Please use the (path: pathlib.Path) argument instead.
2022-04-29T12:03:52.8653856Z 5: E   See https://docs.pytest.org/en/latest/deprecations.html#fspath-argument-for-node-constructors-replaced-with-pathlib-path
2022-04-29T12:03:52.8654734Z 5: - generated xml file: /home/runner/work/rmf/rmf/ros_ws/build/rmf_fleet_adapter_python/test_results/rmf_fleet_adapter_python/test_vehicletraits.xunit.xml -
2022-04-29T12:03:52.8655334Z 5: =========================== short test summary info ============================
2022-04-29T12:03:52.8655853Z 5: ERROR ../.. - pytest.PytestRemovedIn8Warning: The (fspath: py.path.local) arg...
2022-04-29T12:03:52.8656278Z 5: !!!!!!!!!!!!!!!!!!!! Interrupted: 1 error during collection !!!!!!!!!!!!!!!!!!!!
2022-04-29T12:03:52.8656614Z 5: =============================== 1 error in 0.58s ===============================
2022-04-29T12:03:52.8656938Z 5: -- run_test.py: return code 2
2022-04-29T12:03:52.8657600Z 5: -- run_test.py: verify result file '/home/runner/work/rmf/rmf/ros_ws/build/rmf_fleet_adapter_python/test_results/rmf_fleet_adapter_python/test_vehicletraits.xunit.xml'
2022-04-29T12:03:52.8658105Z 5/5 Test #5: test_vehicletraits ...............***Failed    1.55 sec
2022-04-29T12:03:52.8658303Z 
2022-04-29T12:03:52.8658417Z 0% tests passed, 5 tests failed out of 5
2022-04-29T12:03:52.8658596Z 
2022-04-29T12:03:52.8658689Z Label Time Summary:
2022-04-29T12:03:52.8658939Z pytest    =   7.65 sec*proc (5 tests)
2022-04-29T12:03:52.8659103Z 
2022-04-29T12:03:52.8659215Z Total Test time (real) =   7.66 sec
2022-04-29T12:03:52.8659363Z 
2022-04-29T12:03:52.8659470Z The following tests FAILED:
2022-04-29T12:03:52.8659888Z 	  1 - test_geometry (Failed)
2022-04-29T12:03:52.8660188Z 	  2 - test_graph (Failed)
2022-04-29T12:03:52.8660510Z 	  3 - test_RobotCommandHandle (Failed)
2022-04-29T12:03:52.8660828Z 	  4 - test_types (Failed)
2022-04-29T12:03:52.8661144Z 	  5 - test_vehicletraits (Failed)
2022-04-29T12:03:52.8661394Z Errors while running CTest
2022-04-29T12:03:52.8661808Z Output from these tests are in: /home/runner/work/rmf/rmf/ros_ws/build/rmf_fleet_adapter_python/Testing/Temporary/LastTest.log
2022-04-29T12:03:52.8662397Z Use "--rerun-failed --output-on-failure" to re-run the failed cases verbosely.
2022-04-29T12:03:52.8662744Z ---
2022-04-29T12:03:52.8663262Z Finished <<< rmf_fleet_adapter_python [7.80s]	[ with test failures ]
2022-04-29T12:03:52.8663655Z --- stderr: rmf_fleet_adapter_python
2022-04-29T12:03:52.8663928Z Errors while running CTest
2022-04-29T12:03:52.8664324Z Output from these tests are in: /home/runner/work/rmf/rmf/ros_ws/build/rmf_fleet_adapter_python/Testing/Temporary/LastTest.log
2022-04-29T12:03:52.8664913Z Use "--rerun-failed --output-on-

Originally posted by @youliangtan in https://github.com/open-rmf/rmf/issues/151#issuecomment-1117160809

Start by reproducing the nightly CI failure in the ROS workspace and inspect the pytest collection errors involving launch_testing and the five listed tests: test_geometry, test_graph, test_RobotCommandHandle, test_types, and test_vehicletraits. Use the generated LastTest.log and rerun failed cases with --rerun-failed --output-on-failure; done means all five tests pass and nightly CI is green.