[Python] Dask integration test fails due to what seems a pytest mark collection error
- Dominant language
- C++
- Stars
- 17.1k
- Forks
- 4.3k
- Avg merge
- 3d 13h
- Merged PRs (30d)
- 88
Description
### Describe the bug, including details regarding any error messages, version, and platform.
[test-conda-python-3.11-dask-latest](https://github.com/ursacomputing/crossbow/actions/runs/28342815776/job/83960423881) is currently failing on the nightlies with:
```
============================= test session starts ==============================
platform linux -- Python 3.11.15, pytest-9.1.0, pluggy-1.6.0 -- /opt/conda/envs/arrow/bin/python3.11
cachedir: .pytest_cache
hypothesis profile 'ci' -> database=None, deadline=None, print_blob=True, derandomize=True, suppress_health_check=(HealthCheck.too_slow,)
rootdir: /
plugins: hypothesis-6.155.3
collecting ... collected 0 items / 1 error
==================================== ERRORS ====================================
_ ERROR collecting opt/conda/envs/arrow/lib/python3.11/site-packages/dask/dataframe/io/tests/test_parquet.py _
opt/conda/envs/arrow/lib/python3.11/site-packages/pluggy/_hooks.py:512: in __call__
return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
opt/conda/envs/arrow/lib/python3.11/site-packages/pluggy/_manager.py:120: in _hookexec
return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
opt/conda/envs/arrow/lib/python3.11/site-packages/_pytest/python.py:250: in pytest_pycollect_makeitem
return list(collector._genfunctions(name, obj))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
opt/conda/envs/arrow/lib/python3.11/site-packages/_pytest/python.py:476: in _genfunctions
self.ihook.pytest_generate_tests.call_extra(methods, dict(metafunc=metafunc))
opt/conda/envs/arrow/lib/python3.11/site-packages/pluggy/_hooks.py:573: in call_extra
return self._hookexec(self.name, hookimpls, kwargs, firstresult)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
opt/conda/envs/arrow/lib/python3.11/site-packages/pluggy/_manager.py:120: in _hookexec
return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
opt/conda/envs/arrow/lib/python3.11/site-packages/_pytest/python.py:124: in pytest_generate_tests
metafunc.parametrize(*marker.args, **marker.kwargs, _param_mark=marker)
opt/conda/envs/arrow/lib/python3.11/site-packages/_pytest/python.py:1316: in parametrize
argnames, parametersets = ParameterSet._for_parametrize(
opt/conda/envs/arrow/lib/python3.11/site-packages/_pytest/mark/structures.py:218: in _for_parametrize
if len(param.values) != len(argnames):
^^^^^^^^^^^^^^^^^
E TypeError: object of type 'NoneType' has no len()
```
### Component(s)
Python
Contributor guide
Research direction
Start by reproducing the test-conda-python-3.11-dask-latest Crossbow failure and inspect the Dask test path shown in the collection error: dask/dataframe/io/tests/test_parquet.py. Trace the pytest parametrization inputs causing the NoneType error, then verify the nightly integration test collects and runs without this collection failure.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- testing-qa
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Quiet
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100