apache / apache/arrow

[Python] Dask integration test fails due to what seems a pytest mark collection error

Open
#50,276 1 comment 0 reactions 0 assignees View on GitHub
Component: Python Type: bug
Dominant language
C++
Stars
17.1k
Forks
4.3k
Avg merge
3d 13h
Merged PRs (30d)
88

Description

### Describe the bug, including details regarding any error messages, version, and platform.

[test-conda-python-3.11-dask-latest](https://github.com/ursacomputing/crossbow/actions/runs/28342815776/job/83960423881) is currently failing on the nightlies with:
```
============================= test session starts ==============================
platform linux -- Python 3.11.15, pytest-9.1.0, pluggy-1.6.0 -- /opt/conda/envs/arrow/bin/python3.11
cachedir: .pytest_cache
hypothesis profile 'ci' -> database=None, deadline=None, print_blob=True, derandomize=True, suppress_health_check=(HealthCheck.too_slow,)
rootdir: /
plugins: hypothesis-6.155.3
collecting ... collected 0 items / 1 error

==================================== ERRORS ====================================
_ ERROR collecting opt/conda/envs/arrow/lib/python3.11/site-packages/dask/dataframe/io/tests/test_parquet.py _
opt/conda/envs/arrow/lib/python3.11/site-packages/pluggy/_hooks.py:512: in __call__
return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
opt/conda/envs/arrow/lib/python3.11/site-packages/pluggy/_manager.py:120: in _hookexec
return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
opt/conda/envs/arrow/lib/python3.11/site-packages/_pytest/python.py:250: in pytest_pycollect_makeitem
return list(collector._genfunctions(name, obj))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
opt/conda/envs/arrow/lib/python3.11/site-packages/_pytest/python.py:476: in _genfunctions
self.ihook.pytest_generate_tests.call_extra(methods, dict(metafunc=metafunc))
opt/conda/envs/arrow/lib/python3.11/site-packages/pluggy/_hooks.py:573: in call_extra
return self._hookexec(self.name, hookimpls, kwargs, firstresult)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
opt/conda/envs/arrow/lib/python3.11/site-packages/pluggy/_manager.py:120: in _hookexec
return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
opt/conda/envs/arrow/lib/python3.11/site-packages/_pytest/python.py:124: in pytest_generate_tests
metafunc.parametrize(*marker.args, **marker.kwargs, _param_mark=marker)
opt/conda/envs/arrow/lib/python3.11/site-packages/_pytest/python.py:1316: in parametrize
argnames, parametersets = ParameterSet._for_parametrize(
opt/conda/envs/arrow/lib/python3.11/site-packages/_pytest/mark/structures.py:218: in _for_parametrize
if len(param.values) != len(argnames):
^^^^^^^^^^^^^^^^^
E TypeError: object of type 'NoneType' has no len()
```

### Component(s)

Python

Contributor guide

Open the contributing guide

Research direction

Start by reproducing the test-conda-python-3.11-dask-latest Crossbow failure and inspect the Dask test path shown in the collection error: dask/dataframe/io/tests/test_parquet.py. Trace the pytest parametrization inputs causing the NoneType error, then verify the nightly integration test collects and runs without this collection failure.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
testing-qa
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.