apache / apache/arrow

[CI][Integration] Bump HDFS versions tested on conda python integration CI jobs

Open
#49,524 1 comment 0 reactions 1 assignee Claimed by @raulcd View on GitHub
Component: Continuous Integration Component: Integration Type: enhancement
Dominant language
C++
Stars
17.1k
Forks
4.3k
Avg merge
3d 13h
Merged PRs (30d)
88

Description

### Describe the enhancement requested

The [test-conda-python-3.10-hdfs-2.9.2](https://github.com/ursacomputing/crossbow/actions/runs/22944679479/job/66593987920) failed sporadically on this PR when upgrading some dependencies due to time out rebuilding the docker image.
A big chunk of time was spent on the job just downloading HDFS 2.9.2.

From what I can see HDFS 2.9.2 was released on 2018. We test 2.9.2 and 3.2.1, released on 2019.

Should we bump to newer versions for our integration tests? Latests are 3.4.3 (2026) and 2.10.2 (2022)
We defined those versions 5 years ago and haven't been touched.

### Component(s)

Continuous Integration, Integration

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.