apache / apache/arrow

[Integration] Test skip messages can be misleading

Open
#38,454 0 comments 0 reactions 0 assignees View on GitHub
Component: Integration Type: bug
Dominant language
C++
Stars
17.1k
Forks
4.3k
Avg merge
3d 13h
Merged PRs (30d)
88

Description

### Describe the bug, including details regarding any error messages, version, and platform.

The integration test runner displays skipped tests like this:
```
2023-10-25T08:23:41.7618109Z ======================================================================
2023-10-25T08:23:41.7618808Z ======================================================================
2023-10-25T08:23:41.7619627Z Testing file /tmp/arrow-integration-v3004kb3/generated_run_end_encoded.json
2023-10-25T08:23:41.7621134Z -- Skipping test because producer Rust does not support IPC
2023-10-25T08:23:41.7621941Z ======================================================================
2023-10-25T08:23:41.7622866Z ======================================================================
2023-10-25T08:23:41.7624223Z Testing file /tmp/arrow-integration-v3004kb3/generated_binary_view.json
2023-10-25T08:23:41.7625209Z -- Skipping test because producer Rust does not support IPC
2023-10-25T08:23:41.7625913Z ======================================================================
```

which is confusing, since Rust actually supports Arrow IPC, it's just that the specific datatypes or files are disabled for Rust.

It would be nicer to have more specific messages, such as:
```
Skipping test, reason: producer Rust does not support data type
Skipping test, reason: consumer Java does not support data type
Skipping test, reason: consumer JS does not support importing C arrays
[etc.]
```

### Component(s)

Integration

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.