Lightning-AI / Lightning-AI/litData

parquet tests fails inconsistently in CI

Open
#813 1 comment 0 reactions 0 assignees View on GitHub
bug help wanted
Dominant language
Python
Stars
614
Forks
106
Avg merge
15h 8m
Merged PRs (30d)
22

Description

## 🐛 Bug

Parquet tests fail inconsistently in CI, mostly due to timeout, waiting for index file to be available. Possibly, multiple parquet tests leaking the environment.

### To Reproduce

Steps to reproduce the behavior...

Code sample

```python
# Ideally attach a minimal code sample to reproduce the decried issue.
# Minimal means having the shortest code but still preserving the bug.
```

Alternatively, you can share a fully reproducible [Lightning Studio](https://lightning.ai/studios) environment:

> A simple guide on how to create such a studio can be found [here](https://www.youtube.com/watch?v=YcW-2Zt_bFg&ab_channel=LightningAI).

1. Create a [Studio](https://lightning.ai/studios).
2. Reproduce the issue in the Studio.
3. [Publish the Studio](https://lightning.ai/docs/overview/studios/publishing#how-to-publish).
4. Paste the Studio link here.

### Expected behavior

### Additional context

Environment detail

- PyTorch Version (e.g., 1.0):
- OS (e.g., Linux):
- How you installed PyTorch (`conda`, `pip`, source):
- Build command you used (if compiling from source):
- Python version:
- CUDA/cuDNN version:
- GPU models and configuration:
- Any other relevant information:

Contributor guide

Open the contributing guide

Research direction

Start by locating the Parquet tests and the CI job that runs them, then reproduce the timeout while waiting for the index file. Investigate whether tests share or leak environment state; done means the Parquet tests complete reliably in CI without inconsistent timeouts.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
testing-qa
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.