Lightning-AI / Lightning-AI/litData
parquet tests fails inconsistently in CI
- Dominant language
- Python
- Stars
- 614
- Forks
- 106
- Avg merge
- 15h 8m
- Merged PRs (30d)
- 22
Description
## 🐛 Bug
Parquet tests fail inconsistently in CI, mostly due to timeout, waiting for index file to be available. Possibly, multiple parquet tests leaking the environment.
### To Reproduce
Steps to reproduce the behavior...
Code sample
```python
# Ideally attach a minimal code sample to reproduce the decried issue.
# Minimal means having the shortest code but still preserving the bug.
```
Alternatively, you can share a fully reproducible [Lightning Studio](https://lightning.ai/studios) environment:
> A simple guide on how to create such a studio can be found [here](https://www.youtube.com/watch?v=YcW-2Zt_bFg&ab_channel=LightningAI).
1. Create a [Studio](https://lightning.ai/studios).
2. Reproduce the issue in the Studio.
3. [Publish the Studio](https://lightning.ai/docs/overview/studios/publishing#how-to-publish).
4. Paste the Studio link here.
### Expected behavior
### Additional context
Environment detail
- PyTorch Version (e.g., 1.0):
- OS (e.g., Linux):
- How you installed PyTorch (`conda`, `pip`, source):
- Build command you used (if compiling from source):
- Python version:
- CUDA/cuDNN version:
- GPU models and configuration:
- Any other relevant information:
Contributor guide
Research direction
Start by locating the Parquet tests and the CI job that runs them, then reproduce the timeout while waiting for the index file. Investigate whether tests share or leak environment state; done means the Parquet tests complete reliably in CI without inconsistent timeouts.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- testing-qa
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Quiet
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100