ChenRocks / ChenRocks/UNITER

Is the training data(nlvr2_train.tar) properly compressed?

Open
#95 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
799
Forks
111
PR merge metrics
No merged PRs in 30d

Description

While running 'bash scripts/download_nlvr2.sh $PATH_TO_STORAGE',
When downloading and decompressing training data(nlvr2_train.tar, nlvr2_train.tar.1), the following error occurs. Where can I get error-free data?

===========================================================
nlvr2_train/
nlvr2_train/feat_th0.2_max100_min10/
nlvr2_train/feat_th0.2_max100_min10/data.mdb
tar: Unexpected EOF in archive
tar: rmtlseek not stopped at a record boundary
tar: Error is not recoverable: exiting now

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with scripts/download_nlvr2.sh and inspect how nlvr2_train.tar and nlvr2_train.tar.1 are downloaded and decompressed. Verify the downloaded archives and retry extraction; the issue is resolved when the training data extracts without the reported Unexpected EOF error.

Written by the indexing model from the issue text.

Assessment

Tech stack
bash, python
Domain
data-engineering, machine-learning
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.