openml / openml/OpenML

incomplete data from server

Open
#483 12 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

bug priority: highest
Dominant language
PHP
Stars
755
Forks
128
PR merge metrics
No merged PRs in 30d

Description

Whenever I try to download data via python (not using the OpenML client) I get an "incomplete data" error:

ContentTooShortError: <urlopen error retrieval incomplete: got only 7487 out of 7495 bytes>

You can reproduce with

from urllib.request import urlretrieve
response = urlretrieve("https://www.openml.org/data/download/61")

This is likely a misconfiguration of the server. The openml python client doesn't error. I think that's because we're using the requests library which simply swallows the error.
I can work around it, but ideally this should be fixed server-side.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Reproduce the issue with Python's urllib.request.urlretrieve against https://www.openml.org/data/download/61 and compare the received length with the reported 7,495 bytes. Investigate the server-side download endpoint; done means the endpoint returns the complete data without ContentTooShortError.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
backend
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.