huggingface / huggingface/dataset-viewer

Regularly review logs starting with `ERROR: ` and open issues for them

Open
#2,565 0 comments 0 reactions 0 assignees View on GitHub
bug P2
Dominant language
Python
Stars
899
Forks
130
Avg merge
9h 26m
Merged PRs (30d)
14

Description

See https://kibana.elastic.huggingface.tech/app/discover#/?_g=(filters:!(),refreshInterval:(pause:!t,value:0),time:(from:now-25h,to:now))&_a=(columns:!(message,kubernetes.namespace),filters:!(('$state':(store:appState),meta:(alias:!n,disabled:!f,index:de38ff80-ac19-11ec-bb45-ad141ad1c5f8,key:kubernetes.namespace,negate:!f,params:(query:datasets-server),type:phrase),query:(match_phrase:(kubernetes.namespace:datasets-server)))),hideChart:!f,index:de38ff80-ac19-11ec-bb45-ad141ad1c5f8,interval:auto,query:(language:kuery,query:'kubernetes.container.name%20:%20prod-datasets-server-worker%20and%20message:%20%22ERROR%22'),sort:!(!('@timestamp',desc))) (internal link).

For example:

```
ERROR: 2024-03-08 15:18:50,885 - root - division by zero
ERROR: 2024-03-08 15:18:46,200 - root - `file_name` must be present as dictionary key in metadata files
ERROR: 2024-03-08 15:13:32,535 - root - job 65eb29cc714fe3fff66e49ed does not exist. Aborting.
```

Contributor guide

Open the contributing guide

Research direction

Start with the linked Kibana Discover view, filtered to the datasets-server worker and messages containing ERROR. Review the listed errors and open separate follow-up issues with enough context for each; completion means the recurring ERROR log entries have been investigated and tracked.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
observability
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.