huggingface / huggingface/dataset-viewer
Regularly review logs starting with `ERROR: ` and open issues for them
- Dominant language
- Python
- Stars
- 899
- Forks
- 130
- Avg merge
- 9h 26m
- Merged PRs (30d)
- 14
Description
See https://kibana.elastic.huggingface.tech/app/discover#/?_g=(filters:!(),refreshInterval:(pause:!t,value:0),time:(from:now-25h,to:now))&_a=(columns:!(message,kubernetes.namespace),filters:!(('$state':(store:appState),meta:(alias:!n,disabled:!f,index:de38ff80-ac19-11ec-bb45-ad141ad1c5f8,key:kubernetes.namespace,negate:!f,params:(query:datasets-server),type:phrase),query:(match_phrase:(kubernetes.namespace:datasets-server)))),hideChart:!f,index:de38ff80-ac19-11ec-bb45-ad141ad1c5f8,interval:auto,query:(language:kuery,query:'kubernetes.container.name%20:%20prod-datasets-server-worker%20and%20message:%20%22ERROR%22'),sort:!(!('@timestamp',desc))) (internal link).
For example:
```
ERROR: 2024-03-08 15:18:50,885 - root - division by zero
ERROR: 2024-03-08 15:18:46,200 - root - `file_name` must be present as dictionary key in metadata files
ERROR: 2024-03-08 15:13:32,535 - root - job 65eb29cc714fe3fff66e49ed does not exist. Aborting.
```
Contributor guide
Research direction
Start with the linked Kibana Discover view, filtered to the datasets-server worker and messages containing ERROR. Review the listed errors and open separate follow-up issues with enough context for each; completion means the recurring ERROR log entries have been investigated and tracked.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- observability
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100