[Misdetection] cn-pdf-10.txt file misdetected as randombytes / "application/octet-stream" score 65.0%
Open
misdetection
needs triage
- Dominant language
- Rust
- Stars
- 18.6k
- Forks
- 1.2k
- Avg merge
- 3d 12h
- Merged PRs (30d)
- 20
Description
The file contains CJK text. Without the leading BOM it is detected as txt with score 70%
[cn-pdf-10.txt](https://github.com/user-attachments/files/25741596/cn-pdf-10.txt)
Contributor guide
Research direction
Start by reproducing detection of the attached cn-pdf-10.txt file and compare it with the same content without the leading BOM. Trace the file-type classification path to determine why the CJK text is assigned to randombytes/application/octet-stream; done means the file is detected as txt with an appropriate score.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- rust
- Domain
- machine-learning
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100