codelucas / codelucas/newspaper
Some article texts are not fully downloaded.
Open
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 15.2k
- Forks
- 2.1k
- PR merge metrics
- No merged PRs in 30d
Description
Hi, I have only found this on one website so far, but when I try to download the full text from an article on the BBC, it only returns a snippet.
Here is an example website:
https://www.bbc.co.uk/news/world-48810070
Any idea why? Thanks.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reproducing the issue with the BBC URL provided and trace the article text extraction path that returns only a snippet. Done means the full article text is downloaded for this page without regressing extraction for other articles.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- backend
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100