codelucas / codelucas/newspaper
Newspaper language detection not working with CNN news
Open
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 15.2k
- Forks
- 2.1k
- PR merge metrics
- No merged PRs in 30d
Description
So, does anybody know why, when I try to fetch an article from CNN website (eg. https://edition.cnn.com/2020/02/26/india/india-delhi-violence-ashok-nagar-intl/index.html ) I get no meta_lang?
I used
from newspaper import Article, article
a = Article("https://edition.cnn.com/2020/02/26/india/india-delhi-violence-ashok-nagar-intl/index.html")
a.download()
a.parse()
and i see:

Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Reproduce the report with the supplied CNN URL and the shown Article download/parse sequence. Start by tracing how the parsed article's meta_lang value is populated, then determine why it is absent and verify that the behavior is corrected for this example.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- backend
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100