OpenBagTwo / OpenBagTwo/MarketWatch

Strip all HTML from lede (and headline)

Open
#2 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

enhancement help wanted
Dominant language
Jupyter Notebook
Stars
3
Forks
1
PR merge metrics
No merged PRs in 30d

Description

Right now I'm just excluding any articles with HTML tags (explicitly, the ">") character in the headline or lede. But I can pretty much guarantee that there are libraries that implement HTML handling (beautifulsoup?) that I could be leveraging to do this smarter (and thus with fewer Guardian API calls).

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by locating the notebook code that filters Guardian API results based on HTML tags in headlines or ledes. Review the existing exclusion logic and investigate the HTML-handling approach mentioned in the issue. Done means HTML is stripped from both fields before filtering, reducing unnecessary Guardian API calls.

Written by the indexing model from the issue text.

Assessment

Tech stack
html, python
Domain
api, data
Issue type
Feature
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
48/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.