WikiExtractor / WikiExtractor/wikiextractor

Malformed wiki markup inside HTML comment causes content to be dropped.

Open
#125 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
4k
Forks
1k
Avg merge
1m
Merged PRs (30d)
10

Description

If the wiki markup contains an HTML comment which contains certain kinds of malformed wiki markup, all content after the comment will be dropped. An example:

Before the comment.

<!-- HTML comment here
{{malformed
| stuff = here
End HTML comment -->

After the comment comes {{some stuff}} that should be okay.

The result is just "Before the comment."

This causes, for instance, virtually all of the content to be dropped in the article on Ferdinand Marcos.

Needless to say, content inside an HTML comment should have no effect whatsoever on the parsing of the article.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reproducing the malformed HTML-comment example from the issue and trace the wiki markup parser that handles comments. The fix is done when malformed markup inside an HTML comment has no effect and the content after the comment, including the later template, is preserved.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
tooling
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Clearly specified
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.