WikiExtractor / WikiExtractor/wikiextractor
Store one document per file for Indri
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 4k
- Forks
- 1k
- Avg merge
- 1m
- Merged PRs (30d)
- 10
Description
What changed need to be done, if I want to store one document per file?
Since this XML format and Indri input for the XML class only accepts one document per file.
Other options are to make it into trectext format: <DOC>
<DOCNO> 1 </DOCNO>
<TEXT> text here </TEXT>
</DOC>
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
The issue does not name a file, test, or entry point. Start by locating the XML output and Indri-related command-line handling, then compare the current output with Indri's one-document-per-file requirement. Done means the requested output mode stores each document in its own file and has coverage for the resulting format.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- cli
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100