JuliaGenAI / JuliaGenAI/ColBERT.jl
Append extra text in documents as titles in the `Collection` loader.
Nobody has claimed this yet.
- Dominant language
- Julia
- Stars
- 18
- Forks
- 3
- PR merge metrics
- No merged PRs in 30d
Description
Similar to how Python's ColBERT loads collections, a functionality should be added in the loader for Collection wherein extra text in documents is appended in front of the document as the document title. Currenly, the Collection loader only splits a line of the .tsv file once with the \t delimiter.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with src/data/collection.jl, especially the Collection loader referenced in the issue, and compare its current TSV splitting with the linked Python ColBERT loader. The change is done when extra text in each document is recognized and prepended as its document title rather than being discarded after the first tab.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- julia
- Domain
- search
- Issue type
- Feature
- Difficulty
- 2/5
- Estimated time
- 1-3 hours
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 52/100