AnswerDotAI / AnswerDotAI/RAGatouille

Index metadata does not change after add_to_index or delete_from_index

Open
#192 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
4k
Forks
276
PR merge metrics
No merged PRs in 30d

Description

After I built an index, I thought I was being clever by reading in `docid_metadata_map.json` to be able to review metadata and select documents I want to work with. However, when adding (`add_to_index`) or removing (`delete_from_index`) from the index, it appears that while the operations seem successful, the `docid_metadata_map.json` and `pid_docid_map.json` files are not updated.

Is this expected behavior? I'd think we'd want to have those files updated to allow for effective metadata management.

Thanks for any insights.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by tracing the add_to_index and delete_from_index entry points and how they handle docid_metadata_map.json and pid_docid_map.json. Verify whether each operation updates both files and define done as keeping the metadata files consistent with the index after additions and removals.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
search
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.