llmware-ai / llmware-ai/llmware

Query().apply_custom_filter method needs to be improved

Open
#272 4 comments 1 reaction 0 assignees View on GitHub
Dominant language
Python
Stars
14.8k
Forks
2.9k
PR merge metrics
No merged PRs in 30d

Description

Query().apply_custom_filter does simple exact search for custom filters. This does not server the purpose most of the time ( at least for me ) . I need to filter using mongodb operators like $regex, $ne , $ge etc which is ignored by this method. This method is used by semantic_query method which , which results in filter filtering everything out. If we are filtering the text result from semantic query, we should be able to support the mongodb operators like $regex, $eq etc. We could use library like pymongoquery to support mongo operator like filtering from our results without making a trip to the mongo databse.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with Query().apply_custom_filter and its use from semantic_query; inspect how custom filters are applied to semantic-query results. Compare the current behavior with the MongoDB operators named in the issue, including $regex, $ne, $ge, and $eq. Done means these operators filter results correctly without making another trip to MongoDB.

Written by the indexing model from the issue text.

Assessment

Tech stack
mongodb, python
Domain
backend, databases
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.