khanlab / khanlab/snakebids

Method to find entity combinations "missing" from dataset

Open
#248 1 comment 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Python
Stars
23
Forks
16
PR merge metrics
No merged PRs in 30d

Description

Most of the new filtering apis (#209) focus on removing any entity combinations that are missing in one or more components. For example, component B is missing subject 2, so subject 2 is completely excluded from `.expand()`.

It would be helpful for QC to have a method to print all of these missing entities. This would let developers and users quickly query missing parts of their datasets. Technically, this is equal to:
```py
# pseudocode
product(*dataset.entities.values()) - dataset.zip_lists
```

In other words, the maximal zip list subtracted by the actual zip list.

My idea is to have a base method that returns a `zip_list` like representation of all missing groupings, and possibly another convenience method to print the list in a nice table. I need to think about the exact API yet, but if anyone has ideas please share!

Contributor guide

No contributing guide indexed for this repository

Research direction

Review the new filtering APIs in issue #209 and the dataset representation described here, especially entities and zip_lists. Clarify the base method's return shape and whether the convenience table method is in scope; done means missing entity combinations can be queried without being removed by filtering.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
data
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.