opensafely-core / opensafely-core/opencodelists
Include code frequency indicators in builder tool
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 60
- Forks
- 16
- Avg merge
- 4d 12h
- Merged PRs (30d)
- 17
Description
When authoring a new codelist, there are diminishing returns on the time the author spends on getting every last code correct. On a large codelist, this long tail of apparently-very-unusual-but-possibly-significant codes can take a significant amount of time to QA, possibly with very little benefit: but no-one ever finds out if the work was useful.
It would be good to have an indicator of the frequency of each code for authors to access when making decisions about code inclusion (or exclusion).
From an IG point of view it's been suggested we just start with frequencies for codes in our studies, but this doesn't help with the primary use-case, which is helping authors of new codelists (or editors of existing ones) to make decisions about adding unusual codes.
From a research point of view there's a concern that code counts could be misused for very crude studies on their own.
For the purposes of codelist authoring, centiles of a log rank would probably be sufficient: we just want to know "this code is vanishingly infrequently used". This could probably be across a single year of data aggregated across TPP and EMIS. This may address possible concerns around data stewardship etc.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
The issue names the builder tool and codelist authoring but does not identify files, tests, or an entry point. First map how codes are loaded and displayed, then resolve the data-source, aggregation, privacy, and presentation requirements; done means an agreed indicator is available to authors and covered by tests.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- data
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100