MaartenGr / MaartenGr/BERTopic
semi-supervised topic modelling with multiple labels per document
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 7.8k
- Forks
- 920
- Avg merge
- 22h 24m
- Merged PRs (30d)
- 5
Description
Hi there,
I have a dataset with 2000 participants who reported their most negative daily event for 90 days. They completed three questions related to their most negative event:
(1) an open-ended written question "what was you most negative event today?
(2) which categories does this event belong to (select all that apply) (e.g., mental health, physical health, relationship with family, etc)
(3) how negative was this event (i.e., 7-point likert with 1 - not at all negative and 7 - very negative)
The known topic categories are rather coarse, so the aim of using BERTopic is find a more fine-grained understanding topics participants' wrote about. From https://github.com/MaartenGr/BERTopic/issues/826#issuecomment-1306746031 I understand that the semi-supervised labelling does not support multiple labels.
I have also read https://github.com/MaartenGr/BERTopic/issues/1725#issuecomment-1879975094. However I'm not sure if there are alternatives to the suggestions provided there.
In a nutshell, I'm wondering what would be the best way to combine the above features (written response, known categories, and participant ratings) to improve the performance of BERTopic in finding topics. Any help in how to proceed would be greatly appreciated!
Thanks,
Justin
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reviewing the discussion in issues 826 and 1725, especially the referenced comment and proposed alternatives. Compare those approaches against the three stated inputs—written responses, multiple known categories, and participant ratings—and document whether BERTopic supports a practical combined workflow or what feature would be needed.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100