MaartenGr / MaartenGr/BERTopic
Can't reproduce same results when using cuml version of UMAP and HDBSCAN
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 7.8k
- Forks
- 920
- Avg merge
- 22h 24m
- Merged PRs (30d)
- 5
Description
Hi,
I understand that when I import UMAP from umap, and HDBSCAN from hdbscan, I can reproduce the results of topic modeling by setting random_state in UMAP.
But I realized that if I import HDBSCAN from cuml.cluster, and UMAP from cuml.manifold, then the results of topic modeling can no longer be replicated even when I set random_state in UMAP.
This is done on the Colab platform, and I upgrade BERTopic to 0.16.2.
Any ideas on how I can reproduce topic modeling results using cuml? Thanks much!
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reproducing the Colab setup described in the issue with BERTopic 0.16.2, cuML UMAP, and cuML HDBSCAN, using the same random_state across repeated runs. Compare the resulting topic models and document whether deterministic results are possible and which configuration or limitation explains the difference.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100