MaartenGr / MaartenGr/BERTopic

scikit-learn 1.1.0 error, when installing OCTIS

Open
#2,320 2 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

bug
Dominant language
Python
Stars
7.8k
Forks
920
Avg merge
22h 24m
Merged PRs (30d)
5

Description

### Have you searched existing issues? 🔎

- [x] I have searched and found no existing issues

### Desribe the bug

I have run a BERTopic model on my a customer feedback dataset of my own, and now I want to use the OCTIS package to evaluate TC and TD. However, I encounter an issue when installing OCTIS due to a dependency on scikit-learn==1.1.0. I am using Google Colab and have attempted to debug the issue with Gemini, but without success.

### Reproduction

!pip install octis

Collecting octis
Using cached octis-1.14.0-py2.py3-none-any.whl.metadata (27 kB)
Collecting gensim<5.0,>=4.2.0 (from octis)
Using cached gensim-4.3.3-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (8.1 kB)
Requirement already satisfied: nltk in /usr/local/lib/python3.11/dist-packages (from octis) (3.9.1)
Requirement already satisfied: pandas in /usr/local/lib/python3.11/dist-packages (from octis) (2.2.2)
Requirement already satisfied: spacy in /usr/local/lib/python3.11/dist-packages (from octis) (3.8.4)
Collecting scikit-learn==1.1.0 (from octis)
Using cached scikit-learn-1.1.0.tar.gz (6.8 MB)
Installing build dependencies ... done
Getting requirements to build wheel ... done
error: subprocess-exited-with-error

× Preparing metadata (pyproject.toml) did not run successfully.
│ exit code: 1
╰─> See above for output.

note: This error originates from a subprocess, and is likely not a problem with pip.
Preparing metadata (pyproject.toml) ... error
error: metadata-generation-failed

× Encountered error while generating package metadata.
╰─> See above for output.

note: This is an issue with the package mentioned above, not pip.
hint: See above for details.

### BERTopic Version

0.17.0

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reproducing the reported `!pip install octis` failure in Google Colab with BERTopic 0.17.0, then inspect the dependency-resolution output for the pinned scikit-learn==1.1.0 requirement. Done should be a clearly scoped, reproducible finding that identifies whether the issue belongs in BERTopic or in the OCTIS dependency chain.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, scikit-learn
Domain
build-system, machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.