MaartenGr / MaartenGr/BERTopic

openai topic representations are not finishing

Open
#1,391 11 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
7.8k
Forks
920
Avg merge
22h 24m
Merged PRs (30d)
5

Description

I'm currently working on an example, but it's taking longer than expected. I've noticed that it's using up some of my openai credit, even though it's not finished yet. Could you help me troubleshoot this issue? Additionally, I was wondering if there's a way to print logs to track the progress of each step in bertopic.

prompt="""
I have a topic that is described by the following keywords: [KEYWORDS]
In this topic, the following documents are a small but representative subset of all documents in the topic:
[DOCUMENTS]
Based on the information above, please give a description of this topic in the following format:
topic: <description>
"""

representation_model = OpenAI(model="gpt-3.5-turbo", delay_in_seconds=20,prompt=prompt, chat=True)

topic_model = BERTopic('english',nr_topics=5,representation_model=representation_model)

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

No repository file or test is named. Start by reproducing the provided Python snippet with the OpenAI representation model and record which topic-representation step does not finish; done means identifying the blocking behavior and documenting a reproducible fix or progress output.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.