huggingface / huggingface/setfit

Regarding expanding the label column

Open
#521 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
2.8k
Forks
267
Avg merge
36m
Merged PRs (30d)
5

Description

Using the sentence transformers you have provided I tried different variations for the aspect model and the polarity model and obtained good results.
However I am interested in two more things which I tried and still couldn't achieve.

1) For ABSA tasks rather than three labels I wanted to expand it to 5, adding the more positive and more negative parts. We manually annotated our own dataset for this as for the format of the Laptop and restaurant 14 datasets you have provided. But it did not give the expected results. The polarities cannot be expanded to 5. How can I achieve this ? Can you guide on this matter.

2) Instead of the accuracies for the Polarity and aspect extraction separately I want an collective accuracy. A single accuracy that represents both. How can I do that?

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reviewing the provided Laptop and restaurant 14 dataset formats and the existing aspect and polarity evaluation described in the issue. Define how five polarity labels and a combined accuracy should be evaluated; no implementation file or test entry point is identified in the issue.

Written by the indexing model from the issue text.

Assessment

Domain
machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.