huggingface / huggingface/setfit
Regarding expanding the label column
- Dominant language
- Jupyter Notebook
- Stars
- 2.8k
- Forks
- 267
- Avg merge
- 36m
- Merged PRs (30d)
- 5
Description
Using the sentence transformers you have provided I tried different variations for the aspect model and the polarity model and obtained good results.
However I am interested in two more things which I tried and still couldn't achieve.
1) For ABSA tasks rather than three labels I wanted to expand it to 5, adding the more positive and more negative parts. We manually annotated our own dataset for this as for the format of the Laptop and restaurant 14 datasets you have provided. But it did not give the expected results. The polarities cannot be expanded to 5. How can I achieve this ? Can you guide on this matter.
2) Instead of the accuracies for the Polarity and aspect extraction separately I want an collective accuracy. A single accuracy that represents both. How can I do that?
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by reviewing the provided Laptop and restaurant 14 dataset formats and the existing aspect and polarity evaluation described in the issue. Define how five polarity labels and a combined accuracy should be evaluated; no implementation file or test entry point is identified in the issue.
Written by the indexing model from the issue text.
Assessment
- Domain
- machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100