huggingface / huggingface/sentence-transformers

evaluation

Open
#169 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
19.1k
Forks
2.9k
Avg merge
1d 19h
Merged PRs (30d)
61

Description

Thanks for sharing the great work and library, I have a confusion in my understanding of evaluation , please clarify for my understanding.
1)The evaluation metrics can only be used during pre-training? if I fine-tune a model for some task, lets say k-mean clustering, so how would I evaluate my results.
2) can I fine-tune on any dataset?
thanks in advance

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reviewing the project's existing evaluation and fine-tuning guidance, focusing on the questions about clustering metrics and dataset suitability. Done means clarifying whether evaluation applies during fine-tuning, how k-means results should be assessed, and whether arbitrary datasets can be used.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Documentation
Difficulty
1/5
Estimated time
Under an hour
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.