gorse-io / gorse-io/gorse

System Status metrics

Open
#997 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Go
Stars
9.8k
Forks
912
Avg merge
2h 35m
Merged PRs (30d)
9

Description

Hi,
While testing the system, I noticed that some metrics ( e.g. Matching Model Precision@10) show very low values (below 10%).
To rule out issues related to the dataset or configuration, I instantiated the container in playground mode following the official instructions. However, I obtained similar results (as shown in the attached screenshot).
Is this behavior expected? Am i misinterpreting those metrics?
Additionally, I tried modifying some parameters in the config.toml file, and even after restarting the container to ensure the changes were applied, I didn't observe any differences in the metric results.
Is the config.toml supposed to affect evaluation metrics directly, or am I missing a required step to apply the changes?
Finally, I would appreciate some clarification on the metrics terminology:
What exactly do "matching model" and "ranking model" refer to in this context?
Thanks in advance!

![Image](https://github.com/user-attachments/assets/d51ec3b4-6902-48e0-a47c-52510dfb171f)

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.