How to correctly define "--included-text-fields" when embedding data
- Ngôn ngữ chính
- Python
- Star
- 592
- Fork
- 58
- Chỉ số merge pull request
- Không có pull request nào được merge trong 30 ngày
Mô tả
Hi there,
I have used the pretrained model to embed my own data. In `scripts/embed.py`, there is an argument `--included-text-fields` which seems to be a user-defined option. Since I would like to compare the embedding of the title, title+abstract and also all the content of an article containing results, conclusion, and etc.; however, it doesn't work when I override the value such as `abstract title results`. Besides, I found that when `title` is given to `--included-text-fields` , the embedding differs from the same condition but with abstract removed.
Is there any limitation regarding to this issue?
The corresponding input format:
metadata.json
{
doc_id: { "title": "..........",
"abstract": "..........",
"results": "..........",
"conclusion": "..........",
"other_content": "..........",
"paper_id": doc_id },
...
}
Hướng dẫn đóng góp
Chưa lập chỉ mục được hướng dẫn đóng góp cho kho mã nguồn này
Đánh giá
Issue này chưa được đánh giá.