allenai / allenai/specter

Can we get calculated embeddings directly into variable?

Open
#10 12 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
592
Forks
58
PR merge metrics
No merged PRs in 30d

Description

`embed.py` script calculates embeddings of inputs in `sample-metadata.json` and stores them in output file `output.jsonl`

```
python scripts/embed.py \
--ids data/sample.ids --metadata data/sample-metadata.json \
--model ./model.tar.gz \
--output-file output.jsonl \
--vocab-dir data/vocab/ \
--batch-size 16 \
--cuda-device -1
```
Is there any way to call the function directly from python script and get the output embeddings in a variable? ...something like the web-api is doing but locally, offline
I do not want to load the model for each evaluation call

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.