jonathanbratt / jonathanbratt/RBERT

figure out better way to pass token type ids to model

Open
#61 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
R
Stars
166
Forks
19
PR merge metrics
No merged PRs in 30d

Description

currently, I attach tt_ids as an attribute to the tokenized input in `tokenize_input`. It feels like a misuse of attributes, but I also don't want to, say, pass the tt_ids as part of a list along with the tokenized input. We could just figure out the tt ids later, and calculate them when we need them to run the model?

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.