huggingface / huggingface/torchMoji

Format for tsv file for new vocab

Open
#31 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
920
Forks
185
PR merge metrics
No merged PRs in 30d

Description

I'm trying to train the model using my own data.
In the examples directory, it says to run: `create_twitter_vocab.py`
This script tries to open this file: `../../twitterdata/tweets.2016-09-01
`
But there is not such file in repo. Can you please help me understand what is the format of this data file? I understand this is a tsv but what are the contents of this file?

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reading examples/create_twitter_vocab.py and check how it opens ../../twitterdata/tweets.2016-09-01. Document the expected TSV contents and explain where the data file should come from, so someone training with their own data can prepare the file and run the script successfully.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
documentation
Issue type
Documentation
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.