TikToken Tokenizer from scratch ?

Open
#303 0 comments 17 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Assessment

Difficulty
2/5
Estimated time
1-3 hours
Newbie friendliness
35/100
Issue type
Documentation
Clarity
Mostly clear
Activity status
Stale
Tech stack
python

Research direction

The issue names no files, tests, or entry points. Begin by locating the tokenizer-training API and compare its options with min_frequency and min_length; done means providing a custom-dataset training example and clearly documenting whether those options are supported.

Written by the indexing model from the issue text.

Description

Hey, considering its superiority over SPE tokenizers

would you provide some sample/example code to train a tiktoken tokenizer from scratch on a custom dataset

also like training BPE/SPE does it support min_frequency and min_length for tokens while training ?

Dominant language
Python
Stars
19.3k
Forks
1.6k
PR merge metrics
No merged PRs in 30d

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from openai/tiktoken

All issues in openai/tiktoken

Similar issues

More Python issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.