dotnet / dotnet/machinelearning
Please provide examples of the vocab and merge file formats
- Dominant language
- C#
- Stars
- 9.4k
- Forks
- 2k
- Avg merge
- 2d 20h
- Merged PRs (30d)
- 11
Description
Please provide examples of the vocab and merge file formats. Better yet, provide links to downloadable pre-created files for common purposes GPT3 etc.
---
#### Document Details
⚠ *Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.*
* ID: 909b9e8c-f08c-ba0a-6c31-7dd151699999
* Version Independent ID: 909b9e8c-f08c-ba0a-6c31-7dd151699999
* Content: [Bpe Constructor (Microsoft.ML.Tokenizers)](https://learn.microsoft.com/en-us/dotnet/api/microsoft.ml.tokenizers.bpe.-ctor?view=ml-dotnet-preview#microsoft-ml-tokenizers-bpe-ctor(system-string-system-string-system-string-system-string-system-string))
* Content Source: [dotnet/xml/Microsoft.ML.Tokenizers/Bpe.xml](https://github.com/dotnet/ml-api-docs/blob/live/dotnet/xml/Microsoft.ML.Tokenizers/Bpe.xml)
* Product: **dotnet-ml-api**
* GitHub Login: @natke
* Microsoft Alias: **nakersha**
Contributor guide
Assessment
This issue has not been assessed yet.