FluxML / FluxML/FastAI.jl

Add character and word level tokenizers

Open
#24 3 comments 0 reactions 0 assignees View on GitHub
enhancement gsoc-proposal
Dominant language
Julia
Stars
592
Forks
49
No merged PRs in 30d

Description

Add simple character and word level tokenizers that conform to the LearnBase.jl `getobs`/`nobs` interfaces.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.