Add the required packages for BERT Japanese Tokenizer to the Eland docker image
Open
enhancement
topic:NLP
- Dominant language
- Python
- Stars
- 693
- Forks
- 112
- PR merge metrics
- No merged PRs in 30d
Description
The BERT Japanese Tokenizer requires the following packages that are not including in the Docker image.
- fugashi
- ipadic
- unidic_lite
The list comes from the PR description where BERT Japanese was added https://github.com/elastic/eland/pull/529
Contributor guide
Research direction
Inspect the Eland Docker image definition and compare its installed packages with the BERT Japanese Tokenizer requirements listed here: fugashi, ipadic, and unidic_lite. Build the image and verify that these packages are available for the tokenizer; done means the image includes all three dependencies.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- docker, python
- Domain
- devops
- Issue type
- Bug
- Difficulty
- 2/5
- Estimated time
- 1-3 hours
- Activity status
- Stale
- Clarity
- Clearly specified
- Newbie friendliness
- 42/100