elastic / elastic/eland

Add the required packages for BERT Japanese Tokenizer to the Eland docker image

Open
#709 0 comments 0 reactions 0 assignees View on GitHub
enhancement topic:NLP
Dominant language
Python
Stars
693
Forks
112
PR merge metrics
No merged PRs in 30d

Description

The BERT Japanese Tokenizer requires the following packages that are not including in the Docker image.

- fugashi
- ipadic
- unidic_lite

The list comes from the PR description where BERT Japanese was added https://github.com/elastic/eland/pull/529

Contributor guide

Open the contributing guide

Research direction

Inspect the Eland Docker image definition and compare its installed packages with the BERT Japanese Tokenizer requirements listed here: fugashi, ipadic, and unidic_lite. Build the image and verify that these packages are available for the tokenizer; done means the image includes all three dependencies.

Written by the indexing model from the issue text.

Assessment

Tech stack
docker, python
Domain
devops
Issue type
Bug
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Stale
Clarity
Clearly specified
Newbie friendliness
42/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.