explosion / explosion/spaCy

Installation issue on old macOSes for new Korean tokenizer in v4.0 alpha

Open
#12,416 1 comment 0 reactions 0 assignees View on GitHub
lang / ko
Dominant language
Python
Stars
33.9k
Forks
4.7k
Avg merge
3m
Merged PRs (30d)
1

Description

Hi, I noticed from #12328 that spaCy has switched to `pymecab-ko` for the Korean tokenizer in the upcoming `spaCy` 4.0, but there seems to be some installation/import issues of this package on macOSes (cf. [pymecab-ko/#5](https://github.com/NoUnique/pymecab-ko/issues/5)).

I've tried on OS X 10.11 that [python-mecab-ko](https://github.com/jonghwanhyeon/python-mecab-ko), the alternative mentioned in #12328, could be successfully compiled, installed, and imported. I'm wondering that whether it is possible to add this as another alternative for the Korean tokenizer in `spaCy` 4.0?

## Your Environment

* Operating System: Windows 11 x64, OS X 10.11
* Python Version Used: 3.9.16
* spaCy Version Used: 4.0 alpha

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.