explosion / explosion/spaCy

Japanese model missing url_match

Open
#13,928 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
33.9k
Forks
4.7k
Avg merge
3m
Merged PRs (30d)
1

Description

## How to reproduce the behaviour

```
import spacy
nlp = spacy.load("ja_core_news_md")
text = "詳細はこちらのサイトをご覧ください:https://example.com/jp"
doc = nlp(text)
for token in doc:
print(token.text)
```

Output:

```
詳細

こちら

サイト

ご覧
ください

https
:
/
/
example
.
com
/
jp
```

## Your Environment

- **spaCy version:** 3.8.11
- **Platform:** Linux-6.16.1-arch1-1-x86_64-with-glibc2.42
- **Python version:** 3.12.10
- **Pipelines:** ja_core_news_md (3.8.0), it_core_news_md (3.8.0), pt_core_news_md (3.8.0), en_core_web_trf (3.8.0), en_core_web_sm (3.8.0), nl_core_news_md (3.8.0), en_core_web_md (3.8.0), es_core_news_md (3.8.0), fr_core_news_md (3.8.0), de_core_news_md (3.8.0)

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.