andrewrk / andrewrk/node-diacritics

Use Unicode normalization?

Open
#22 0 comments 3 reactions 0 assignees View on GitHub
Dominant language
JavaScript
Stars
270
Forks
32
PR merge metrics
No merged PRs in 30d

Description

Unicode defines normalized forms for characters and character classes.

It might work to normalize strings to NFKD and remove any characters of class Mn (Nonspacing_Mark) (see [table 12](http://www.unicode.org/reports/tr44/#GC_Values_Table))

It might be necessary to specially handle conversions like ß to ss

See also [python stack overflow answer](http://stackoverflow.com/a/1410365/2607762)

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.