Graylog2 / Graylog2/graylog2-server
json extractors not work with non-english field name
- Dominant language
- Java
- Stars
- 8.1k
- Forks
- 1.1k
- Avg merge
- 1d 20h
- Merged PRs (30d)
- 217
Description
I have send some json message via raw udp input, each json message contain UTF-8 non-english field name like this:

When I try json extractor with default config,seems work good as below:

So I add json extractor like this and also try passed.
Configuration
flatten:
list_separator: ,
kv_separator: =
key_prefix: j_
key_separator: _
replace_key_whitespace:
key_whitespace_replacement: _
## Expected Behavior
I can see some english field works with json extractor:

But non-english field can not see:

Here is my json message example:
{"source":"stream:icmp","sourcetype":"icmp","time":1632071413.6059999466,"endtime":"2021-09-19T17:10:13.606360Z","timestamp":"2021-09-19T17:10:13.606360Z","字节":135,"入向字节":135,"出向字节":0,"校验和":33039,"消息代码":0,"目标ip":"100.100.10.6","目标mac":"D2:AE:52:6C:52:47","标识符":2570,"详细协议":"ip:icmp","序列号":2631,"源ip":"100.10.10.12","源mac":"01:50:56:9A:F3:D9","总用时":0,"消息类型":5,"类型说明":"Redirect"}
Thank you for your help
* Graylog Version: Graylog v4.1.5+01c9198
* Java Version: openjdk version "1.8.0_292"
* Elasticsearch Version:7.10.1
* MongoDB Version: MongoDB shell version v4.0.27
* Operating System: ubuntu 20.04
* Browser version: Firefox 92.0
Contributor guide
Assessment
This issue has not been assessed yet.