influxdata / influxdata/telegraf

Add ability to parse other text encodings to tail/logparser input

Open
#6,775 6 comments 0 reactions 0 assignees View on GitHub
area/tail feature request platform/windows
Dominant language
Go
Stars
17.8k
Forks
5.8k
Avg merge
1d 20h
Merged PRs (30d)
161

Description

Relevant telegraf.conf:

[[inputs.logparser]]
files = ["C:\\Users\\jen.tomm\\Desktop\\applicationlog_2019-11-13_07-43-25\\sample.log"]
from_beginning = false
[inputs.logparser.grok]
measurement = "applicationlog"
patterns = ["^%{TIMESTAMP_ISO8601:timestamp},%{WORD:LogLevel},%{NUMBER:ThreadId},%{WORD:LoggerName},%{DATA:ServiceId},%{DATA:RequestId},%{DATA:UserId},%{DATA:RemoteDate},%{DATA:RemoteServer},%{DATA:RemoteProcessId},%{DATA:RemoteThreadId},%{GREEDYDATA:message}"]
### System info:
windows
telegraf 1.13

### Steps to reproduce:

1. parsing logs through log parser with grok pattern
2. using grafana log panel plugin to get the log metrics

### Expected behavior:

logs have to display with proper format but getting space between the letters

### Actual behavior:

getting space between the logs

2 0 1 9-1 1-1 3 0 4 : 5 4 : 5 4 . 8 6 1 0 0 0 , D E B U G, 6 1 0 0 , a p p
l i c a t i o n S e r v i c e , R e n d e r W o r k e r , , , , , , , " R e n d e r Q u e u e H a n d l e r _ R e a d B o d y : W o r k e r < E U D - V - 0 A 6 F 5 5 1 8 _ 0 > r e q u e s t < G e t J o b > "

### Additional info:

Date,LogLevel,ThreadId,LoggerName,ServiceId,RequestId,UserId,RemoteDate,RemoteServer,RemoteProcessId,RemoteThreadId,Message
2019-11-13 04:54:54.861000,DEBUG,6100,applicationService,RenderWorker,,,,,,,"RenderQueueHandler_ReadBody: Worker request "
2019-11-13 04:54:54.920000,NOTICE,4592,applicationService,EUD-V-0A6F55180|55ECC331,,jen.tomm,,,,,"QueueHandler::GrowServicePoolThreads: Growing thread pool count to <9>"

Contributor guide

Open the contributing guide

Research direction

Start with the tail/logparser input configuration and reproduce the Windows sample.log case using the provided Grok pattern. Identify how the input currently handles text encoding; done means supported non-default encodings parse without spaces between characters and the resulting logs display in the proper format.

Written by the indexing model from the issue text.

Assessment

Tech stack
go
Domain
backend
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.