opensearch-project / opensearch-project/data-prepper

data-prepper crashing on openshift

Open
#2,500 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

bug
Dominant language
Java
Stars
374
Forks
354
Avg merge
3d 18h
Merged PRs (30d)
8

Description

Discussed in https://github.com/opensearch-project/data-prepper/discussions/2499

Originally posted by ccntechgit April 15, 2023
OCP 4.12
Deployed data-prepper:2 in my namespace using the unchanged k8s deployment-template file "data-prepper-k8s.yaml"

Container started and crashes with the following errors:
Reading pipelines and data-prepper configuration files from Data Prepper home directory.
/opt/java/openjdk/bin/java
Found openjdk version of 17.0

2023-04-15 23:35:46,808 main ERROR Unable to create file log/data-prepper/data-prepper.log java.io.IOException: Could not create directory /usr/share/data-prepper/log/data-prepper

023-04-15 23:35:46,814 main ERROR Could not create plugin of type class org.apache.logging.log4j.core.appender.RollingFileAppender for element RollingFile: java.lang.IllegalStateException: ManagerFactory [org.apache.logging.log4j.core.appender.rolling.RollingFileManager$RollingFileManagerFactory@672872e1] unable to create manager for [log/data-prepper/data-prepper.log] with data [org.apache.logging.log4j.core.appender.rolling.RollingFileManager$FactoryData@32910148[pattern=logs/data-prepper.log.%d{MM-dd-yy-HH}-%i.gz, append=true, bufferedIO=true, bufferSize=8192, policy=CompositeTriggeringPolicy(policies=[TimeBasedTriggeringPolicy(nextRolloverMillis=0, interval=1, modulate=true), SizeBasedTriggeringPolicy(size=104857600)]), strategy=DefaultRolloverStrategy(min=1, max=168, useMax=true), advertiseURI=null, layout=%d{ISO8601} [%t] %-5p %40C - %m%n, filePermissions=null, fileOwner=null]] java.lang.IllegalStateException: ManagerFactory [org.apache.logging.log4j.core.appender.rolling.RollingFileManager$RollingFileManagerFactory@672872e1] unable to create manager for [log/data-prepper/data-prepper.log] with data [org.apache.logging.log4j.core.appender.rolling.RollingFileManager$FactoryData@32910148[pattern=logs/data-prepper.log.%d{MM-dd-yy-HH}-%i.gz, append=true, bufferedIO=true, bufferSize=8192, policy=CompositeTriggeringPolicy(policies=[TimeBasedTriggeringPolicy(nextRolloverMillis=0, interval=1, modulate=true), SizeBasedTriggeringPolicy(size=104857600)]), strategy=DefaultRolloverStrategy(min=1, max=168, useMax=true), advertiseURI=null, layout=%d{ISO8601} [%t] %-5p %40C - %m%n, filePermissions=null, fileOwner=null]]

2023-04-15 23:35:46,816 main ERROR Unable to invoke factory method in class org.apache.logging.log4j.core.appender.RollingFileAppender for element RollingFile: java.lang.IllegalStateException: No factory method found for class org.apache.logging.log4j.core.appender.RollingFileAppender java.lang.IllegalStateException: No factory method found for class org.apache.logging.log4j.core.appender.RollingFileAppender

If you need full see attached
console-output.log

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Begin with data-prepper-k8s.yaml and the attached console-output.log; inspect the container's configured home and log/data-prepper path under OpenShift. Done means the unchanged deployment starts without the RollingFileAppender errors and produces usable logs.

Written by the indexing model from the issue text.

Assessment

Tech stack
java, kubernetes
Domain
devops, infrastructure
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.