opensearch-project / opensearch-project/data-prepper
data-prepper crashing on openshift
Nobody has claimed this yet.
- Dominant language
- Java
- Stars
- 374
- Forks
- 354
- Avg merge
- 3d 18h
- Merged PRs (30d)
- 8
Description
Discussed in https://github.com/opensearch-project/data-prepper/discussions/2499
Originally posted by ccntechgit April 15, 2023
OCP 4.12
Deployed data-prepper:2 in my namespace using the unchanged k8s deployment-template file "data-prepper-k8s.yaml"
Container started and crashes with the following errors:
Reading pipelines and data-prepper configuration files from Data Prepper home directory.
/opt/java/openjdk/bin/java
Found openjdk version of 17.0
2023-04-15 23:35:46,808 main ERROR Unable to create file log/data-prepper/data-prepper.log java.io.IOException: Could not create directory /usr/share/data-prepper/log/data-prepper
023-04-15 23:35:46,814 main ERROR Could not create plugin of type class org.apache.logging.log4j.core.appender.RollingFileAppender for element RollingFile: java.lang.IllegalStateException: ManagerFactory [org.apache.logging.log4j.core.appender.rolling.RollingFileManager$RollingFileManagerFactory@672872e1] unable to create manager for [log/data-prepper/data-prepper.log] with data [org.apache.logging.log4j.core.appender.rolling.RollingFileManager$FactoryData@32910148[pattern=logs/data-prepper.log.%d{MM-dd-yy-HH}-%i.gz, append=true, bufferedIO=true, bufferSize=8192, policy=CompositeTriggeringPolicy(policies=[TimeBasedTriggeringPolicy(nextRolloverMillis=0, interval=1, modulate=true), SizeBasedTriggeringPolicy(size=104857600)]), strategy=DefaultRolloverStrategy(min=1, max=168, useMax=true), advertiseURI=null, layout=%d{ISO8601} [%t] %-5p %40C - %m%n, filePermissions=null, fileOwner=null]] java.lang.IllegalStateException: ManagerFactory [org.apache.logging.log4j.core.appender.rolling.RollingFileManager$RollingFileManagerFactory@672872e1] unable to create manager for [log/data-prepper/data-prepper.log] with data [org.apache.logging.log4j.core.appender.rolling.RollingFileManager$FactoryData@32910148[pattern=logs/data-prepper.log.%d{MM-dd-yy-HH}-%i.gz, append=true, bufferedIO=true, bufferSize=8192, policy=CompositeTriggeringPolicy(policies=[TimeBasedTriggeringPolicy(nextRolloverMillis=0, interval=1, modulate=true), SizeBasedTriggeringPolicy(size=104857600)]), strategy=DefaultRolloverStrategy(min=1, max=168, useMax=true), advertiseURI=null, layout=%d{ISO8601} [%t] %-5p %40C - %m%n, filePermissions=null, fileOwner=null]]
2023-04-15 23:35:46,816 main ERROR Unable to invoke factory method in class org.apache.logging.log4j.core.appender.RollingFileAppender for element RollingFile: java.lang.IllegalStateException: No factory method found for class org.apache.logging.log4j.core.appender.RollingFileAppender java.lang.IllegalStateException: No factory method found for class org.apache.logging.log4j.core.appender.RollingFileAppender
If you need full see attached
console-output.log
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Begin with data-prepper-k8s.yaml and the attached console-output.log; inspect the container's configured home and log/data-prepper path under OpenShift. Done means the unchanged deployment starts without the RollingFileAppender errors and produces usable logs.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java, kubernetes
- Domain
- devops, infrastructure
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100