4paradigm / 4paradigm/OpenMLDB
complain HADOOP_CONF_DIR not set error even configured hadoop.conf.dir
- Dominant language
- C++
- Stars
- 1.7k
- Forks
- 331
- Avg merge
- 12d 12h
- Merged PRs (30d)
- 1
Description
**Bug Description**
i configured hadoop.conf.dir of taskmanager.properties, but jobs still complain about "When running with master 'yarn' either HADOOP_CONF_DIR or YARN_CONF_DIR must be set in the environment."
**Expected Behavior**
job execute normally
**Steps to Reproduce**
1.
2.
3.
4.
Contributor guide
Research direction
The issue mentions a configuration property 'hadoop.conf.dir' in taskmanager.properties and an error about HADOOP_CONF_DIR or YARN_CONF_DIR environment variables. Look for taskmanager configuration parsing code and how Hadoop/YARN integration is initialized. Check if the property is being read and used to set the environment. The bug likely involves the interaction between configuration files and environment variable setup for YARN master mode.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- hadoop
- Domain
- backend, databases, machine-learning
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100