linkedin / linkedin/transport

Test framework should create runtime tmp files in non-root directory

Open
#38 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Java
Stars
306
Forks
75
PR merge metrics
No merged PRs in 30d

Description

When we run hive/spark tests through the test framework, it will create some files in the root folder of the project such as

metastore_db/
derby.log
hdfs_cache/

Right now we add these to .gitignore to ignore them. We should consider setting appropriate configs so that these files are generated in tmp directories and not in the root directory.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

No files or tests are named. Reproduce the Hive/Spark test run and inspect the test framework’s runtime configuration to identify where metastore_db, derby.log, and hdfs_cache are created. Done means these artifacts are placed in temporary directories and no longer require root-level .gitignore entries.

Written by the indexing model from the issue text.

Assessment

Tech stack
java, spark
Domain
testing-qa
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.