linkedin / linkedin/dr-elephant

Compilation error spark 2.2.3 and hadoop 2.7

Open
#541 2 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Java
Stars
1.4k
Forks
839
PR merge metrics
No merged PRs in 30d

Description

Hi,

I am first time trying to use dr-elephant. Trying to compile on mac and failing with below:
Command is: play -Dhadoopversion=2.7.0 -Dsparkversion=2.2.3 -Dsbt.repository.config=app-conf/resolver.conf clean compile test
activator is ~/Development/Tools/activator-dist-1.3.12//bin/activator
[info] Loading global plugins from ~/.sbt/0.13/plugins
[info] Loading project definition from ~/Development/workspace/git/dr-elephant/dr-elephant/project
[error] ~/Development/workspace/git/dr-elephant/dr-elephant/project/Dependencies.scala:17: object Project is not a member of package play
[error] import play.Project._
[error] ^
[error] ~/Development/workspace/git/dr-elephant/dr-elephant/project/Dependencies.scala:102: not found: value javaJdbc
[error] var dependencies = Seq(javaJdbc, javaEbean, cache)
[error] ^
[error] ~/Development/workspace/git/dr-elephant/dr-elephant/project/Dependencies.scala:102: not found: value javaEbean
[error] var dependencies = Seq(javaJdbc, javaEbean, cache)
[error] ^
[error] ~/Development/workspace/git/dr-elephant/dr-elephant/project/Dependencies.scala:102: not found: value cache
[error] var dependencies = Seq(javaJdbc, javaEbean, cache)
[error] ^
[error] four errors found
[error] (compile:compile) Compilation failed

Appreciate any help.

Thanks,
Ravi Papisetti

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Reproduce the reported command with the stated Spark 2.2.3 and Hadoop 2.7.0 versions, then inspect project/Dependencies.scala at the failing import and dependency declarations. Done means the project compiles and the test task completes without the reported errors.

Written by the indexing model from the issue text.

Assessment

Tech stack
hadoop, java, spark
Domain
build-system
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.