typelevel / typelevel/cats-effect
IOApp hangs in Databricks 10.4LTS
Open
@gatear is already working on this.
Since Oct 17, 2022.
- Dominant language
- Scala
- Stars
- 2.2k
- Forks
- 576
- Avg merge
- 2d 11h
- Merged PRs (30d)
- 18
Description
The issue a simple IOApp executes all required code but then hangs indefinitely on 3.3.14.
import cats.effect._
object Test extends IOApp {
def run(args: List[String]): IO[ExitCode] =
IO.delay(ExitCode.Success)
}
The issue is somehow fixed on 3.4-4c07d83 where first time it runs successfully. The second run it hangs and I also get:
WARNING: Cats Effect global runtime already initialized; custom configurations will be ignored
For context on CE2 there were no such issues.
Now I assume it could be related to the way the lifetime of Spark containers is managed in Databricks, the shutdown hooks are not run reliably.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.