JuliaParallel / JuliaParallel/ClusterManagers.jl

SGE (via qrsh): addprocs_qrsh() fails on cluster that supports qrsh

Open
#141 1 comment 1 reaction 0 assignees View on GitHub
manager: SGE
Dominant language
Julia
Stars
260
Forks
74
Avg merge
6m
Merged PRs (30d)
1

Description

When I use `addprocs_qrsh()` I get an error message and no jobs are created (checked in `qstat`).
```
ClusterManagers.addprocs_qrsh(3,res_list="h_rt=2:00:00,h_data=4G,highp")
Error launching workers
MethodError(iterate, (Process(`qrsh -l h_rt=2:00:00,h_data=4G,highp -V -N julia-13730 -now n cd /mydir '&&' /u/local/apps/julia/1.5.1/bin/julia --worker=2BuUs4aIkAHENSDE`, ProcessRunning),), 0x0000000000006caf)
Int64[]
````

My cluster does support `qrsh`. When I try to run the `qrsh` command manually in a shell, it produces these messages about host key, but does seem to allocate the worker, as I can see it in `qstat`.

```
qrsh -l h_rt=2:00:00,h_data=4G,highp -V -N julia-13730 -now n cd /mydir '&&' /u/local/apps/julia/1.5.1/bin/julia --worker=2BuUs4aIkAHENSDE
could not open any host key
ssh_keysign: no reply
key_sign failed
julia_worker:9934
```

```

job-ID prior name user state submit/start at queue jclass slots ja-task-ID
------------------------------------------------------------------------------------------------------------------------------------------------
4514401 0.50500 QRLOGIN user r 09/02/2020 00:05:14 my.q@nodexxx 2
```

When I use `addprocs_sge()` it works just fine.

---
This looks like the same issue as [this comment](https://github.com/JuliaParallel/ClusterManagers.jl/issues/122#issuecomment-601302365) but opened a new issue as that one was originally opened for a different purpose.

Julia 1.5.1
ClusterManagers.jl master branch dde400e953cd8cf631802866e164697019805a92

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.