Server Error 500 : ERROR - django.request Internal Server Error

Hello Developers

Could you extend your help in fixing this issue


Calamari.log

```
2015-06-23 13:53:41,317 - metric_access - django.request No graphite data for ceph.cluster.9609b429-eee2-4e23-af31-28a24fcf5cbc.df.total_used_bytes
2015-06-23 13:53:41,329 - metric_access - django.request No graphite data for ceph.cluster.9609b429-eee2-4e23-af31-28a24fcf5cbc.df.total_used
2015-06-23 13:53:41,330 - metric_access - django.request No graphite data for ceph.cluster.9609b429-eee2-4e23-af31-28a24fcf5cbc.df.total_space
2015-06-23 13:53:41,330 - metric_access - django.request No graphite data for ceph.cluster.9609b429-eee2-4e23-af31-28a24fcf5cbc.df.total_avail
2015-06-23 13:53:41,394 - ERROR - django.request Internal Server Error: /api/v1/cluster/9609b429-eee2-4e23-af31-28a24fcf5cbc/health_counters
Traceback (most recent call last):
File "/opt/calamari/venv/lib/python2.7/site-packages/django/core/handlers/base.py", line 115, in get_response
response = callback(request, *callback_args, **callback_kwargs)
File "/opt/calamari/venv/lib/python2.7/site-packages/rest_framework/viewsets.py", line 78, in view
return self.dispatch(request, *args, **kwargs)
File "/opt/calamari/venv/lib/python2.7/site-packages/calamari_rest_api-0.1-py2.7.egg/calamari_rest/views/rpc_view.py", line 94, in dispatch
self.client.close()
File "/opt/calamari/venv/lib/python2.7/site-packages/zerorpc/core.py", line 292, in close
ClientBase.close(self)
File "/opt/calamari/venv/lib/python2.7/site-packages/zerorpc/core.py", line 194, in close
self._multiplexer.close()
File "/opt/calamari/venv/lib/python2.7/site-packages/zerorpc/channel.py", line 61, in close
self._channel_dispatcher_task.kill()
File "/opt/calamari/venv/lib/python2.7/site-packages/gevent/greenlet.py", line 235, in kill
waiter.get()
File "/opt/calamari/venv/lib/python2.7/site-packages/gevent/hub.py", line 575, in get
return self.hub.switch()
File "/opt/calamari/venv/lib/python2.7/site-packages/gevent/hub.py", line 338, in switch
return greenlet.switch(self)
LostRemote: Lost remote after 10s heartbeat
```

My environment details

```
[root@ceph-node1 ~]# rpm -qa | grep -i supervisor
supervisor-3.0-1.el7.noarch
[root@ceph-node1 ~]#
[root@ceph-node1 ~]# rpm -qa | grep -i calamari
calamari-server-1.3.0.1-49_g828960a.el7.centos.x86_64
calamari-clients-1.2.2-32_g931ee58.el7.centos.x86_64
[root@ceph-node1 ~]#
[root@ceph-node1 ~]# ceph -v
ceph version 0.87.1 (283c2e7cfa2457799f534744d7d549f83ea1335e)
[root@ceph-node1 ~]#
[root@ceph-node1 ~]# cat /etc/redhat-release
CentOS Linux release 7.0.1406 (Core)
[root@ceph-node1 ~]#
[root@ceph-node1 ~]# rpm -qa | grep -i salt
salt-2015.5.0-1.el7.noarch
salt-master-2015.5.0-1.el7.noarch
salt-minion-2015.5.0-1.el7.noarch
[root@ceph-node1 ~]#
```

Start with the /api/v1/cluster/{id}/health_counters endpoint and the rpc_view.py dispatch path shown in the traceback, especially the client.close() call at line 94. Reproduce the request using the reported Calamari, Ceph, CentOS, Salt, and Supervisor versions, then trace the LostRemote heartbeat failure. Done means the endpoint no longer returns HTTP 500 and its health-counter response remains correct.

Written by the indexing model from the issue text.