dropbox / dropbox/PyHive

Hive Query Timeout - [Errno 110] Connection timed out

Open
#248 2 comments 2 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
1.7k
Forks
545
PR merge metrics
No merged PRs in 30d

Description

I am running Hive queries from Python using PyHive. One of the query is taking around 12-15 minutes to complete. I could see it completed on Hadoop ResourceManager UI, however I am seeing bellow timeout error on Python

Error:Traceback (most recent call last): File "/home/mrjadav/python/thunderbolt.py", line 704, in main() File "/home/mrjadav/python/thunderbolt.py", line 662, in main getColoLatency() File "/home/mrjadav/python/thunderbolt.py", line 582, in getColoLatency dataSet = saveHqlResultToXls(queryString=queryString, caption='Colo Latency Breakdown', configuration=g_hive_config_heavy) File "/home/mrjadav/python/thunderbolt.py", line 636, in saveHqlResultToXls dataSet=cursor.fetchall() File "/home/y/lib/python2.7/site-packages/pyhive/common.py", line 136, in fetchall return list(iter(self.fetchone, None)) File "/home/y/lib/python2.7/site-packages/pyhive/common.py", line 105, in fetchone self._fetch_while(lambda: not self._data and self._state != self._STATE_FINISHED) File "/home/y/lib/python2.7/site-packages/pyhive/common.py", line 45, in _fetch_while self._fetch_more() File "/home/y/lib/python2.7/site-packages/pyhive/hive.py", line 386, in _fetch_more response = self._connection.client.FetchResults(req) File "/home/y/lib/python2.7/site-packages/TCLIService/TCLIService.py", line 714, in FetchResults return self.recv_FetchResults() File "/home/y/lib/python2.7/site-packages/TCLIService/TCLIService.py", line 726, in recv_FetchResults (fname, mtype, rseqid) = iprot.readMessageBegin() File "/home/y/lib/python2.7/site-packages/thrift/protocol/TBinaryProtocol.py", line 134, in readMessageBegin sz = self.readI32() File "/home/y/lib/python2.7/site-packages/thrift/protocol/TBinaryProtocol.py", line 217, in readI32 buff = self.trans.readAll(4) File "/home/y/lib/python2.7/site-packages/thrift/transport/TTransport.py", line 60, in readAll chunk = self.read(sz - have) File "/home/y/lib/python2.7/site-packages/thrift_sasl/__init__.py", line 166, in read self._read_frame() File "/home/y/lib/python2.7/site-packages/thrift_sasl/__init__.py", line 170, in _read_frame header = self._trans.readAll(4) File "/home/y/lib/python2.7/site-packages/thrift/transport/TTransport.py", line 60, in readAll chunk = self.read(sz - have) File "/home/y/lib/python2.7/site-packages/thrift/transport/TSocket.py", line 117, in read buff = self.handle.recv(sz) error: [Errno 110] Connection timed out

Is there any specific parameter which can help me to fix this?

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.