trinodb / trinodb/trino-python-client

Queries stuck in FINISHING time

Open
#463 5 comments 0 reactions 1 assignee View on GitHub

@hashhar is already working on this.

Since Jun 6, 2024.

bug
Dominant language
Python
Stars
439
Forks
206
PR merge metrics
No merged PRs in 30d

Description

Expected behavior

Queries' results should be successfully recieved to the client.

Actual behavior

In our Trino cluster, we are facing an issur that some queries remain stuck in the FINISHING state for an extended period before eventually failing with the error message: "Query was abandoned by the client, as it may have exited or stopped checking for query results."

After conducting some investigation, it appears that this issue predominantly occurs when querying Trino using the Python client. Here's a breakdown of the observed flow:

  1. In the main module, we execute the TrinoQuery.execute function with our query.
  2. This function initiates a POST request to the Trino coordinator.
  3. Subsequently, it sends a GET request to the nextUri to retrieve the initial batch of query results.
  4. As the results start arriving, the query state transitions to FINISHING.
  5. The execution of the execute function ends.
  6. Following this, the cursor.fetchall() function in the main module iterates over the nextUris, yielding each received row to the client. However, after a certain duration of fetching query results, the query fails with the "query abandon" error (as mentioned above).

Any assistance on resolving this significant issue would be greatly appreciated.

Thank you!!

Steps To Reproduce
  1. Is it advisable to incorporate heartbeats to the coordinator while fetching results?

  2. Would it be feasible to fetch multiple nextUris in parallel? I'm uncertain about this possibility due to the need to access nextUris as a linked list.

Log output

No response

Operating System

Windows

Trino Python client version

0.326.0

Trino Server version

439

Python version

3.9.3

Are you willing to submit PR?
  • Yes I am willing to submit a PR!

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.