aws / aws/amazon-redshift-python-driver

write_dataframe() does not finish

Open
#250 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
220
Forks
86
PR merge metrics
No merged PRs in 30d

Description

I'm trying to write a `pandas.DataFrame` into a table using the `write_dataframe `function but I tried waiting 10 minutes, and it does not finish.

I limited the size of the dataframe to have around 70 rows and 40 columns, the problem persists.

In the debugger, the code is stuck when calling the libray code `self.executemany(sql, arrays)` into `write_dataframe `.

How can I know what is the problem? I can read successfully another table. The table where I want to write was just created for testing purpouses.

Thanks

Contributor guide

Open the contributing guide

Research direction

Start at write_dataframe() and inspect the self.executemany(sql, arrays) call described in the report. Reproduce the hang with a roughly 70-row, 40-column pandas.DataFrame and the newly created test table, then determine what allows the write to finish and verify that the dataframe is inserted successfully.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, pandas, python
Domain
databases
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.