Parquet write_table killed when run from script

Hello, I'm trying to merge a large quantity of Parquet files into a single Parquet file which works fine from Python shell. The files to merge are stored in the 'chunks' directory and the merge produces a 3.7G file.
And yet I fail to merge the files when running the same command from a Python script:
```
>>> import pandas as pd
>>> import pyarrow.parquet as pq
>>> chunks_path = './chunks'
>>> pq.write_table(pq.ParquetDataset(chunks_path).read(), 'merge_test.parquet', row_group_size=100000)
ubuntu@ip-xxx$ ls *.parquet
merge_test.parquet
ubuntu@ip-xxx1$ du -sh merge_test.parquet
3.7G merge_test.parquet
In Python Script:
print('combine results')
pq.write_table(pq.ParquetDataset(chunks_path).read(), 'results.parquet', row_group_size=100000)
Terminal:
combine results
killed
```

What may be the reason for the failure to merge the files when run from a script and how can it be fixed?
I'm using Ubuntu on ec2 instance('c5.12xlarge'), 48 vCPU cores, 96Mb RAM

Start with the reported Python entry points, pq.ParquetDataset(chunks_path).read() and pq.write_table(...), and reproduce the command in both the interactive shell and a script on Ubuntu. Inspect the process and available memory when the script is killed; done means identifying the difference, confirming the cause, and documenting or implementing a supported fix.

Written by the indexing model from the issue text.