Advice on large number of PUTs

Hi All,
I need to create almost 2m small files in an S3 bucket (see the `make.js` script at https://github.com/Digital-Contraptions-Imaginarium/frugal-addresses-onspd/tree/write-to-s3-directly if you are curious).

I am wondering what is the best practice to use knox to do that effectively. At the moment, I am simply writing the files one by one and observing that after the first 4000 PUTs the process becomes very slow. My guess is that there is some "buffer" of PUT requests that can't get processed fast enough.

Any advice is welcome, thanks,

Giacecco

Start by reviewing the make.js script in the write-to-s3-directly branch, then examine how Knox handles the sequence of PUT requests. The issue does not define a specific implementation or test target; completion would require agreeing on the desired best-practice behavior for creating nearly 2 million S3 objects.

Written by the indexing model from the issue text.