json.dump(x,f) is much slower than f.write(json.dumps(x))

Bug report

Bug description:

Experimentally I measured a huge performance improvement when I switched my code from

json.dump(x, f, **)

to

f.write(json.dumps(x, **))

Method

I essentially wrote the same contents to different files sequentially and measured the total amount of time taken. The json contents had 1, 300, and 400 entries per level, and 1, 5, and 6 levels of depth. There's quite a level of variance here but this wasn't what I was trying to measure in the first place. I discovered this by chance, so forgive the lack of precision. I also don't have the source code anymore because I wasn't originally planning to report this discovery.

Results

Conclusion

A cursory investigation into the cpython code suggests that the slow part is the sequential writing of the iterencode yield. The chunks are quite small.

CPython versions tested on:

3.10

Operating systems tested on:

macOS

Linked PRs

• gh-130076

Bắt đầu bằng việc xem xét PR gh-130076 được liên kết và mã JSON của CPython liên quan đến các lần ghi tuần tự từ iterencode. Tái hiện các phép đo thời gian dump-versus-dumps đã được báo cáo, sau đó xác minh rằng thay đổi này cải thiện hiệu năng dump đối với các trường hợp lớn hơn mà không thay đổi đầu ra.