humanmade / humanmade/hm-content-import

Iterator that supports multiple items within files

Open
#56 1 comment 0 reactions 1 assignee Claimed by @johnbillion View on GitHub
enhancement
Dominant language
PHP
Stars
30
Forks
7
Avg merge
6h 39m
Merged PRs (30d)
2

Description

Using a separate file for each individual exported item is fine until you get to really large numbers and want to batch multiple items into a file in order to reduce the overall number of files (for I/O performance purposes, for example).

I'm working on writing an iterator that supports a JSON encoded array within each file that gets iterated over by the Files iterator, including support for updating the progress bar correctly, and only passing one item to `process_item()` as expected.

Combined with #55 this allows for much more efficient use of files on the filesystem.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.