drive: Batch creation of directories
Nobody has claimed this yet.
- Dominant language
- Go
- Stars
- 59.8k
- Forks
- 5.4k
- Avg merge
- 2d 14h
- Merged PRs (30d)
- 48
Description
What is your current rclone version (output from rclone version)?
rclone v1.45
What problem are you are trying to solve?
I have a backup application that creates a large directory structure to store file chunks in (65535 directories at top level). When replicating this, it takes almost 9 hours to recreate the directory structure on Google Drive.
It seems that rclone is performing one directory creation per API call.
How do you think rclone should be changed to solve that?
I see Google Drive supports batch operations of up to 100 operations per API call. If it is possible, it would be great if rclone could create 100 directories at a time. This would significantly drop the time needed to create large directory structures.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
The issue names no files or tests; start by tracing rclone’s Google Drive directory-creation path and reviewing the Google Drive batch-operation API. Confirm that batching directory creates preserves existing behavior and that completion is verified by tests or measurements covering large directory structures.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- go
- Domain
- api, cloud
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100