adobe / adobe/da-admin

[list] Copying large folders is unreliable

Open
#244 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
JavaScript
Stars
6
Forks
17
PR merge metrics
No merged PRs in 30d

Description

We have several issues that creates instability with large (> 500 items) folder copies.

1. Fundamental issues with content integrity we (or S3 SDK) dies on - "empty" or `//` prefixes
2. The relationship with `DA_JOBS` seems brittle. I cannot reliably copy anything of meaningful size.
3. We are not resilient to "Network changed" errors that may happen on the client. Ideally the client has a way to pick up where they left off. This could be as simple as getting the continuation token and when supplying back da-admin looks at DA_JOBS to see if there's an existing job.

Contributor guide

Open the contributing guide

Research direction

No files, tests, or entry points are named. Start by tracing large-folder copy handling in da-admin, including the S3 SDK interaction and DA_JOBS relationship; reproduce a copy over 500 items and document what completion and resume behavior should look like.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, javascript
Domain
cli, cloud
Issue type
Bug
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.