FOC Devnet scenarios run report (frontier)

The **frontier** scenarios run **failed ❌**.
See [the workflow run](https://github.com/FilOzone/foc-devnet/actions/runs/33485248106) for details.

# Scenarios Tests

| Description | Data |
|-------------| ------------------------------------------------------------------- |
| Type | **frontier** |
| Date | 01-September-2026 08:43:04 GMT +0 |
| Status | PASS ✅:**5**, FAIL 🟥:**1**, Total:6 |
| CI run | [https://github.com/FilOzone/foc-devnet/actions/runs/33485248106](https://github.com/FilOzone/foc-devnet/actions/runs/33485248106) |

## Versions info
```
foc-devnet 1.0.0-rc.1
Commit: 3381232169ed712a6e6848c39698c751d08823ca
Branch: main
Built (UTC): 2026-09-01 08:22:43 UTC (20 minutes ago)
Built (Local): 2026-09-01 08:22:43 +00:00

default:code:lotus: https://github.com/filecoin-project/lotus.git, tag v1.36.2
default:code:curio: https://github.com/filecoin-project/curio.git, tag v1.28.6
default:code:filecoin-services: https://github.com/FilOzone/filecoin-services.git, tag v1.3.1
default:code:multicall3: https://github.com/mds1/multicall3.git, tag v3.1.0
```

## Resolved dependencies
| Dependency | Source | Version/ref | Commit | Overrides |
|---|---|---|---|---|
| curio | git | `main` | `b8467c315a18af4981991550d8ecfb3ac0388f07` | - |
| filecoin-pin | git | `master` | `0933c5f3b585095878946ef2dabe261ffcf38670` | - |
| filecoin-services | git | `main` | `c7ad4c5a700455a97f2f776d087ae23e9779511f` | - |
| lotus | git | `master` | `ecc2f390c78428fa8e2a60b3abe33daee1bcb277` | - |
| pdp | git | `main` | `cc3f5eaffee7df80471b671a4e35a42b000685b8` | - |
| synapse-sdk | pkg_pr_new | `https://pkg.pr.new/FilOzone/synapse-sdk/@filoz/synapse-sdk@1af645a` | `1af645a395a883a2239e951493a49084011ad42b` | - |

## Tests summary

✅ test_containers - PASS (0s)

```
[ OK ] container foc-20260901T0831_BoingPomp-lotus is running
[ OK ] container foc-20260901T0831_BoingPomp-lotus-miner is running
[ OK ] container foc-20260901T0831_BoingPomp-curio-1 is running
[ OK ] container foc-20260901T0831_BoingPomp-curio-2 is running
```

✅ test_basic_balances - PASS (0s)

```
[ OK ] cast is installed
[ OK ] at least one user exists
[ OK ] USER_1 FIL balance > 0
[ OK ] USER_1 USDFC balance > 0
[ OK ] USER_2 FIL balance > 0
[ OK ] USER_2 USDFC balance > 0
[ OK ] USER_3 FIL balance > 0
[ OK ] USER_3 USDFC balance > 0
```

✅ test_create_dataset_smoke - PASS (46s)

```
[ OK ] node is installed
[ OK ] install Synapse consumer runtime
[INFO] Synapse runtime: pkg_pr_new:@filoz/synapse-sdk@1af645a395a883a2239e951493a49084011ad42b
[INFO] Running createDataSet smoke script against devnet
[INFO] === Synapse data set creation probe ===
Provider: 1 (http://host.docker.internal:5711)
Plain ERC20 preparation: ready=false deposit=656000000002169600 approval=true
USDFC approval submitted: 0xa0b763924f0eb3c147310244ff0f7397e31525d4c96c9e2443ca9c0f809dc43b
FilecoinPay deposit submitted: 0xd0e27acb3dd9ef3a91248a08182a08a5d02e33b761903122cbe595bbb287b185
FWSS approval submitted: 0xde29d8b871f04fc6aae8d6a19da8de99c6ad0cd5ea68ac3ab76ef550b4610f68
Data set creation submitted: 0xb10af71c81b1d5d95f405e84c6b6315a81867e43140d4ae89309dd84ca5f1980
Data set created and verified: 1
[ OK ] createDataSet smoke test
```

❌ test_synapse_e2e - FAIL (27s)

```
[FAIL] Synapse system E2E (exit=1) Replication failed: provider=2 piece=bafkzcibfqcapabiuuwbw4j3fajxirwml7a4bkrhop6gipo3u47drjeusofmnyitg3yaq: Failed to pull pieces from storage provider.

Details: Service Provider PDP
Invalid pull payer: decode combined extraData: abi: cannot marshal in to go slice: offset 45921515623899465284282526249268533423382839566343209301117805142375967944578 would go over slice boundary (len=448) [eid: c86962a5-7acc-42d3-9d99-6007e0c5a2fb]

AssertionError [ERR_ASSERTION]: Upload incomplete: 1/2 copies

false !== true

at assertCompleteReplication (file:///tmp/synapse-e2e-44najzu6/storage.ts:120:10)
at main (file:///tmp/synapse-e2e-44najzu6/system-e2e.ts:31:3)
at process.processTicksAndRejections (node:internal/process/task_queues:104:5) {
generatedMessage: false,
code: 'ERR_ASSERTION',
actual: false,
expected: true,
operator: 'strictEqual',
diff: 'simple'
}
=== Synapse system E2E ===
Network: devnet run=20260901T0831_BoingPomp
Fresh metadata: {"scenario":"system-e2e","run":"mtif2v16-1n2i"}

Phase 1: initialize account
Wallet: 0x47CC9101fD026fC112D7FADf6B3c9DF5bE7D4A8c

Phase 2: prepare payment account
Account preparation: ready=true deposit=0 approval=false
Prepared payment state: funds=10000000000000000000 available=10000000000000000000 lockup=0

Phase 3: upload and replicate
Uploading /tmp/synapse-e2e-44najzu6/random_file (20971520 bytes) with 2 copy target
Provider selected: 1 (0x446339aE7245e3cd1FeD701b685C196C69af695e)
Provider selected: 2 (0xC60bc6fb60901c2d28ba6e4F8AD4915Bd2106497)
Upload progress: 10485760/20971520
Upload progress: 20971520/20971520
Primary stored: provider=1 piece=bafkzcibfqcapabiuuwbw4j3fajxirwml7a4bkrhop6gipo3u47drjeusofmnyitg3yaq
Commit submitted: provider=1 tx=0x9e9ac2f1f7f5c226ebd126180464016419e3ed6a7cc79011db46da1f4b657a5a
Commit confirmed: provider=1 dataSet=2
[ OK ] node is installed
[ OK ] install Synapse consumer runtime
[INFO] Synapse runtime: pkg_pr_new:@filoz/synapse-sdk@1af645a395a883a2239e951493a49084011ad42b
[INFO] Creating random file (20971520 bytes)
[ OK ] random_file created with exact size 20971520 bytes
[INFO] Running the Synapse-driven system E2E against devnet
```

✅ test_multi_copy_upload - PASS (46s)

```
[ OK ] node is installed
[ OK ] npm is installed
[ OK ] clone filecoin-pin
[ OK ] checkout filecoin-pin 0933c5f3b585095878946ef2dabe261ffcf38670
[ OK ] pnpm install
[ OK ] pnpm build
[INFO] Creating random file (20971520 bytes)
[ OK ] random_file created with exact size 20971520 bytes
[INFO] Running filecoin-pin multi-copy upload script against devnet
[INFO] filecoin-pin add attempt 1 (default multi-copy)
[INFO] Verified retrieval URL 1: http://host.docker.internal:5711/ipfs/bafybeicscvnp3dhanfl3yrgdavs35em6i4ycrkon5gvoggfnn6gfqdfj4q
[INFO] Verified retrieval URL 2: http://host.docker.internal:5715/ipfs/bafybeicscvnp3dhanfl3yrgdavs35em6i4ycrkon5gvoggfnn6gfqdfj4q
```

✅ test_caching_subsystem - PASS (101s)

```
[ OK ] node is installed
[INFO] Run index: 1, seeds: small=43, large=86
[INFO] Scylla container: foc-20260901T0831_BoingPomp-scylla-1
[INFO] Initial row count = 0
[ OK ] install Synapse consumer runtime
[INFO] Synapse runtime: pkg_pr_new:@filoz/synapse-sdk@1af645a395a883a2239e951493a49084011ad42b
[INFO] Uploading 20MB piece (below 32MB threshold)
[INFO] === Synapse upload probe: 1 copy target ===
Account preparation: ready=true deposit=0 approval=false
Prepared payment state: funds=9892000000000000000 available=6139822203735595955 lockup=3752156954652121390
Uploading /tmp/synapse-cache-zmjpcoo_/small_20mb (20971520 bytes) with 1 copy target
Provider selected: 1 (0x446339aE7245e3cd1FeD701b685C196C69af695e)
Upload progress: 10485760/20971520
Upload progress: 20971520/20971520
Primary stored: provider=1 piece=bafkzcibfqcapabiuoe2wvpyktx3aunlchjyqizqov5lhagoi4ycwnq344ql6k4gctmwa
Commit submitted: provider=1 tx=0x636b49bce8ccc984af6702d4a99ac82706f504eca3ff4558d7cf7bac2017840e
Commit confirmed: provider=1 dataSet=5
Direct retrieval verified: provider=1 (20971520 bytes)
Payment state: funds=9856000000000000000 available=5519746731155854571 lockup=4336242153317663769 rate=5557763240830
On-chain data set verified: id=5 provider=1 piece=0 rail=9
Upload probe verified: bafkzcibfqcapabiuoe2wvpyktx3aunlchjyqizqov5lhagoi4ycwnq344ql6k4gctmwa
[ OK ] upload 20MB piece
[INFO] Waiting 10s for caching tasks
[INFO] row_count after 'upload 20MB piece' = 0
[ OK ] cache rows count should not increase
[INFO] Uploading 80MB piece (above 32MB threshold)
[INFO] === Synapse upload probe: 1 copy target ===
Account preparation: ready=true deposit=0 approval=false
Prepared payment state: funds=9856000000000000000 available=5519730057866132081 lockup=4336242153317663769
Uploading /tmp/synapse-cache-zmjpcoo_/large_80mb (83886080 bytes) with 1 copy target
Provider selected: 1 (0x446339aE7245e3cd1FeD701b685C196C69af695e)
Upload progress: 10485760/83886080
Upload progress: 20971520/83886080
Upload progress: 31457280/83886080
Upload progress: 41943040/83886080
Upload progress: 52428800/83886080
Upload progress: 62914560/83886080
Upload progress: 73400320/83886080
Upload progress: 83886080/83886080
Primary stored: provider=1 piece=bafkzcibfqcamafywumo5i24e5ryghcohzkeyuzp6hosbgkftd7inxohiveq2tm7dkima
Commit submitted: provider=1 tx=0x776cec3b45cf404b1c2fee43aef986b574e73b439e80899a38dcaf72c38d58d2
Commit confirmed: provider=1 dataSet=6
Direct retrieval verified: provider=1 (83886080 bytes)
Payment state: funds=9820000000000000000 available=4899464283212962947 lockup=4920494023628778499 rate=6948859709759
On-chain data set verified: id=6 provider=1 piece=0 rail=10
Upload probe verified: bafkzcibfqcamafywumo5i24e5ryghcohzkeyuzp6hosbgkftd7inxohiveq2tm7dkima
[ OK ] upload 80MB piece
[INFO] Waiting 10s for caching tasks
[INFO] row_count after 'upload 80MB piece' = 32
[ OK ] cache rows count should increase
```
[Action Run link](https://github.com/FilOzone/foc-devnet/actions/runs/33485248106)

Start with the linked workflow run and the failing test_synapse_e2e output, then inspect storage.ts:120 and system-e2e.ts:31 around the replication assertion. Trace the Invalid pull payer error and confirm the frontier scenario completes with both copies replicated and the E2E test passing.

Written by the indexing model from the issue text.