cloudflare / cloudflare/workers-sdk

🐛 BUG: Cannot create a string longer than 0x1fffffe8 characters

Open
#3,278 3 comments 1 reaction 0 assignees View on GitHub
package:wrangler product:d1
Dominant language
TypeScript
Stars
4.5k
Forks
1.5k
Avg merge
3d 8h
Merged PRs (30d)
187

Description

### Which Cloudflare product(s) does this pertain to?

D1

### What version of `Wrangler` are you using?

3.0.0

### What operating system are you using?

Ubuntu

### Describe the Bug

Create a big sqlite database (>2GB), follow this guide https://developers.cloudflare.com/d1/learning/importing-data/#converting-sqlite-database-files
```
✘ [ERROR] Could not read file: db.sql

Cannot create a string longer than 0x1fffffe8 characters

If you think this is a bug, please open an issue at:
https://github.com/cloudflare/workers-sdk/issues/new/choose

```
Probably have to stream/chunk big DBs?

Contributor guide

Open the contributing guide

Research direction

Start with Wrangler's D1 import flow described in the linked SQLite conversion guide and reproduce the failure using a database larger than 2GB. Trace where db.sql is read, then verify that large imports no longer hit the string-length error and that the documented import flow completes successfully.

Written by the indexing model from the issue text.

Assessment

Tech stack
sqlite, typescript
Domain
cli, cloud, databases
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.