Could not write temp file and throw Invalid argument during BIG table sort
- Lingua principale
- C++
- Stelle
- 127
- Fork
- 80
- Merge medio
- 13h 49m
- PR unite (30g)
- 48
Descrizione
As you can see below, i have a table with 56 million rows, and attemping to perform sorting to "hierarchy_path" column will cause it to fail with invalid argument. i observed 400 + tmp files are being created on and off during the execution and after 5 minutes it goes off with error, i consider it crashed or at least not completing the SQL to create the table.
duckdb "/db/com.db"
v1.2.1 8e52ec4395
Enter ".help" for usage hints.
D select count(*) from asset_tree;
┌─────────────────┐
│ count_star() │
│ int64 │
├─────────────────┤
│ 56452767 │
│ (56.45 million) │
└─────────────────┘
D
duckdb "/db/com.db"
v1.2.1 8e52ec4395
Enter ".help" for usage hints.
D create table eric as
select * from asset_tree order by hierarchy_path;
49% ▕█████████████████████████████▍ ▏ IO Error:
Could not write file "/db/com.db.tmp/duckdb_temp_block-4611686018427598582.block": Invalid argument
D .quit
Guida per i contributori
Nessuna guida per i contributori indicizzata per questo repository
Direzione di ricerca
Start by reproducing the DuckDB CLI command against a comparable 56-million-row asset_tree table, sorting by hierarchy_path and observing the temporary files under /db/com.db.tmp. Done means the CREATE TABLE sort completes without the Invalid argument error or reports a confirmed platform or filesystem limitation.
Scritto dal modello di indicizzazione a partire dal testo della issue.
Valutazione
- Stack tecnologico
- java, sql
- Ambito
- databases
- Tipo di issue
- Bug
- Difficoltà
- 4/5
- Tempo stimato
- 3-5 giorni
- Stato di attività
- Ferma
- Chiarezza
- Abbastanza chiara
- Idoneità per principianti
- 35/100