lance-format / lance-format/lance
CreateTable on fuse filesystem will throw Error (os error 95)
Open
Nobody has claimed this yet.
enhancement
- Dominant language
- Rust
- Stars
- 7.1k
- Forks
- 852
- Avg merge
- 3d 18h
- Merged PRs (30d)
- 272
Description
code
import lancedb
db = lancedb.connect("/path/to/fuse/mounted/dir")
tb1 = db.create_table("table1", data=xx, mode="overwrite")
error:
RuntimeError: lance error: LanceError(IO): Generic LocalFileSystem error: Unable to rename file: Operation not supported (os error 95), /root/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/lance-table-0.32.0/src/io/commit.rs:1043:50
seems table commit will rename tmp file from other device to fuse mounted dir, when rust rename a file cross devices will cause this os error 95 error
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with the table commit path in lance-table/src/io/commit.rs, especially the rename reported near line 1043, and reproduce the Python lancedb example against a FUSE-mounted directory. Check how temporary files are committed across filesystems; done means CreateTable succeeds there without the os error 95, with relevant tests added or updated if an existing test location is found.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python, rust
- Domain
- backend, databases
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100