feature request: connect to inference engine through unix socket
Open
Nobody has claimed this yet.
autonomous: no
enhancement
priority: low
triage: needs-decision
- Dominant language
- Rust
- Stars
- 19.9k
- Forks
- 2.3k
- Avg merge
- 2d 7h
- Merged PRs (30d)
- 30
Description
Many of the prominent inference engines support serving on unix sockets.
These can be forwarded over network easily and can also be less hassle to keep secure than tcp.
It will be nice if jcode is able to connect to such unix sockets directly.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Search the jcode CLI for the inference-engine connection entry point and configuration parsing. Then identify the existing connection tests, add coverage for a Unix-socket endpoint, and verify that jcode can connect directly to it.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- rust
- Domain
- cli, networking
- Issue type
- Feature
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Quiet
- Clarity
- Mostly clear
- Newbie friendliness
- 55/100