Layr-Labs/d-inference

Private Inference Network on Idle Macs

Stars: 522
Forks: 113
Open beginner issues: 0
Indexed issues: 130
Avg merge: 17h 26m
Merged PRs (30d): 111

Dominant language: Go
License: No license data
Last GitHub push: Sep 16, 2026
Latest indexed: Sep 18, 2026
Contributing guide: Contributing guide
Code of conduct: No code of conduct
Beginner labels: No beginner labels indexed

Open All

130 open issues indexed

Provider trust_level=hardware set even when MDA→SE-key binding fails (43% of live providers) Open

Layr-Labs/d-inference#147 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 18, 2026
Public attestation feed omits SE-signed AttestationBlob — security state is coordinator-asserted Open

Layr-Labs/d-inference#148 · 0 comments · 1 reaction · 0 assignees · Indexed Sep 18, 2026
No public coordinator attestation endpoint; substrate claim conflicts across project docs Open

Layr-Labs/d-inference#149 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 18, 2026
Client-side verifiers are incomplete: web verifier stops at 'genuine Apple device'; Python SDK referenced in docs is absent Open

Layr-Labs/d-inference#151 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 18, 2026
Docs disagree about who sees plaintext + coordinator substrate ambiguity Open

Layr-Labs/d-inference#152 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 18, 2026
Auto top-up: automatically replenish balance when funds are low Open

enhancement

Layr-Labs/d-inference#231 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 18, 2026
[bug] mlx-community/gemma-4-26b-a4b-it-8bit chat_template is not portable to swift-jinja Open

bug

Layr-Labs/d-inference#242 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 18, 2026
[bug] MLX error: Failed to load the default metallib (language version 4.0) on M1 Pro + macOS Sequoia 15.7.7 Open

bug

Layr-Labs/d-inference#243 · 1 comment · 3 reactions · 0 assignees · Indexed Sep 18, 2026
darkbloom doctor: actively guide un-enrolled/un-attested providers to MDM enrollment Open

Layr-Labs/d-inference#254 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 18, 2026
[bug] No longer able to use symlink for model directory Open

bug

Layr-Labs/d-inference#260 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 18, 2026
Provider connects but receives 0 inference requests; coordinator shows no live provider record Open

bug

Layr-Labs/d-inference#264 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 18, 2026
KV cache: global (cross-model) SSD disk budget — needed before high-churn multi-model fleets Open

area:provider enhancement

Layr-Labs/d-inference#266 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 18, 2026
KV cache: allow long shared-prefix reuse past the sliding window (lift the conservative checkpoint-boundary cap) Open

enhancement

Layr-Labs/d-inference#267 · 7 comments · 0 reactions · 0 assignees · Indexed Sep 18, 2026
Empirical agent trajectory analysis: optimize AGENTS.md by studying what agents actually read Open

Layr-Labs/d-inference#276 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 18, 2026
APNs code-identity (v0.6.0): close the remaining attestation gaps — bind a fresh MDA per connection and enforce the SEP-signed SIP/Secure-Boot OIDs Open

Layr-Labs/d-inference#302 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 18, 2026
MDA gate: Apple-root the device serial to the connection's SE key (self-asserted-serial residual from #302) Open

Layr-Labs/d-inference#328 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 18, 2026
OOM-H2: provider can OOM the coordinator (TEE) via unbounded non-streaming chunk accumulation Open

area:coordinator bug security

Layr-Labs/d-inference#337 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 18, 2026
Load-test findings: requests shed at per-account admission guards before routing while fleet sits idle (+ KV/size-aware routing gaps) Open

Layr-Labs/d-inference#342 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 18, 2026
Align per-turn image upload budget with the provider WebSocket frame cap Open

area:console-ui area:coordinator bug

Layr-Labs/d-inference#343 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 18, 2026
Provider MLX continuous-batching crash: [concatenate] shape mismatch merging concurrent requests (Qwen3.5 hybrid model) Open

bug

Layr-Labs/d-inference#344 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 18, 2026
Reputation persistence not concurrency-safe under multiple writers (PR #345 follow-up) Open

Layr-Labs/d-inference#348 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 18, 2026
[bug] 100% CPU usage without serving requests Open

bug

Layr-Labs/d-inference#365 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 18, 2026
Stabilize WebSocket connections and handling Open

Layr-Labs/d-inference#400 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 18, 2026
Provider dashboard numbers overlap into an unreadable mess Open

Layr-Labs/d-inference#424 · 1 comment · 2 reactions · 0 assignees · Indexed Sep 18, 2026
[feature] add support for running in a VM Open

enhancement

Layr-Labs/d-inference#426 · 1 comment · 1 reaction · 0 assignees · Indexed Sep 18, 2026
Self-route: "My Machine" (prefer) blocks zero/low-balance users with 402 before dispatching to their own node Open

bug

Layr-Labs/d-inference#464 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 18, 2026
[feature] Open

enhancement

Layr-Labs/d-inference#478 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 18, 2026
Bug Report: SCEP Enrollment Fails — Server Returns HTTP 500 Open

bug

Layr-Labs/d-inference#490 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 18, 2026
Crypto (USDC) payouts ONLY for countries Stripe can't serve — non-US persons only, W-8BEN + OFAC compliance scoped first Open

area:console-ui area:coordinator enhancement

Layr-Labs/d-inference#500 · 3 comments · 2 reactions · 0 assignees · Indexed Sep 18, 2026
Earn page "Notify me when smaller models launch" has no server-side registration — can't actually notify anyone Open

Layr-Labs/d-inference#503 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 18, 2026
E2E flake on master: provider WebSocket disconnect under concurrent load → all requests 502 Open

Layr-Labs/d-inference#513 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 18, 2026
[Bug] Stripe onboarding fails: "Your platform needs approval for accounts to have requested the transfers capability without the card_payments capability" Open

bug

Layr-Labs/d-inference#521 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 18, 2026
[feature] Documentation MCP Open

enhancement

Layr-Labs/d-inference#545 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 18, 2026
[v0.7.10][provider-swift] Provider reaches 205.9 GiB Metal footprint on 256 GB M3 Ultra and triggers system-wide Jetsam Open

Layr-Labs/d-inference#550 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 18, 2026
[v0.7.10][fan helper] M4 Max becomes permanently unsupported after implausible GPU reading and failed Auto restore Open

Layr-Labs/d-inference#551 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 18, 2026
Fix production Cloud Build trigger provenance wiring Open

Layr-Labs/d-inference#554 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 18, 2026
Reasoning models never accept reasoning:off — thinking cannot be disabled (gpt-oss-20b, qwen3.6-35b) Open

Layr-Labs/d-inference#639 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 18, 2026
[bug] Provider hard-untrusted on Reduced Security Macs — SecureBootLevel=medium fails the posture check with no surfaced reason Open

Layr-Labs/d-inference#667 · 12 comments · 0 reactions · 0 assignees · Indexed Sep 18, 2026
[bug] Installer doesn't add CLI to PATH + daemon loops silently on coordinator rejection (no error logged) Open

bug

Layr-Labs/d-inference#668 · 2 comments · 2 reactions · 0 assignees · Indexed Sep 18, 2026
[bug] Every model download fails to decode the manifest: coordinator emits fractional-second timestamps, client uses .iso8601 which rejects them (0.8.10) Open

bug

Layr-Labs/d-inference#673 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 18, 2026
[bug] Three different answers to "how much memory can this box use", two for "how much does this model need" (0.8.10) Open

bug

Layr-Labs/d-inference#675 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 18, 2026
feat(provider ops): uncapped earnings history + per-provider/model $ breakdown for multi-host operators Open

Layr-Labs/d-inference#679 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 18, 2026
Provider CLI should drain active requests before stop or restart Open

Layr-Labs/d-inference#685 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 18, 2026
New hardware-attested provider gets 0 requests for 3+ hours while warm at full priority; established peer keeps 100% of traffic even when thermally degraded Open

Layr-Labs/d-inference#688 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 18, 2026
Provider hangs on any Mac with a display: HardwareDetector/attestation pipe-buffer deadlock Open

Layr-Labs/d-inference#689 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 18, 2026
"This Mac is already managed by another MDM ... macOS allows only one MDM enrollment per device." Open

enhancement

Layr-Labs/d-inference#691 · 0 comments · 2 reactions · 0 assignees · Indexed Sep 18, 2026
[bug] SE-challenge sweep leaves responsive providers unroutable until manual reconnect — challenge loop never re-admits the session (0.8.10, ~40 min zero routing) Open

Layr-Labs/d-inference#692 · 26 comments · 0 reactions · 0 assignees · Indexed Sep 18, 2026
v0.8.10 installer fails on macOS 15.7.4 (M4): "safe R1 was not latched as requested" even with the #663 seed environment Open

Layr-Labs/d-inference#693 · 8 comments · 1 reaction · 0 assignees · Indexed Sep 18, 2026
[bug] MDM SecurityInfo acknowledged with HTTP 200 but coordinator remains mdm=pending Open

bug

Layr-Labs/d-inference#694 · 6 comments · 2 reactions · 0 assignees · Indexed Sep 18, 2026
Provider payouts: North Macedonia (MK) missing from Stripe Connect onboarding country list Open

Layr-Labs/d-inference#695 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 18, 2026

A short digest of beginner-friendly GitHub issues.