microsoft / microsoft/BitNet

Debian package with systemd socket activation (bitnet-server)

Open
#557 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
C++
Stars
40.3k
Forks
3.7k
PR merge metrics
No merged PRs in 30d

Description

Built a Debian package that runs BitNet b1.58 2B4T as a systemd service on Ubuntu 24.04.

What it does:

  • sudo apt install bitnet-server from PPA
  • OpenAI-compatible API on localhost:11435
  • Socket activation: 112KB idle, starts on first request
  • Auto-downloads model from HuggingFace
  • Sandboxed (unprivileged user, systemd protections)

PPA: ppa:satyajeet1827/bitnet-server
Source: https://github.com/123Satyajeet123/bitnet-server

Sharing in case it's useful for the community or worth linking from the README. Happy to answer questions about the packaging approach.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Review the repository README, the linked bitnet-server source, and the PPA packaging approach. Done means determining whether the Debian package and systemd socket-activation setup should be linked or documented for BitNet users.

Written by the indexing model from the issue text.

Assessment

Tech stack
debian, huggingface, ubuntu
Domain
devops, documentation, release
Issue type
Documentation
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.