OpenBMB / OpenBMB/MiniCPM-V

[Deployment Guide] Deploy MiniCPM-o 4.5 on Offline H100 + Mobile Access — Full WSL2 Workflow (PR #1076)

Open
#1,077 1 comment 1 reaction 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
26.4k
Forks
2.1k
Avg merge
14h 39m
Merged PRs (30d)
3

Description

Hi everyone,

I noticed several issues in this repo asking about deploying MiniCPM-o 4.5 in offline/enterprise environments, or accessing it from mobile devices. I've put together a complete solution and submitted it as PR #1076. Sharing it here in case it helps anyone.


🎯 What's covered
  • Full offline deployment: Build Docker images on Windows + WSL2, transfer everything to an air-gapped H100 server via SCP — no public internet required on the server side
  • Docker Compose + fallback docker run: Works even if Compose is unavailable
  • PC browser access: SSH port forwarding to http://127.0.0.1:3000 / https://127.0.0.1:3443
  • Mobile full-duplex video call: Self-signed SSL + laptop-as-relay setup so your phone can access the service over LAN with camera/mic permissions
  • iOS Safari: Step-by-step certificate trust instructions
  • PowerShell helper functions: One-liners for managing dynamic SSH ports, opening/closing tunnels, and printing the mobile access URL automatically
  • Audio & storage optimization: PCM_16 codec refactor + buffer/I/O improvements for smoother, lower-latency voice calls
  • Security sanitized: All scripts and configs use generic placeholders — safe to use directly

📖 Bilingual documentation

Both English and Chinese guides are included (DEPLOY_WSL2_TO_H100_EN.md / DEPLOY_WSL2_TO_H100_ZH.md), with environment setup, troubleshooting FAQ, and quick command references.


🔗 Links

Feel free to comment on the PR or open a discussion here if you run into issues. Happy to help!

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Review PR #1076 alongside DEPLOY_WSL2_TO_H100_EN.md and DEPLOY_WSL2_TO_H100_ZH.md, which the issue identifies as the deployment guides. Check the offline WSL2-to-H100 workflow, Docker Compose and docker run instructions, mobile access steps, and troubleshooting content; done means the PR's documented workflow is complete and usable without exposing project-specific secrets.

Written by the indexing model from the issue text.

Assessment

Tech stack
docker, docker-compose, powershell
Domain
devops, documentation, infrastructure
Issue type
Documentation
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.