OpenBMB / OpenBMB/MiniCPM-V

[Question] Does the Android deployment support audio understanding (audio + text prompt)?

Open
#1,090 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
26.4k
Forks
2.1k
Avg merge
14h 39m
Merged PRs (30d)
3

Description

I'm trying to deploy MiniCPM-o on the Android platform. I would like to know whether MiniCPM-o on Android supports audio understanding, specifically:

Input: audio file (e.g., WAV/MP3) + natural language prompt
Output: textual understanding of the audio content (e.g., "What is the sound in this recording?")

I've deployed MiniCPM-o with llama.cpp by Android NDK and adb tool (direct building with Termux failed), checked the llama-minicpmv-cli help menu and found no --audio or similar parameter for audio input.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with the llama-minicpmv-cli help output and the Android NDK/adb deployment described in the issue. Check the repository's MiniCPM-o and llama.cpp integration entry points for documented audio-input support; done means establishing whether audio plus a text prompt is supported on Android or identifying the missing scope.

Written by the indexing model from the issue text.

Assessment

Tech stack
android, cpp
Domain
audio-video-rtc, machine-learning, mobile-dev
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.