intel / intel/AI-Playground

Add a dedicated Audio/Voice/Music generation tab / Maybe Ace-step for the music

Open
#494 1 comment 0 reactions 0 assignees View on GitHub
enhancement stale
Dominant language
TypeScript
Stars
979
Forks
132
Avg merge
9h 23m
Merged PRs (30d)
8

Description

Is your feature request related to a problem? Please describe.
No, the application is already amazing for Text and Vision, especially with the latest Battlemage architecture and the Arc B580. However, to make AI Playground a truly comprehensive, all-in-one local AI hub, the audio ecosystem is currently the missing link. Users still have to rely on complex, third-party Python environments or generic WebUIs to handle audio tasks.

Describe the solution you'd like
I would love to see a dedicated "Audio" or "Voice & Music" tab integrated natively into AI Playground, utilizing OpenVINO to leverage the XMX engines of Intel Arc GPUs.

Ideally, this section would be split into three sub-features:

Voice Cloning & TTS (Text-to-Speech): Integration of a lightweight, high-quality model like XTTS v2 or Bark, allowing users to drop a short 10-second audio sample to clone a voice and generate speech locally.

Music Generation: Integration of Meta's MusicGen (AudioCraft) or similar models to generate tracks and loops locally from text prompts.

Audio Transcription: Integration of Whisper (or Whisper.cpp optimized for Intel) to quickly transcribe local audio/video files into text.

Describe alternatives you've considered
Currently, we have to manually set up complex local tools (like ComfyUI with audio nodes, or standalone Gradio interfaces running on PyTorch XPU). Having this integrated directly into the clean, accessible UI of AI Playground would provide a flawless user experience.

Additional context
With 12GB of VRAM on cards like the Arc B580, running these audio and music models completely locally is fully viable and would show off the true multi-modal capabilities of Intel's Battlemage generation.

"Edit : maybe you can use ace-step for the ( generate music ), ace-step is suno alternative but locally and it work with all vram"

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.