ml-inory / ml-inory/SPADE

feat[1]: Project scaffolding, LLM-TTS backbone, and synthetic codec data

Open
#1 2 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
0
Forks
0
PR merge metrics
No merged PRs in 30d

Description

Goal

Iteration 1 of the SPADE implementation: set up the Python package skeleton and build the foundation the pruning/distillation stages depend on — a minimal GPT-style LLM-TTS backbone and the data layer (text tokenizer + synthetic speech-codec benchmark that is decodable back to text so WER is meaningful).

Acceptance

  • pyproject.toml, .gitignore, and spade/ package skeleton exist with minimal dependencies (torch, numpy, pyyaml, tqdm)
  • spade/models/llm_tts.py provides a configurable autoregressive LLM-TTS backbone (causal attention, residual blocks, LM heads) returning logits + per-block hidden states + attention maps
  • spade/data/ provides a character-level text tokenizer and a synthetic speech-codec dataset: text -> deterministic code-token sequences, decodable back to text
  • Model forward/generation and data pipeline have passing pytest unit tests

Notes

Iteration 1 for: SPADE - Structured Pruning and Adaptive Distillation for Efficient LLM-TTS (arXiv:2509.20802)

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with the acceptance checklist, then review pyproject.toml and the proposed spade/ package layout. Read the LLM-TTS requirements in spade/models/llm_tts.py and the tokenizer and synthetic dataset requirements under spade/data/. Done means the configurable model and decodable data pipeline exist, with passing pytest coverage for forward/generation and data behavior.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.