ProjectTech4DevAI / ProjectTech4DevAI/kaapi-backend
Assessment Pipeline: Add audio/video support
Abierto
@vprashrex ya está trabajando en esto.
Desde el 4/9/2026.
- Lenguaje dominante
- Python
- Estrellas
- 18
- Forks
- 10
- Merge medio
- 2 d 20 h
- PR fusionados (30 d)
- 14
Descripción
Is your feature request related to a problem?
The AI Assessments pipeline currently lacks support for audio and video modalities. This limits the assessment's effectiveness and prevents a comprehensive analysis of inputs.
Describe the solution you'd like
- Extend multimodal support to include audio/video in AI Assessments.
- Experiment with Gemini for video handling and explore methods with OpenAI/Anthropic.
- Sample an audio/video dataset from partners, run the pipeline, conduct human evaluations, and iterate.
- Support a language mix of ~50–60% English, ~10–15% Tamil, and a strong presence of South Indian languages like Telugu.
Original issue
Context
Extend multimodal support to include audio/video in AI Assessments.
Investigation
- Video: Gemini does appear to support video directly. Experiments to be done to figure out reasonable way of handling video in Open AI / Anthropic (sampling frames + full audio transcript ?)
Approach / acceptance criteria
- Sample audio/video dataset from partners, run pipeline, run human evals, iterate. Building the tech is easy; evaluation is the bottleneck.
- Language mix to support: ~50–60%+ English, Tamil ~10–15%, strong South Indian language presence, Telugu
Guía de contribución
Primeros pasos
- Lee el issue completo y luego la guía de contribución del proyecto.
- Comenta en el issue que vas a ocuparte — evita que dos personas hagan lo mismo.
- Haz un fork del repositorio y trabaja en una rama.
- Abre un pull request que haga referencia al número del issue.
Evaluación
Este issue todavía no se ha evaluado.