ProjectTech4DevAI / ProjectTech4DevAI/kaapi-backend

Assessment Pipeline: Add audio/video support

Open
#1,184 0 comments 0 reactions 1 assignee View on GitHub

@vprashrex is already working on this.

Since Sep 4, 2026.

Dominant language
Python
Stars
18
Forks
10
Avg merge
2d 20h
Merged PRs (30d)
14

Description

Is your feature request related to a problem?
The AI Assessments pipeline currently lacks support for audio and video modalities. This limits the assessment's effectiveness and prevents a comprehensive analysis of inputs.

Describe the solution you'd like

  • Extend multimodal support to include audio/video in AI Assessments.
  • Experiment with Gemini for video handling and explore methods with OpenAI/Anthropic.
  • Sample an audio/video dataset from partners, run the pipeline, conduct human evaluations, and iterate.
  • Support a language mix of ~50–60% English, ~10–15% Tamil, and a strong presence of South Indian languages like Telugu.
Original issue

Context

Extend multimodal support to include audio/video in AI Assessments.

Investigation

  • Video: Gemini does appear to support video directly. Experiments to be done to figure out reasonable way of handling video in Open AI / Anthropic (sampling frames + full audio transcript ?)

Approach / acceptance criteria

  • Sample audio/video dataset from partners, run pipeline, run human evals, iterate. Building the tech is easy; evaluation is the bottleneck.
  • Language mix to support: ~50–60%+ English, Tamil ~10–15%, strong South Indian language presence, Telugu

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.