dotnet / dotnet/extensions

[AI] Add Support for New Modalities / Content Types

Open
#6,637 0 comments 1 reaction 0 assignees View on GitHub
area-ai
Dominant language
C#
Stars
3.2k
Forks
894
Avg merge
1d 12h
Merged PRs (30d)
23

Description

Overall, we need to:

- Get familiar with existing SDK APIs for new modalities and content types
- Determine if there's enough coverage across providers to start to generalize
- Consider using Deep Research to conduct this exercise itself
- Implement new content type abstractions, or prove existing abstractions suffice
- End-to-end scenario validation
- End-to-end scenarios for bouncing between modalities
- End-to-end scenarios around document/content creation, product support, etc.

## Backlog

- [ ] Text to Video
- [ ] Image to Video
- [ ] Video to Video
- [ ] Image to Text

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.