NVIDIA-NeMo / NVIDIA-NeMo/DataDesigner
Support more types of Model Providers like VertexAI and Bedrock
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 2.2k
- Forks
- 211
- Avg merge
- 2d 6h
- Merged PRs (30d)
- 40
Description
Is your feature request related to a problem? Please describe.
Data Designer currently supports models provided with an OAI or Azure OAI compliant endpoint only.
Describe the solution you'd like
Data Designer should have better support for different types of endpoints, like VertexAI or Bedrock endpoints which do not follow the OAI spec.
Describe alternatives you've considered
For e.g. when using Gemini models on Vertex AI, you could use the OAI compliant endpoint, but if I have an VertexAI API key that has generous rate limits, I can't use that with the OAI compliant endpoint.
Additional context
Data Designer should have native support for the following provider types: Vertex AI, Bedrock, SageMaker, Databricks, DataRobot, and Groq.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
No files or tests are named in the issue. Start by locating the existing OAI and Azure OAI provider integration and its extension points, then define the work needed for Vertex AI, Bedrock, SageMaker, Databricks, DataRobot, and Groq; done means the listed providers have native endpoint support.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- aws, google-cloud, python
- Domain
- ai, cloud
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100