NVIDIA-NeMo / NVIDIA-NeMo/Curator

NeMo Skills requests

Open
#1,636 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

community-request
Dominant language
Python
Stars
1.8k
Forks
328
Avg merge
4d 5h
Merged PRs (30d)
30

Description

Thanks! Can we make a wrapper script that will make it simpler to use and support all the logic without users manually switching between code_execution / different number of gpus, etc. Or instead of a separate script, maybe an option to start_server --launch_chat_interface that when specified will add an extra command that starts the chat interface script? That way we don't need to have a separate docker and can reuse our existing functionality to launch containers. And if anyone wants to run inside existing docker, it will still work as long as cluster config is not specified. Plus this way we can specify all parameters in one place and not need to duplicate them in start_server and chat interface (e.g. to enable code execution).

Another thing I would add is an option to use predefined models, so people can just say --model=Nvidia/OpenMath-Nemotron-X and then we will fill in the correct config / template inside the gradio demo, so that it doesn't need to be specified. This will also make it simpler to avoid errors by specifying incorrect config (e.g. our kaggle model uses different config than non-kaggle ones for tir). Finally, the gradio should ideally support a switch between code execution and non-code execution with a button, not an argument as some of the models can be used in both modes (and we can disable it for the kaggle model, if we can recognize that it's used)

Originally posted by @Kipok in https://github.com/NVIDIA-NeMo/Skills/pull/464#pullrequestreview-2837737225

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

No files or tests are named. Start by locating the start_server entry point and the Gradio demo, then trace how container, model, and code-execution parameters are currently supplied. Done means a unified launch path, predefined model handling, and an in-interface code-execution switch without duplicated configuration.

Written by the indexing model from the issue text.

Assessment

Tech stack
docker, python
Domain
cli, devops, tooling
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.