huggingface / huggingface/diffusers

Add Nvidia NitroGen to huggingface diffusers

Open
#13,086 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
34.5k
Forks
7.3k
Avg merge
3d 3h
Merged PRs (30d)
91

Description

**Feature request**
NVIDIA's NitroGen is a groundbreaking AI model designed to play hundreds of video games autonomously across various genres. This model, developed in collaboration with MineDojo, is trained on over 40,000 hours of publicly available gameplay videos, allowing it to perform across 1,000+ games without relying on proprietary tools or custom datasets.

**Motivation**
This model should be added to Hugging Face Transformers so that developers can use it through the HF interface and fine-tune it to play other games. Doing so will also help researchers build further on this work.

**Your contribution**
Sure, I’ll try to help with some modules, though I’m not entirely sure yet.

Contributor guide

Open the contributing guide

Research direction

The issue does not name any files, tests, or entry points. Start by comparing the repository's existing model integrations and the Hugging Face Transformers interface, then determine the required NitroGen components and scope. Done means NitroGen is available through the requested Hugging Face interface and can be fine-tuned for other games.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, pytorch
Domain
ai, machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.