InternLM / InternLM/JanusCoder

Release JanusCoder models and JanusCode-800K dataset on Hugging Face

オープン
#4 コメント 0 件 リアクション 2 件 担当者 0 名 GitHub で見る
主要言語
Jupyter Notebook
スター
80
フォーク
8
PR マージ指標
30日以内にマージされた PR はありません

説明

Hi @InternLM 🤗

Niels here from the open-source team at Hugging Face. I discovered your work on Arxiv and your paper page: https://huggingface.co/papers/2510.23538.

I saw the exciting announcement in your README regarding the future release of the full JanusCoder checkpoints and the JanusCode-800K dataset, once internal company policy requirements are met. It's fantastic that you are planning to open-source these valuable artifacts!

When you are ready to release them, we'd be thrilled to help you host both the JanusCoder models and the JanusCode-800K dataset on the Hugging Face Hub (https://huggingface.co/models and https://huggingface.co/datasets). Hosting on the Hub would greatly improve their discoverability and visibility within the AI community. We can add relevant tags to the model and dataset cards to make them easily searchable and link them directly to your paper page.

## Uploading models

See here for a guide: https://huggingface.co/docs/hub/models-uploading.

In this case, we could leverage the [PyTorchModelHubMixin](https://huggingface.co/docs/huggingface_hub/package_reference/mixins#huggingface_hub.PyTorchModelHubMixin) class which adds `from_pretrained` and `push_to_hub` to any custom `nn.Module`. Alternatively, one can leverages the [hf_hub_download](https://huggingface.co/docs/huggingface_hub/en/guides/download#download-a-single-file) one-liner to download a checkpoint from the hub.

We encourage researchers to push each model checkpoint to a separate model repository, so that things like download stats also work. We can then also link the checkpoints to the paper page.

## Uploading dataset

Would be awesome to make the JanusCode-800K dataset available on 🤗 , so that people can do:

```python
from datasets import load_dataset

dataset = load_dataset("your-hf-org-or-username/your-dataset")
```
See here for a guide: https://huggingface.co/docs/datasets/loading.

Besides that, there's the [dataset viewer](https://huggingface.co/docs/hub/en/datasets-viewer) which allows people to quickly explore the first few rows of the data in the browser.

Let me know if you're interested/need any help regarding this once your artifacts are fully released!

Cheers,

Niels
ML Engineer @ HF 🤗

コントリビューションガイド

このリポジトリのコントリビューションガイドは索引されていません

調査の方向性

Start by reviewing the README announcement and the linked Hugging Face model-uploading and dataset-loading guides. The issue does not name an implementation entry point or release schedule; it is done only when the JanusCoder checkpoints and JanusCode-800K dataset are publicly available on the Hub, subject to the stated policy requirements.

索引モデルが issue の本文から書いたものです。

評価

技術スタック
huggingface
領域
machine-learning
issue の種類
機能追加
難易度
5/5
見積もり時間
1週間以上
活発さ
停滞
明瞭さ
説明が足りない
初心者へのやさしさ
20/100

新しい issue をメールで受け取る

初心者向けの GitHub issue を短くまとめたダイジェスト。