antirez / antirez/ds4

Using TraceInversion datasets with DS4

Abierto
#409 1 comentario 0 reacciones 0 asignados Ver en GitHub
Lenguaje dominante
C
Estrellas
22.3k
Forks
2.1k
Merge medio
1 d 3 h
PR fusionados (30 d)
4

Descripción

Hi all,
I was exploring a bit the landscape since I am fascinated about this world.
I wanted to start with some hands on project and I have some hardware that I can make use of (Mac Studio M3 Ultra).

After the Fable 5 failure I started scanning the web for projects, alternatives, ways to have the best possible solution running on the hardware I have. Then I stumbled upon this TraceInversion idea, and there are data sets with roughly 5000 questions and answers also from the "in"-famous Fable.

Here is the tutorial by Nvidia.
https://docs.nvidia.com/nemo/automodel/nightly/guides/llm/dsv4-flash.html

Am I throwing money uselessly if I rent a B300 with sufficient storage and I use Opus 4.7 + Fable 5 questions and answers to add a q-lora layer on top?

I cannot understand why there are lots of projects doing this for Qwen but none for DeepSeek.

https://huggingface.co/datasets/Glint-Research/Fable-5-traces

Guía de contribución

Abrir la guía de contribución

Evaluación

Este issue todavía no se ha evaluado.

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.