antirez / antirez/ds4

Using TraceInversion datasets with DS4

Offen
#409 1 Kommentar 0 Reaktionen 0 zugewiesene Personen Auf GitHub ansehen
Vorherrschende Sprache
C
Sterne
22.3k
Forks
2.1k
Ø Merge
1 T. 3 Std.
Gemergte PRs (30 T.)
4

Beschreibung

Hi all,
I was exploring a bit the landscape since I am fascinated about this world.
I wanted to start with some hands on project and I have some hardware that I can make use of (Mac Studio M3 Ultra).

After the Fable 5 failure I started scanning the web for projects, alternatives, ways to have the best possible solution running on the hardware I have. Then I stumbled upon this TraceInversion idea, and there are data sets with roughly 5000 questions and answers also from the "in"-famous Fable.

Here is the tutorial by Nvidia.
https://docs.nvidia.com/nemo/automodel/nightly/guides/llm/dsv4-flash.html

Am I throwing money uselessly if I rent a B300 with sufficient storage and I use Opus 4.7 + Fable 5 questions and answers to add a q-lora layer on top?

I cannot understand why there are lots of projects doing this for Qwen but none for DeepSeek.

https://huggingface.co/datasets/Glint-Research/Fable-5-traces

Beitragsleitfaden

Beitragsleitfaden öffnen

Bewertung

Dieses Issue wurde noch nicht bewertet.

Neue Issues direkt in Ihr Postfach

Eine kurze Übersicht über anfängerfreundliche GitHub-Issues.