0xnyn / 0xnyn/tinylm

Support function calling

Aperta
#6 1 commento 0 reazioni 0 assegnatari Vedi su GitHub
enhancement
Lingua principale
TypeScript
Stelle
59
Fork
9
Metriche di merge delle PR
Nessuna PR unita negli ultimi 30g

Descrizione

Hey there! First off, amazing initiative - this is going to add so much value for people wanting to use local and client-side LLMs. There's a similar project called [webllm](https://webllm.mlc.ai/docs/) that offers an openai-style approach to client-side LLMs, but it falls short on function calling capabilities.
I think it would be awesome if you could add function calling support to this module, at least for models that already support it (like `phi-4-mini`). Totally understand this isn't an easy task though (it is not :) ), so no pressure - feel free to close this issue if it's not something you want to tackle right now.

Keep up the great work! 👍

Guida per i contributori

Nessuna guida per i contributori indicizzata per questo repository

Direzione di ricerca

The issue mentions adding function calling support for models like phi-4-mini, referencing the webllm project. Start by examining the existing OpenAI-compliant API structure in the codebase, then look at how other libraries implement function calling. Check the model loading and inference logic to see where function definitions and calls could be integrated. Determine what 'done' looks like by verifying that a model can accept function definitions and return appropriate calls in its responses.

Scritto dal modello di indicizzazione a partire dal testo della issue.

Valutazione

Stack tecnologico
javascript, typescript
Ambito
ai, backend-api-design
Tipo di issue
Funzionalità
Difficoltà
4/5
Tempo stimato
Più di una settimana
Stato di attività
Ferma
Chiarezza
Abbastanza chiara
Idoneità per principianti
35/100

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.