acmpesuecc / acmpesuecc/ConCore
Migrate from Gemini to Gemma 3 (4B Parameters)
- Lingua principale
- Python
- Stelle
- 0
- Fork
- 11
- Metriche di merge delle PR
- Nessuna PR unita negli ultimi 30g
Descrizione
# Bounty Points: 25
## PR Instructions
Commits should be pushed to the **'local-model'** branch only. 📥
---
## **Status: Local LLM Integration Complete** 🚀
### **Summary of Change: Integrating Existing Solution to Main Codebase**
The architectural shift to support local inference via **Gemma 3 (4B parameters)** has been successfully implemented and tested in a separate branch/environment. This pull request integrates the completed solution into the main codebase.
This migration replaces the external **Gemini API** dependency, providing significant benefits:
* **Privacy:** Data processing is now **privacy-first** (data stays on the local machine).
* **Cost & Latency:** **Zero ongoing API cost** and significantly **lower latency** with full **offline capability**.
* **Autonomy:** Freedom from external API rate limits and dependencies.
The core backend flow remains unchanged; only the LLM interface layer has been modified to support a seamless switch between backends.
---
Guida per i contributori
Apri la guida per i contributori
Valutazione
Questa issue non è ancora stata valutata.