google-deepmind / google-deepmind/gemma

[Demo] Gemma Fine Tune UI. Introducing Gemma Studio: End-to-End Fine-Tuning Platform.

Open
#267 4 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
5.7k
Forks
1k
Avg merge
10h 33m
Merged PRs (30d)
2

Description

# Hello Gemma team and community members,

---

I'm excited to share my latest project, **Gemma Studio**, a web-based application designed to streamline dataset management, model fine-tuning, and deployment workflows. Built with modern technologies like React, TypeScript, and FastAPI, this project demonstrates the potential of Gemma models in simplifying machine learning workflows.

---

## Overview

Gemma Studio is a web application that allows users to:
- Fine-tune Gemma models on their own datasets
- Configure training parameters
- Monitor training progress
- Export fine-tuned models

It also integrates optional cloud-based features like Google Cloud Storage and Vertex AI for scalable training and deployment.

This project showcases Gemma's capabilities in:
- Dataset preprocessing
- Hyperparameter configuration
- Real-time training visualization

Making it an ideal tool for researchers, engineers, and students.

---

## Key Features

- **Dataset Uploading**: Support for various formats (CSV, JSONL, text files) with validation, preprocessing, and optional data augmentation.
- **Hyperparameter Configuration**: Easily adjust key parameters like learning rate, batch size, and epochs with sensible defaults and tooltips.
- **Training Progress Visualization**: Real-time metrics such as loss curves, accuracy, and F1-score, along with examples of generated text.
- **Model Download/Export**: Export fine-tuned models in formats like TensorFlow SavedModel, PyTorch, or GGUF.
- **Cloud Integration**: Optional integration with Google Cloud Storage and Vertex AI for scalable training and data storage.
- **Documentation**: Clear step-by-step instructions for installation, usage, and deployment.

---

## How to Use

1. **Upload a Dataset**: Use the dataset upload interface to upload and preprocess your data.
2. **Configure Training Parameters**: Adjust hyperparameters like learning rate, batch size, and epochs.
3. **Start Training**: Monitor real-time training progress with visualizations of metrics like loss and accuracy.
4. **Export the Model**: Download the fine-tuned model in your preferred format for local or cloud-based inference.
5. **Optional Cloud Integration**: Use Google Cloud Storage for dataset management and Vertex AI for scalable training.

---

## Technical Innovations

- **Real-Time Training Visualization**: Displays real-time metrics like loss curves and accuracy, helping users monitor training progress effectively.
- **Cloud Integration**: Seamless integration with Google Cloud Storage and Vertex AI for scalable training and deployment.
- **Modular Architecture**: The project is split into modular components for frontend (React) and backend (FastAPI), making it easy to extend and maintain.
- **Customizable Hyperparameters**: Provides an intuitive interface for configuring training parameters with tooltips and sensible defaults.

---

## Links

- **GitHub Repository**: [Gemma Studio Repository](https://github.com/frostbyte012/Gemma-Studio?tab=readme-ov-file)

---

I would love for the Gemma team and the community to explore this project and provide feedback. Let me know if there are any suggestions for improvement or additional features you'd like to see!

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.