huggingface / huggingface/aisheets

Local Inference (Ollama) and Offline Functionality Not Working as Expected

Open
#440 3 comments 2 reactions 1 assignee Claimed by @frascuchon View on GitHub
Dominant language
TypeScript
Stars
1.6k
Forks
140
Avg merge
1m
Merged PRs (30d)
1

Description

We attempted to set up Hugging Face AI Sheets to perform inference using local Large Language Models (LLMs) via Ollama
(specifically llama3 and phi3:mini), aiming for data privacy and potential offline use. However, our extensive testing
revealed that the application does not behave as expected based on the CUSTOMIZATION.md documentation.

Observed Behavior:

1. Hard Dependency on Internet Connection (Offline Failure):
2. Inference Not Routed to Local Ollama (Even When Online):
3. UI Misleading/Problematic:
4. `HF_TOKEN` Requirement:
1. Clone the AI Sheets repository: git clone https://github.com/huggingface/aisheets.git
`
HF_TOKEN="hf_YOUR_VALID_HUGGINGFACE_TOKEN"
MODEL_ENDPOINT_URL="http://localhost:11434"
MODEL_ENDPOINT_NAME="llama3" # Or "phi3:mini" for testing the other model
`
6. Build the application: pnpm run build
7. Start the server: pnpm serve (ensure internet connection is active for this step).
8. In the AI Sheets UI, load a CSV file (e.g., reviews.csv with texto_resena in column2).
9. Add a new column using a prompt (e.g., sentiment analysis on {{column2}}).
10. Observe: Check the ollama serve terminal. No new log entries will appear, indicating no request reached the local server.
11. Test Offline: Disconnect from the internet. Restart pnpm serve. The application will fail to load with an ENOTFOUND
huggingface.co error.

Expected Behavior:

* The application should be able to load and function without an internet connection when configured for local LLMs.
* Misleading documentation regarding local/offline capabilities.
* Operating System: Windows (win32)

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.