cactus-compute / cactus-compute/needle

Needle available on Android possibility

Open
#17 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
11k
Forks
710
Avg merge
1d 21h
Merged PRs (30d)
25

Description

Hi,

I am looking to load Needle through cactus-react-native on Android also iOS in the future.

Current state as I understand it:
- Needle on HF is published as JAX/Flax (needle.pkl, ~53MB)
- cactus-react-native's model registry doesn't include Needle yet
- v1 moved from GGUF to .cact, so the obvious 'just load a GGUF' path doesn't apply here.

Questions:
1. Do you have an item on the roadmap for Needle in the RN SDK model list?
2. Is the .cact format / conversion pipeline documented for external use? Willing to give porting if there's a starting point.
3. Any recommended intermediate path (ONNX export, server-side until ready, etc.)?

Context: Love the idea of adding a light tool calling LLM to mobile apps

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the cactus-react-native model registry and investigate the documented .cact conversion pipeline, if one exists. Check whether Needle's JAX/Flax artifact can be supported on Android and iOS; done requires a confirmed roadmap or a documented conversion and integration path.

Written by the indexing model from the issue text.

Assessment

Tech stack
android, ios, python, react-native
Domain
machine-learning, mobile-dev
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.