cactus-compute / cactus-compute/needle
Needle available on Android possibility
- Dominant language
- Python
- Stars
- 11k
- Forks
- 710
- Avg merge
- 1d 21h
- Merged PRs (30d)
- 25
Description
Hi,
I am looking to load Needle through cactus-react-native on Android also iOS in the future.
Current state as I understand it:
- Needle on HF is published as JAX/Flax (needle.pkl, ~53MB)
- cactus-react-native's model registry doesn't include Needle yet
- v1 moved from GGUF to .cact, so the obvious 'just load a GGUF' path doesn't apply here.
Questions:
1. Do you have an item on the roadmap for Needle in the RN SDK model list?
2. Is the .cact format / conversion pipeline documented for external use? Willing to give porting if there's a starting point.
3. Any recommended intermediate path (ONNX export, server-side until ready, etc.)?
Context: Love the idea of adding a light tool calling LLM to mobile apps
Contributor guide
No contributing guide indexed for this repository
Research direction
Start with the cactus-react-native model registry and investigate the documented .cact conversion pipeline, if one exists. Check whether Needle's JAX/Flax artifact can be supported on Android and iOS; done requires a confirmed roadmap or a documented conversion and integration path.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- android, ios, python, react-native
- Domain
- machine-learning, mobile-dev
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Quiet
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100