web3privacy / web3privacy/explorer-data
LLM data crawler
Open
@undecidedpathways is already working on this.
Since Sep 4, 2025.
enhancement
- Dominant language
- JavaScript
- Stars
- 35
- Forks
- 63
- Avg merge
- 1d 21h
- Merged PRs (30d)
- 7
Description
We need to build a web crawler - add a website as a substitution of manual input of data.
Impacting
- up to date information
- speed of data fulfillment
- accuracy
Functioning
- check privacy project's webs
- update new info constantly (push PR? propose clean CSV-dataset?)
- sensitive data - moderated, basic data - not (need to define differences)
Early scouting options
- Venice AI (Diem) (free besides the cost of Purchasing DIEM) (can be used for lightweight queries for the explorer)
- Akash (test out chat.akash.network) - plug in the explorer-data, give it a prompt, explore the models, try out, test out, give it the spec, give an example
- Another option is a local model running on someones computer
- build a decentralized AI solution (Hackathon project)
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.