BuilderIO / BuilderIO/gpt-crawler
Crawl local harddrive
Open
- Dominant language
- TypeScript
- Stars
- 22.4k
- Forks
- 2.4k
- PR merge metrics
- No merged PRs in 30d
Description
Is it possible to change GPT-crawler so it can also crawl local harddrives?
I have ripped some websites that don't exist anymore online and I want to create a bot with it.
Contributor guide
No contributing guide indexed for this repository
Research direction
The issue names no files, tests, or entry points, so first inspect the crawler's current URL input and content-loading flow. Determine how a local ripped site should be selected and represented, then verify that it can be crawled into knowledge files for a custom GPT.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- typescript
- Domain
- backend
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100