CodeForTucson / CodeForTucson/green-welcome-package-astro
Event Scraper
- Dominant language
- Astro
- Stars
- 1
- Forks
- 2
- PR merge metrics
- No merged PRs in 30d
Description
Write a web scraper to find events related to sustainability, green living.
Feel free to contact developers on Slack if you'd like guidance
- [ ] Find event sources
- [ ] Choose how to store the data.
- Some standard database choices are MongoDB, Postgres, or MySQL. You may need to find hosting, but AWS has a [free tier](https://aws.amazon.com/rds/free/)
- Or you can store the data in a file and commit to git.
- [ ] Write a web scraper to regularly visit pages to extract the necessary information and store it (If you don't know how, [Puppeteer](https://github.com/puppeteer/puppeteer) would be a good starting point)
- [ ] Make this accessible to our website
- [ ] (Optional) Schedule the scraping
Contributor guide
No contributing guide indexed for this repository
Research direction
The issue names no files, tests, or entry points. Start by identifying event sources and choosing whether the data lives in MongoDB, Postgres, MySQL, or a committed file; then define the scraper, website access, and optional scheduling work, with completion shown by regularly extracted event data available on the website.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- aws, mongodb, mysql, postgres
- Domain
- backend, databases, web-dev
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100