[P2] Redfin scraper — data normalizer
- Dominant language
- TypeScript
- Stars
- 0
- Forks
- 0
- PR merge metrics
- No merged PRs in 30d
Description
Parse and normalize Redfin Apify output:
- Map Redfin fields → properties table
- Extract price history → property_history (TimescaleDB)
- Extract image URLs → queue for MinIO download
- Store raw JSON blob — never lose data
- Handle duplicates (upsert by address + source)
Contributor guide
No contributing guide indexed for this repository
Research direction
No files or tests are named. Start by locating the TypeScript entry point that receives Redfin Apify output and the code handling properties, property_history, MinIO downloads, and queueing. Done means all listed fields are normalized, price history and images are handled, raw JSON is retained, and duplicates upsert by address and source.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- typescript
- Domain
- backend, data-engineering, databases
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Quiet
- Clarity
- Mostly clear
- Newbie friendliness
- 48/100