egarim / egarim/PropScout

[P2] Redfin scraper — data normalizer

Open
#8 0 comments 0 reactions 0 assignees View on GitHub
backend phase-2
Dominant language
TypeScript
Stars
0
Forks
0
PR merge metrics
No merged PRs in 30d

Description

Parse and normalize Redfin Apify output:
- Map Redfin fields → properties table
- Extract price history → property_history (TimescaleDB)
- Extract image URLs → queue for MinIO download
- Store raw JSON blob — never lose data
- Handle duplicates (upsert by address + source)

Contributor guide

No contributing guide indexed for this repository

Research direction

No files or tests are named. Start by locating the TypeScript entry point that receives Redfin Apify output and the code handling properties, property_history, MinIO downloads, and queueing. Done means all listed fields are normalized, price history and images are handled, raw JSON is retained, and duplicates upsert by address and source.

Written by the indexing model from the issue text.

Assessment

Tech stack
typescript
Domain
backend, data-engineering, databases
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
48/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.