DATA ENGINEERING
PriceRadar — Competitive Price Intelligence
Full-stack price monitoring system: configure product URLs, schedule Playwright stealth scrapes every 15 minutes, track history in Redis, and receive webhook/Slack/email alerts on price moves.
Source code
15min — min scrape interval
The problem
E-commerce teams check competitor prices manually once a day and miss flash discounts, stock-out pricing shifts, and aggressive undercutting that happens overnight.
The approach
Playwright with stealth mode + multiple extraction strategies handles anti-bot measures. APScheduler runs configurable jobs (15min–weekly) with jitter. Redis stores up to 500 time-series data points per product. Seven alert condition types (threshold breach, % change, stock status) route to webhook, Slack, or email.
The results
Real-time WebSocket dashboard with price trend charts and competitor comparisons. Data export in CSV and JSON. Deployed via Docker Compose with Nginx reverse proxy. Supports 15-minute to weekly scrape intervals with intelligent jitter to avoid rate limiting.
Stack: React 18, Vite 5, FastAPI, Playwright, Redis 8, APScheduler, Docker