Real-Time Trending Products

Real-Time Trending Products

A high-throughput, real-time leaderboard engine built on a horizontally scaled Redis Cluster. The system tracks product popularity across 10 categories by scoring every purchase and view event instantly — maintaining sorted leaderboards over 50,000+ products with sub-millisecond latency. Designed for scale-out from day one, it demonstrates key distributed systems concepts: data sharding, automatic failover, replica read scaling, and pipeline-based bulk ingestion.

Node.js Redis Cluster ioredis Docker Docker Compose Distributed Systems Data Sharding Real-Time Processing High Availability Horizontal Scaling
View on GitHub

What Is This Project?

What Is This Project?

Spinning Up the Cluster

Spinning Up the Cluster

Hash Slot Allocation & Cluster Init

Hash Slot Allocation & Cluster Init

Live Cluster Topology

Live Cluster Topology

High-Throughput Pipeline Seeding

High-Throughput Pipeline Seeding

Data Distribution Across Shards

Data Distribution Across Shards

Flash Sale Simulation — 1,000 Concurrent Purchases

Flash Sale Simulation — 1,000 Concurrent Purchases

High Availability — Master Failover in 3ms

High Availability — Master Failover in 3ms

Failover Summary — 27% Write Failure Rate, 3ms Recovery

Failover Summary — 27% Write Failure Rate, 3ms Recovery

Multi-Category Leaderboards & Parallel Speedup

Multi-Category Leaderboards & Parallel Speedup