IA
Netflix's Real-Time Distributed Graph, Part 1 — Ingesting and Processing Data Streams
IA
The Daily Diff di Premchand Chidipoti
Note sull'episodio
The origin story of Netflix's Real-Time Distributed Graph: why microservices left them with data silos across ads, live events, and games, and how member actions become graph nodes and edges. Jordan and Riley cover the API Gateway to Kafka to Flink pipeline (~1M msgs/sec per topic, 5M+ records/sec published downstream), and the two scaling calls Netflix made — one Flink job per Kafka topic, and a separate topic per node/edge type — trading operational overhead for independent scaling.
Source: How and Why Netflix Built a Real-Time Distributed Graph, Part 1: Ingesting and Processing Data Streams at Internet Scale — Netflix Tech Blog, Oct 17 2025 — https:/ ...
Parole chiave
Tech blogEngineering blogSoftware designSoftware engineering