Curriculum : Architecting High-Scale Geo-Spatial Matchmaking Systems with Kafka Streams and Spring Boot

Module 1 : Event-Driven Architecture & Geospatial Foundations

  • Week 1 : Foundations of Event-Driven Systems (Lessons 1–6)

  • Week 2 : Infrastructure, H3 Strategy & Kafka Setup (Lessons 7–12)


Module 2 : High-Throughput Data Simulation

  • Week 3 : High-Throughput Kafka Producer Engineering (Lessons 13–19)

  • Week 4 :Concurrent Driver Simulation & Firehose Testing (Lessons 20–25)


Module 3 : Data Locality & Custom Partitioning

  • Week 5 : Data Locality & Custom Partitioning Fundamentals (Lessons 26–30 )

  • Week 6 : Partition Boundaries, Skew & Replication (Lessons 31–35)

  • Week 7 : Rebalancing, Static Membership & Co-Partitioning (Lessons 36–40)


Module 4 : The Matching Engine (Processor API)

  • Week 8 : Kafka Streams Processor API & RocksDB Foundations (Lessons 41–45)

  • Week 9 : Stateful Driver Tracking & Fault Tolerance (Lessons 46–50)

  • Week 10 : Geo-Spatial Matching Algorithms & K-Ring Search (Lessons 51–55)

  • Week 11 : Stream Processing Optimization & Testing (Lessons 56–60)


Module 5 : Interactive Queries & RPC

  • Week 12 : Interactive Queries & Distributed State Access (Lessons 61–65)

  • Week 13 : RPC Communication & Distributed Query Patterns (Lessons 66–70)

  • Week 14 : Secure Distributed Query Infrastructure (Lessons 71–72)


Module 6 : WebSockets & Backpressure

  • Week 15 : Real-Time WebSocket Communication Systems (Lessons 73–77)

  • Week 16 : Backpressure Control & Smart Consumer Design (Lessons 78–82)

  • Week 17 : Frontend Streaming, Visualization & Latency Analysis (Lessons 83–85)


Module 7 : Operations & Scale

  • Week 18 : Production Operations, Scaling & Final Defense (Lessons 86–90)

Module 1 : Event-Driven Architecture & Geospatial Foundations

Week 1: Foundations of Event-Driven Systems

Week 2 : Infrastructure, H3 Strategy & Kafka Setup


Module 2 : High-Throughput Data Simulation

Week 3 : High-Throughput Kafka Producer Engineering

Week 4 : Concurrent Driver Simulation & Firehose Testing


Module 3 : Data Locality & Custom Partitioning

Week 5 : Data Locality & Custom Partitioning Fundamentals

Week 6 : Partition Boundaries, Skew & Replication

Week 7 : Rebalancing, Static Membership & Co-Partitioning

  • Lesson 36: Replication Factors

  • Lesson 37: Rebalancing Events

  • Lesson 38: Static Membership

  • Lesson 39: Co-Partitioning Requirements

  • Lesson 40: Locality Verification Lab


Module 4 : The Matching Engine (Processor API)

Week 8 : Kafka Streams Processor API & RocksDB Foundations

  • Lesson 41: DSL vs. Processor API (PAPI)

  • Lesson 42: Defining the Topology

  • Lesson 43: Introduction to RocksDB

  • Lesson 44: Designing the Composite Key

  • Lesson 45: Prefix Scanning

Week 9 : Stateful Driver Tracking & Fault Tolerance

  • Lesson 46: The DriverProcess Logic

  • Lesson 47: Handling Old Data

  • Lesson 48: The Punctuator (Cleanup)

  • Lesson 49: Fault Tolerance (Changelogs)

  • Lesson 50: Processing Rider Requests

Week 10 : Geo-Spatial Matching Algorithms & K-Ring Search

  • Lesson 51: The K-Ring Algorithm

  • Lesson 52: Implementing the Search Loop

  • Lesson 53: Distance Filtering

  • Lesson 54: Locking Matches

  • Lesson 55: Emitting the Match

Week 11 : Stream Processing Optimization & Testing

  • Lesson 56: Handling Failures (No Match)

  • Lesson 57: Processor Threading Model

  • Lesson 58: Custom Serdes

  • Lesson 59: Unit Testing the Topology

  • Lesson 60: Processor Lab


Module 5 : Interactive Queries & RPC

Week 12 : Interactive Queries & Distributed State Access

  • Lesson 61: Interactive Queries Theory

  • Lesson 62: The HostInfo API

  • Lesson 63: Local vs. Remote Queries

  • Lesson 64: Building the REST Controller

  • Lesson 65: Querying Local RocksDB

Week 13 : RPC Communication & Distributed Query Patterns

  • Lesson 66: Implementing RPC Client

  • Lesson 67: The Scatter-Gather Pattern

  • Lesson 68: Handling Rebalancing

  • Lesson 69: Internal Serialization

  • Lesson 70: Service Discovery

Week 14 : Secure Distributed Query Infrastructure

  • Lesson 71: Security for RPC

  • Lesson 72: RPC Lab


Module 6 : WebSockets & Backpressure

Week 15 : Real-Time WebSocket Communication Systems

  • Lesson 73: WebSocket Protocol

  • Lesson 74: STOMP Messaging

  • Lesson 75: Topic Subscriptions

  • Lesson 76: Connecting Kafka to WebSockets

  • Lesson 77: The Slow Consumer Problem

Week 16 : Backpressure Control & Smart Consumer Design

  • Lesson 78: Detecting Congestion

  • Lesson 79: Pause/Resume Logic

  • Lesson 80: Spring Container Control

  • Lesson 81: Implementing the “Smart Consumer”

  • Lesson 82: Rate Limiting

Week 17 : Frontend Streaming, Visualization & Latency Analysis

  • Lesson 83: Handling Disconnects

  • Lesson 84: Frontend Visualization

  • Lesson 85: End-to-End Latency


Module 7 : Operations & Scale

Week 18 : Production Operations, Scaling & Final Defense

  • Lesson 86: Prometheus Metrics

  • Lesson 87: RocksDB Tuning

  • Lesson 88: Standby Replicas

  • Lesson 89: Capacity Planning

  • Lesson 90: Final Architecture Defense