ChaptersStream Processing
Stream Processing
How do you process data continuously, as events happen, and keep derived views in sync?
Not started
Builds onEncodingReplication
Message Brokers & Logs
Put a durable buffer between the service that says something happened and the services that care. Queues hand out work and forget it; logs remember everything in order, and every reader keeps its own place.
Stream Processing
A computation that never finishes, over data that never stops and arrives out of order. How stream processors decide what time it is, when an answer is ready, and how they survive crashes without counting anything twice.
Change Data Capture & Event Sourcing
Your database already writes down every change, in order. Turn that log into a stream and every other system can follow it, or make the log of events the database itself.
Streaming Systems as Architecture
Put an ordered, replayable log at the centre, and treat every database, index and cache as a view of it. What that buys you, what it costs, and how to stay correct without distributed transactions.