Streaming (Distributed Systems)
Progress + Plans
I did 2/4 of the projects, then got a job. The job covered my programming desires, so I was doing other stuff in my free time, but I’d still like to do the rest some day, e.g. if I go unemployed for ages again. I’d cut back on the explanations in order to go faster tho :P.
I MapReduce – ✓
II Raft – ✓
III Key-Value Service (based on II)
IV Sharding (of III)
Project II was pretty interesting: Raft, a consensus algorithm, basically:
A state machine (thing that processes incoming commands) running on a redundant cluster of servers that work as a democracy, electing a leader among themselves to do the actual work and re-electing if it fails.
- Raft Illustration – check this nice 10-min illustrated intro to Raft if you’re curious.
- Raft Blueprint – the spec I was implementing.
- My Raft Notes
Videos + Work
Has a readme navigation of the Raft project.
To Max + Ben for giving me the idea to stream, and to everyone who dropped by to say hi, chat compsci or careers. This shit was fun ya kno.
^ o ^