Retrieve this presentation online
Load balancer at Spotify : Part 1 and Part 2
Evaluation of different load balancing strategies
I want to provide an example of why consensus is needed.
Some of these problems can be ameliorated by improving Elasticsearch’s GC performance and overall responsiveness–but this will only reduce the frequency of split-brain events, not fix the underlying problem. Elasticsearch needs a real consensus algorithm to linearize updates to documents.
By the way, the entire Jepsen blog post list is a must read if you consider being a backend developer, and might still be interresting for full stack developers. Start from the begining.