Chitchat: Decentralised Cluster Membership with Failure Detection in Rust

Cluster membership management is one of the critical aspects of a distributed system. To put it simply, nothing can work if nodes don’t know about each other and what service or resource each can offer.

In this talk, first, we briefly describe Quickwit’s previous cluster management implementation. Then deeply explore the new implementation based on the scuttlebutt algorithm while highlighting our motivations and what the current rust ecosystem offers. The algorithm presented here is also what powers Apache Cassandra cluster feature. We finally conclude by presenting a couple of tricks we used to overcome some implementation challenges while contrasting with the solutions adopted by Apache Cassandra.

YOU MAY ALSO LIKE:

• J Forum (Online Conference on 31st August 2022)
• YOW! Perth Developer Conference 2022: Online (Online Conference on 19th - 20th September 2022)
• Real-time Stream Processing in Spring Made Easy (in London on 25th August 2022)
• Answering Cloud Security Questions of all the Stakeholders (Online Meetup on 13th September 2022)
• Bazel eXchange Panel: Day 2 (SkillsCast recorded in June 2022)
• Fast, Green — Choose Two: A Buildkite Case Study (SkillsCast recorded in June 2022)