|
|
Erlang eXchange 2008: Alexander Reinefeld on Building a transactional distributed data store with Erlang
Building a transactional distributed data store with Erlang
The e-commerce platforms at Amazon, E-Bay or Google serve millions of customers using tens of thousands of servers located in data centers throughout the world. At this scale, components fail continuously and it is difficult to maintain a consistent state while hiding failures from the application.
Peer-to-peer protocols have been invented to provide availability by replicating services among peers. The current systems are perfectly tuned for sharing read-only data. To extend them beyond the typical file sharing, the support of transactions on distributed hash tables (DHTs) is a most important but yet missing feature.
At this talk given at the Erlang eXchange 2008, Alexander presented a key/value store based on DHTs that supports consistent writes. Alexander will explain how a system by Zuse Institute Berlin and onScale solutions GmbH comprises of three layers, all of them implemented in Erlang:
- a DHT layer for scalable, reliable access to replicated distributed data,
- a transaction layer to ensure data consistency in the face of concurrent write operations,
- an application layer with a very demanding access rate of several thousand reads/writes per second.
For the application layer, Zuse Institute Berlin and onScale solutions GmbH selected a distributed, scalable Wiki with full transaction support. Alexander will show that its Wiki outperforms the public Wikipedia in terms of served page requests per second and he will discuss how the development of the distributed code benefited from the use of Erlang rather than C++ or Java.
This is a joint development by Zuse Institute Berlin and onScale solutions GmbH.
Download the slides here
ABOUT ALEXANDER REINEFELD
|
Alexander Reinefeld is the head of the Computer Science department of the Zuse Institute Berlin and a professor for parallel and distributed systems at the Humboldt-Universität zu Berlin. His research interests include grid and peer-to-peer computing
More about Alexander Reinefeld
|
|
PODCAST BUILDING A TRANSACTIONAL DISTRIBUTED DATA STORE WITH ERLANG
|
|
|
