Distributed Data Engine Group

Welcome to the homepage of the distributed engine group. We focus on creating ideas for MySQL storage engines and also implement them as time allows. Currently there are four projects in work.

  • Distributed Data Engine for WAN
  • Distributed Data Engine for data warehousing application
  • Data Revision Engine
  • Column Store
The Distributed Data Engine for WAN is the original idea for this group. After many discussions and crazy ideas we came up with the idea of creating a similar engine for data warehousing applications. In detail the only difference is the distribution math. While we where working on this engine we started in on many other discussions from our daily live in different companies.

A complete separate idea came up during work on several web based industrial applications. In most applications specific data has to be tracked. Whenever a change is made the changes have to be stored in a way so the history of a data set can be retrieved. In all applications this means either several hundreds lines of code or the use of triggers. Both solutions are only to track the history but not retrieving it. The Data Revision Engine will track the changes of the data automatically. Additionally it will be possible to retrieve a specific revision of a dataset. To read more about the revision engine please visit our product page.

Our youngest project is all about column stores. Tables in the field of Data Warehouses and Weblogs tend to grow drastically over time. Most queries executed on these types of database systems seldomly require the  complete width of the table for analysis. Vertical partitioning of table data has proven to decrease disk I/O and increase query speed. Creating the column store as a pluggable storage engine within MySQL faces multiple challenges. For more information on the challenges and prospect please download our white paper.

All engines are published in a dual licencing mode. The available licences are GPL v3 and a commercial one for commercial use. We greatly encourage anyone who would like to participate in the development in any way. If you are eager to join please do not hesitate and contact us at This e-mail address is being protected from spambots. You need JavaScript enabled to view it