Chaos achieved 4th place in the Graph500 capacity ranking for June 2016!
The Achievement
We processed a graph with 16 trillion edges (scale 40) using only 20 commodity servers in approximately 10.5 hours, requiring 256 terabytes of storage.
Technical Innovation
Unlike supercomputers that rely on massive main memory, Chaos uses a pool of magnetic disks to store and process the graph. This offers cost-effective scalability despite slower processing speeds.
Ragnarok Mode
Our specialized processing approach enables edge stream optimization. The system produces updates by inserting them directly in the edge stream and implements circular edge streams which collapse the parts of the file that have been read while appending newly generated data.
Significance
This achievement demonstrates that competitive large-scale graph processing is achievable with affordable hardware through innovative system design. We are competing against dedicated supercomputing infrastructure with commodity machines!
See the full rankings on Graph500.