Massive data analytics: The Graph 500 on IBM Blue Gene/Q

ABSTRACT Graph algorithms are becoming increasingly important for biology, transportation, business intelligence, and a wide range of commercial workloads. Most graph algorithms stress to the limit various architectural aspects of conventional machines. The memory access patterns are irregular, with little spatial locality and data reuse. The amount of computation per loaded byte is very small, typically involving bit manipulation; pointer-chasing is often the norm. Likewise, the generated network traffic comprises small packets that are sent to random destinations at a very high messaging rate. With our recent winning Graph 500 submissions in November 2010, June 2011, and November 2011, we have demonstrated the versatility of the IBM Blue Gene® family of supercomputers and the possibility of using them to parallelize demanding data-intensive applications. In this paper, we describe the algorithmic techniques that we used to map the Graph 500 breadth-first search (BFS) exploration on the IBM Blue Gene®/Q, achieving a performance of 254 billion traversed edges per second.

KEYWORDS

SHARE & LIKE

COMMENTS

ABOUT THE AUTHOR

IBM journal of research and development

0 Following 2 Fans 0 Projects 70 Articles

SIMILAR ARTICLES

ABSTRACT The IBM Blue Gene®/Q supercomputer is designed for highly efficient computing for problems dominated by floating-point computation. Its tar

阅读更多

ABSTRACT Enterprise adoption of cloud computing often requires a significant transformation of existing information technology (IT) systems and proc

阅读更多

ABSTRACT The heart of a Blue Gene®/Q system is the Blue Gene/Q Compute (BQC) chip, which combines processors, memory, and communication functions on

阅读更多

ABSTRACT The heart of a Blue Gene®/Q system is the Blue Gene/Q Compute (BQC) chip, which combines processors, memory, and communication functions on

阅读更多

ABSTRACT The IBM Blue Gene®/Q supercomputer is designed for highly efficient computing for problems dominated by floating-point computation. Its tar

阅读更多

In this paper, we explain the techniques used in IBM Blue Gene®/Q Compute chips to achieve high energy efficiency. Architectural techniques include the

阅读更多

In this paper, we explain the techniques used in IBM Blue Gene®/Q Compute chips to achieve high energy efficiency. Architectural techniques include the

阅读更多

ABSTRACT In order to understand application-level power/performance tradeoffs on current computer systems, runtime monitoring capabilities are neede

阅读更多

ABSTRACT In order to understand application-level power/performance tradeoffs on current computer systems, runtime monitoring capabilities are neede

阅读更多

ABSTRACT The principal focus areas for system software on the IBM Blue Gene®/Q include ultrascalability and high reliability while delivering the fu

阅读更多