A cloud queuing service with strong consistency and high availability

ABSTRACT Message queues are widely used to connect loosely coupled components to form large-scale, highly distributed, and fault-tolerant applications. A number of vendors currently provide cloud-based queuing services that are designed to be elastic, scalable, and easy to use. However, unlike enterprise queuing systems, which provide strong queuing consistency and are suitable for many traditional enterprise workloads, these cloud-based queuing services offer reduced queuing consistency. They can deliver messages without loss, but they may deliver messages out of order or with duplications. This paper presents SilverDove Queuing Service (SDQS), a scalable cloud-based queuing service with stronger consistency than existing cloud-based queuing services. SDQS delivers messages without losses or duplications and provides in-order message delivery as an option. Built on top of IBM WebSphere® eXtreme Scale, i.e., an elastic in-memory object grid system, SDQS can be easily scaled up and down to accommodate a wide range of workloads. SDQS is able to provide high availability with either the no-order or the in-order message delivery option. We have performed a preliminary evaluation of SDQS with up to 70 nodes on a compute cloud platform, verifying its consistency offerings and providing insights into the tradeoff between performance and consistency.

KEYWORDS

SHARE & LIKE

COMMENTS

ABOUT THE AUTHOR

IBM journal of research and development

0 Following 2 Fans 0 Projects 70 Articles

SIMILAR ARTICLES

ABSTRACT The IBM Blue Gene®/Q supercomputer is designed for highly efficient computing for problems dominated by floating-point computation. Its tar

Read More

ABSTRACT Enterprise adoption of cloud computing often requires a significant transformation of existing information technology (IT) systems and proc

Read More

ABSTRACT The heart of a Blue Gene®/Q system is the Blue Gene/Q Compute (BQC) chip, which combines processors, memory, and communication functions on

Read More

ABSTRACT The heart of a Blue Gene®/Q system is the Blue Gene/Q Compute (BQC) chip, which combines processors, memory, and communication functions on

Read More

ABSTRACT The IBM Blue Gene®/Q supercomputer is designed for highly efficient computing for problems dominated by floating-point computation. Its tar

Read More

In this paper, we explain the techniques used in IBM Blue Gene®/Q Compute chips to achieve high energy efficiency. Architectural techniques include the

Read More

In this paper, we explain the techniques used in IBM Blue Gene®/Q Compute chips to achieve high energy efficiency. Architectural techniques include the

Read More

ABSTRACT In order to understand application-level power/performance tradeoffs on current computer systems, runtime monitoring capabilities are neede

Read More

ABSTRACT In order to understand application-level power/performance tradeoffs on current computer systems, runtime monitoring capabilities are neede

Read More

ABSTRACT The principal focus areas for system software on the IBM Blue Gene®/Q include ultrascalability and high reliability while delivering the fu

Read More