Green Resource Allocation Algorithms for Publish/Subscribe Systems

Alex Cheung and Hans-Arno Jacobsen.

In 31th IEEE International Conference on Distributed Computing Systems (ICDCS), pages 812-823, June 2011.
Acceptance rate: 15%.


A popular trend in large enterprises today is the adoption of green IT strategies that use resources as efficiently as possible to reduce IT operational costs. With the publish/subscribe middleware playing a vital role in seamlessly integrating applications at large enterprises including Google and Yahoo, our goal is to search for resource allocation algorithms that enable publish/subscribe systems to use system resources as efficiently as possible. To meet this goal, we develop methodologies that minimize system-wide message rates, broker load, hop count, and the number of allocated brokers, while maximizing the resource utilization of allocated brokers to achieve maximum efficiency. Our contributions consist of developing a bit vector supported resource allocation framework, designing and comparing four different classes with a total of ten variations of subscription allocation algorithms, and developing a recursive overlay construction algorithm. A compelling feature of our work is that it works under any arbitrary workload distribution and is independent of the publish/subscribe language, which makes it easily applicable to any topic and content-based publish/subscribe system. Experiments on a cluster testbed and a high performance computing platform show that our approach reduces the average broker message rate by up to 92% and the number of allocated brokers by up to 91%.


Tags: publish/subscribe, content-based routing, load estimation, resource allocation, overlay construction, publisher relocation, subscriber relocation, load minimization, green it

Readers who enjoyed the above work, may also like the following: