Title:Balanced Overlay Networks (BON): Decentralized Load Balancing via Self-Organized Random Networks

Abstract: We introduce a new load balancing paradigm, where the instantaneous in-degree distribution of a dynamic overlay network encodes the current free resources at each of the server/computing nodes. The allocation of a new job is executed by sampling the in-degree of nodes via a short random walk, and assigning the job to a node with the maximum in-degree (hence, the one with the most free resources) among the sampled nodes; the reduced free resources of the node is updated by randomly deleting an appropriate number of incoming edges. Similarly, when a job is completed at a node, it updates its status by adding a desired number of incoming edges, where the other end of the edges are again picked via short random walks. We show that this mapping of free resources to the degree distribution of an overlay network is well suited to any situation where each server provides similar service such as large-scale computing (cluster and grid computing) and web content mirroring. Extensive simulation results show that our random-walk based protocol leads to an almost optimal distribution of load: the steady state topology of the overlay network approaches random d-regular graphs. Implementing the protocol directly using lightweight sockets to maintain the overlay network should involve minimal overhead, however direct connections are not required since edges in the overlay network could be ``virtual'' edges that represent routes in the underlying transport layer.