Resource allocation in decentralised computational systems: an evolutionary market-based approach

We present a novel market-based method, inspired by retail markets, for resource allocation in fully decentralised systems where agents are self-interested. Our market mechanism requires no coordinating node or complex negotiation. The stability of outcome allocations, those at equilibrium, is analysed and compared for three buyer behaviour models. In order to capture the interaction between self-interested agents, we propose the use of competitive coevolution. Our approach is both highly scalable and may be tuned to achieve specified outcome resource allocations. We demonstrate the behaviour of our approach in simulation, where evolutionary market agents act on behalf of service providing nodes to adaptively price their resources over time, in response to market conditions. We show that this leads the system to the predicted outcome resource allocation. Furthermore, the system remains stable in the presence of small changes in price, when buyers’ decision functions degrade gracefully.

[1]  Emin Gün Sirer,et al.  Perils of transitive trust in the domain name system , 2005, IMC '05.

[2]  Philip S. Yu,et al.  Dynamic Load Balancing on Web-Server Systems , 1999, IEEE Internet Comput..

[3]  Lawrence Davis,et al.  Genetic Algorithms and Simulated Annealing , 1987 .

[4]  Torsten Eymann,et al.  Decentralized vs. Centralized Economic Coordination of Resource Allocation in Grids , 2003, European Across Grids Conference.

[5]  A. Roth,et al.  Learning in Extensive-Form Games: Experimental Data and Simple Dynamic Models in the Intermediate Term* , 1995 .

[6]  Hans M. Amman,et al.  Handbook of Computational Economics , 1996 .

[7]  Matei Ripeanu,et al.  Peer-to-peer architecture case study: Gnutella network , 2001, Proceedings First International Conference on Peer-to-Peer Computing.

[8]  Dave Cliff,et al.  Shop ‘Til You Drop I: Market Trading Interactions as Adaptive Behavior , 1998 .

[9]  Andrew Byde,et al.  Applying evolutionary game theory to auction mechanism design , 2003, EEE International Conference on E-Commerce, 2003. CEC 2003..

[10]  David Abramson,et al.  Economic models for resource management and scheduling in Grid computing , 2002, Concurr. Comput. Pract. Exp..

[11]  Torsten Eymann,et al.  Self-organizing resource allocation for autonomic network , 2003, 14th International Workshop on Database and Expert Systems Applications, 2003. Proceedings..

[12]  T. Ishida,et al.  An equilibratory market-based approach for distributed resource allocation and its applications to communication network control , 1996 .

[13]  Robert Axelrod,et al.  The Evolution of Strategies in the Iterated Prisoner's Dilemma , 2001 .

[14]  Mark Handley,et al.  A scalable content-addressable network , 2001, SIGCOMM '01.

[15]  Paolo Traverso,et al.  Service-Oriented Computing: a Research Roadmap , 2008, Int. J. Cooperative Inf. Syst..

[16]  Kevin C. Almeroth,et al.  Price issues in delivering E-content on-demand , 2002, SECO.

[17]  Torsten Eymann,et al.  The catallaxy approach for decentralized economic-based allocation in Grid resource and service markets , 2006, Applied Intelligence.

[18]  Peter McBurney,et al.  JCAT: a platform for the TAC market design competition , 2008, AAMAS.

[19]  R. Baldick,et al.  Hybrid coevolutionary programming for Nash equilibrium search in games with local optima , 2004, IEEE Transactions on Evolutionary Computation.

[20]  Zhiwei Xu,et al.  GridIS: an incentive-based grid scheduling , 2005, 19th IEEE International Parallel and Distributed Processing Symposium.

[21]  Andrew B. Whinston,et al.  The economics of network management , 1999, CACM.

[22]  Munindar P. Singh,et al.  Service-oriented computing - semantics, processes, agents , 2005 .

[23]  S. Clearwater.  Market-based control: a paradigm for distributed resource allocation , 1996 .

[24]  Ishfaq Ahmad,et al.  Non-cooperative, semi-cooperative, and cooperative games-based grid resource allocation , 2006, Proceedings 20th IEEE International Parallel & Distributed Processing Symposium.

[25]  Peter McBurney,et al.  An evolutionary game-theoretic comparison of two double-auction market designs , 2004, AAMAS'04.

[26]  Charles R. Plott,et al.  An Experimental Examination of Two Exchange Institutions , 1978 .

[27]  Shohachiro Nakanishi,et al.  Distributed auction servers resolving winner and winning bid without revealing privacy of bids , 2000, Proceedings Seventh International Conference on Parallel and Distributed Systems: Workshops.

[28]  Tad Hogg,et al.  Spawn: A Distributed Computational Economy , 1992, IEEE Trans. Software Eng..

[29]  Pattie Maes,et al.  Challenger: a multi-agent system for distributed resource allocation , 1997, AGENTS '97.

[30]  Xin Yao,et al.  Evolutionary market agents and heterogeneous service providers: Achieving desired resource allocations , 2009, 2009 IEEE Congress on Evolutionary Computation.

[31]  A. E. Eiben,et al.  Introduction to Evolutionary Computing , 2003, Natural Computing Series.

[32]  Richard M. Karp,et al.  Load balancing in dynamic structured peer-to-peer systems , 2006, Perform. Evaluation.

[33]  Julian Padget,et al.  Auctions without Auctioneers: Distributed Auction Protocols , 1999, Agent Mediated Electronic Commerce.

[34]  Dave Cliff,et al.  Explorations in evolutionary design of online auction market mechanisms , 2003, Electron. Commer. Res. Appl..

[35]  Tony Curzon Price,et al.  Using co-evolutionary programming to simulate strategic behaviour in markets , 1997 .

[36]  Richard Wolski,et al.  Analyzing Market-Based Resource Allocation Strategies for the Computational Grid , 2001, Int. J. High Perform. Comput. Appl..

[37]  Nicholas R. Jennings,et al.  On Agent-Mediated Electronic Commerce , 2003, IEEE Trans. Knowl. Data Eng..

[38]  Dave Cliff,et al.  Simple Bargaining Agents for Decentralized Market-Based Control , 1998, ESM.

[39]  Kevin Lai,et al.  Markets are dead, long live markets , 2005, SECO.

[40]  Torsten Eymann,et al.  The Catallaxy as a New Paradigm for the Design of Information Systems , 2000 .

[41]  Pablo Rodriguez,et al.  Dynamic parallel access to replicated content in the internet , 2002, TNET.

[42]  Anne-Marie Kermarrec,et al.  Epidemic information dissemination in distributed systems , 2004, Computer.

[43]  Vernon L. Smith,et al.  A Comparison of Posted-Offer and Double-Auction Pricing Institutions , 1984 .

[44]  Dave Cliff,et al.  Evolving market design in zero-intelligence trader markets , 2003, EEE International Conference on E-Commerce, 2003. CEC 2003..

[45]  Stephen A. Jarvis,et al.  Grid load balancing using intelligent agents , 2005, Future Gener. Comput. Syst..

[46]  Thomas L. Casavant,et al.  A Taxonomy of Scheduling in General-Purpose Distributed Computing Systems , 1988, IEEE Trans. Software Eng..

[47]  Patrick Brézillon,et al.  Lecture Notes in Artificial Intelligence , 1999 .

[48]  Ruay-Shiung Chang,et al.  A multiple parallel download scheme with server throughput and client bandwidth considerations for data grids , 2008, Future Gener. Comput. Syst..

[49]  John Dickhaut,et al.  Price Formation in Double Auctions , 2001, E-Commerce Agents.

[50]  T. Eymann,et al.  Co-Evolution of Bargaining Strategies in a Decentralized Multi-Agent System , 2001 .

[51]  Edward J. Anderson,et al.  Modeling Implicit Collusion Using Coevolution , 2009, Oper. Res..

[52]  R. Alfano,et al.  TURBO: an autonomous execution environment with scalability and load balancing features , 2006, IEEE Workshop on Distributed Intelligent Systems: Collective Intelligence and Its Applications (DIS'06).

[53]  M. Mišík,et al.  Oxford University Press , 1968, PMLA/Publications of the Modern Language Association of America.

[54]  Elizabeth Sklar,et al.  Co-evolutionary Auction Mechanism Design: A Preliminary Report , 2002, AMEC.

[55]  Eric A. Brewer,et al.  Lessons from Giant-Scale Services , 2001, IEEE Internet Comput..

[56]  David Hausheer,et al.  PeerMart: the technology for a distributed auction-based market for peer-to-peer services , 2005, IEEE International Conference on Communications, 2005. ICC 2005. 2005.

[57]  P. Oscar Boykin,et al.  Balanced Overlay Networks (BON): An Overlay Technology for Decentralized Load Balancing , 2004, IEEE Transactions on Parallel and Distributed Systems.

[58]  Jeffrey O. Kephart,et al.  Shopbots and Pricebots , 1999, IJCAI.

[59]  Xin Yao,et al.  Evolutionary Market Agents for Resource Allocation in Decentralised Systems , 2008, PPSN.