IDEAS home Printed from https://ideas.repec.org/a/inm/oropre/v46y1998i6p776-784.html
   My bibliography  Save this article

Individual Equilibrium and Learning in Processor Sharing Systems

Author

Listed:
  • Eitan Altman

    (INRIA, Sophia-Antipolis Cedex, France)

  • Nahum Shimkin

    (Technion—Israel Institute of Technology, Haifa, Israel)

Abstract

We consider a processor-sharing service system, where the service rate to individual customers decreases as the load increases. Each arriving customer may observe the current load and should then choose whether to join the shared system. The alternative is a constant-cost option, modeled here for concreteness as a private server (e.g., a personal computer that serves as an alternative to a central mainframe computer). The customers wish to minimize their individual service times (or an increasing function thereof). However, the optimal choice for each customer depends on the decisions of subsequent ones, through their effect on the future load in the shared server. This decision problem is analyzed as a noncooperative dynamic game among the customers. We first show that any Nash equilibrium point consists of threshold decision rules and establish the existence and uniqueness of a symmetric equilibrium point. Computation of the equilibrium threshold is demonstrated for the case of Poisson arrivals, and some of its properties are delineated. We next consider a reasonable dynamic learning scheme, which converges to the symmetric Nash equilibrium point. In this model customers simply choose the better option based on available performance history. Convergence of this scheme is illustrated here via a simulation example and is established analytically in subsequent work.

Suggested Citation

  • Eitan Altman & Nahum Shimkin, 1998. "Individual Equilibrium and Learning in Processor Sharing Systems," Operations Research, INFORMS, vol. 46(6), pages 776-784, December.
  • Handle: RePEc:inm:oropre:v:46:y:1998:i:6:p:776-784
    DOI: 10.1287/opre.46.6.776
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/opre.46.6.776
    Download Restriction: no

    File URL: https://libkey.io/10.1287/opre.46.6.776?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Fudenberg, Drew & Levine, David, 1998. "Learning in games," European Economic Review, Elsevier, vol. 42(3-5), pages 631-639, May.
    2. Steven A. Lippman & Shaler Stidham, 1977. "Individual versus Social Optimization in Exponential Congestion Systems," Operations Research, INFORMS, vol. 25(2), pages 233-247, April.
    3. Naor, P, 1969. "The Regulation of Queue Size by Levying Tolls," Econometrica, Econometric Society, vol. 37(1), pages 15-24, January.
    4. Haviv, Moshe, 1991. "Stable strategies for processor sharing systems," European Journal of Operational Research, Elsevier, vol. 52(1), pages 103-106, May.
    5. Hau Leung Lee & Morris A. Cohen, 1985. "Multi-Agent Customer Allocation in a Stochastic Service System," Management Science, INFORMS, vol. 31(6), pages 752-763, June.
    6. Uri Yechiali, 1972. "Customers' Optimal Joining Rules for the GI/M/s Queue," Management Science, INFORMS, vol. 18(7), pages 434-443, March.
    7. Drew Fudenberg & David K. Levine, 1998. "The Theory of Learning in Games," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262061945, April.
    8. David Assaf & Moshe Haviv, 1990. "Reneging from Processor Sharing Systems and Random Queues," Mathematics of Operations Research, INFORMS, vol. 15(1), pages 129-138, February.
    9. Susan H. Xu & J. George Shanthikumar, 1993. "Optimal Expulsion Control—A Dual Approach to Admission Control of an Ordered-Entry System," Operations Research, INFORMS, vol. 41(6), pages 1137-1152, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Mark Fackrell & Peter Taylor & Jiesen Wang, 2021. "Strategic customer behavior in an M/M/1 feedback queue," Queueing Systems: Theory and Applications, Springer, vol. 97(3), pages 223-259, April.
    2. Piotr Więcek & Eitan Altman & Arnob Ghosh, 2016. "Mean-Field Game Approach to Admission Control of an M/M/ $$\infty $$ ∞ Queue with Shared Service Cost," Dynamic Games and Applications, Springer, vol. 6(4), pages 538-566, December.
    3. Blume, Andreas & Duffy, John & Temzelides, Ted, 2010. "Self-organized criticality in a dynamic game," Journal of Economic Dynamics and Control, Elsevier, vol. 34(8), pages 1380-1391, August.
    4. Wang, Jinting & Zhang, Feng, 2013. "Strategic joining in M/M/1 retrial queues," European Journal of Operational Research, Elsevier, vol. 230(1), pages 76-87.
    5. Ali K. Parlaktürk & Sunil Kumar, 2004. "Self-Interested Routing in Queueing Networks," Management Science, INFORMS, vol. 50(7), pages 949-966, July.
    6. A.C. Brooms, 2004. "On the Nash equilibria for the FCFS queueing system with load-increasing service rate," Birkbeck Working Papers in Economics and Finance 0407, Birkbeck, Department of Economics, Mathematics & Statistics.
    7. Xuanming Su & Stefanos Zenios, 2004. "Patient Choice in Kidney Allocation: The Role of the Queueing Discipline," Manufacturing & Service Operations Management, INFORMS, vol. 6(4), pages 280-301, June.
    8. Parlakturk, Ali & Kumar, Sunil, 2004. "Self-Interested Routing in Queueing Networks," Research Papers 1782r, Stanford University, Graduate School of Business.
    9. Hung Q. Nguyen & Tuan Phung-Duc, 2022. "Strategic customer behavior and optimal policies in a passenger–taxi double-ended queueing system with multiple access points and nonzero matching times," Queueing Systems: Theory and Applications, Springer, vol. 102(3), pages 481-508, December.
    10. V. V. Mazalov & A. V. Melnik, 2016. "Equilibrium Prices and Flows in the Passenger Traffic Problem," International Game Theory Review (IGTR), World Scientific Publishing Co. Pte. Ltd., vol. 18(01), pages 1-19, March.
    11. Albert Y. Ha, 2001. "Optimal Pricing That Coordinates Queues with Customer-Chosen Service Requirements," Management Science, INFORMS, vol. 47(7), pages 915-930, July.
    12. E. J. Collins & A. C. Brooms, 2005. "The Bernoulli Feedback Queue with Balking: Stochastic Order Results and Equilibrium Joining Rules," Birkbeck Working Papers in Economics and Finance 0517, Birkbeck, Department of Economics, Mathematics & Statistics.
    13. Cripps, Martin W. & Thomas, Caroline D., 2019. "Strategic experimentation in queues," Theoretical Economics, Econometric Society, vol. 14(2), May.
    14. Refael Hassin & Ran I. Snitkovsky, 2020. "Social and Monopoly Optimization in Observable Queues," Operations Research, INFORMS, vol. 68(4), pages 1178-1198, July.
    15. Ety Zohar & Avishai Mandelbaum & Nahum Shimkin, 2002. "Adaptive Behavior of Impatient Customers in Tele-Queues: Theory and Empirical Support," Management Science, INFORMS, vol. 48(4), pages 566-583, April.
    16. John Duffy & Andreas Blume & Ted Temzelides, 2006. "Self-Organized Criticality in a Dynamic Game," Working Paper 276, Department of Economics, University of Pittsburgh, revised Dec 2009.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Refael Hassin & Ran I. Snitkovsky, 2020. "Social and Monopoly Optimization in Observable Queues," Operations Research, INFORMS, vol. 68(4), pages 1178-1198, July.
    2. Alessandro Arlotto & Andrew E. Frazelle & Yehua Wei, 2019. "Strategic Open Routing in Service Networks," Management Science, INFORMS, vol. 65(2), pages 735-750, February.
    3. Tingliang Huang & Gad Allon & Achal Bassamboo, 2013. "Bounded Rationality in Service Systems," Manufacturing & Service Operations Management, INFORMS, vol. 15(2), pages 263-279, May.
    4. Albert Y. Ha, 2001. "Optimal Pricing That Coordinates Queues with Customer-Chosen Service Requirements," Management Science, INFORMS, vol. 47(7), pages 915-930, July.
    5. Philipp Afèche & Haim Mendelson, 2004. "Pricing and Priority Auctions in Queueing Systems with a Generalized Delay Cost Structure," Management Science, INFORMS, vol. 50(7), pages 869-882, July.
    6. Knight, Vincent A. & Harper, Paul R., 2013. "Selfish routing in public services," European Journal of Operational Research, Elsevier, vol. 230(1), pages 122-132.
    7. Grossman, Thomas A. & Brandeau, Margaret L., 2002. "Optimal pricing for service facilities with self-optimizing customers," European Journal of Operational Research, Elsevier, vol. 141(1), pages 39-57, August.
    8. Shone, Rob & Knight, Vincent A. & Williams, Janet E., 2013. "Comparisons between observable and unobservable M/M/1 queues with respect to optimal customer behavior," European Journal of Operational Research, Elsevier, vol. 227(1), pages 133-141.
    9. Galbiati, Marco & Soramäki, Kimmo, 2011. "An agent-based model of payment systems," Journal of Economic Dynamics and Control, Elsevier, vol. 35(6), pages 859-875, June.
    10. Schipper, Burkhard C., 2021. "Discovery and equilibrium in games with unawareness," Journal of Economic Theory, Elsevier, vol. 198(C).
    11. Mathieu Faure & Gregory Roth, 2010. "Stochastic Approximations of Set-Valued Dynamical Systems: Convergence with Positive Probability to an Attractor," Mathematics of Operations Research, INFORMS, vol. 35(3), pages 624-640, August.
    12. Kyle Y. Lin, 2003. "Decentralized admission control of a queueing system: A game‐theoretic model," Naval Research Logistics (NRL), John Wiley & Sons, vol. 50(7), pages 702-718, October.
    13. Ianni, A., 2002. "Reinforcement learning and the power law of practice: some analytical results," Discussion Paper Series In Economics And Econometrics 203, Economics Division, School of Social Sciences, University of Southampton.
    14. ,, 2011. "Manipulative auction design," Theoretical Economics, Econometric Society, vol. 6(2), May.
    15. Kyle Y. Lin & Sheldon M. Ross, 2003. "Admission Control with Incomplete Information of a Queueing System," Operations Research, INFORMS, vol. 51(4), pages 645-654, August.
    16. Christian Ewerhart, 2020. "Ordinal potentials in smooth games," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 70(4), pages 1069-1100, November.
    17. Benaïm, Michel & Hofbauer, Josef & Hopkins, Ed, 2009. "Learning in games with unstable equilibria," Journal of Economic Theory, Elsevier, vol. 144(4), pages 1694-1709, July.
    18. Saori Iwanaga & Akira Namatame, 2015. "Hub Agents Determine Collective Behavior," New Mathematics and Natural Computation (NMNC), World Scientific Publishing Co. Pte. Ltd., vol. 11(02), pages 165-181.
    19. Erhao Xie, 2019. "Monetary Payoff and Utility Function in Adaptive Learning Models," Staff Working Papers 19-50, Bank of Canada.
    20. Jacob W. Crandall & Mayada Oudah & Tennom & Fatimah Ishowo-Oloko & Sherief Abdallah & Jean-François Bonnefon & Manuel Cebrian & Azim Shariff & Michael A. Goodrich & Iyad Rahwan, 2018. "Cooperating with machines," Nature Communications, Nature, vol. 9(1), pages 1-12, December.
      • Abdallah, Sherief & Bonnefon, Jean-François & Cebrian, Manuel & Crandall, Jacob W. & Ishowo-Oloko, Fatimah & Oudah, Mayada & Rahwan, Iyad & Shariff, Azim & Tennom,, 2017. "Cooperating with Machines," TSE Working Papers 17-806, Toulouse School of Economics (TSE).
      • Abdallah, Sherief & Bonnefon, Jean-François & Cebrian, Manuel & Crandall, Jacob W. & Ishowo-Oloko, Fatimah & Oudah, Mayada & Rahwan, Iyad & Shariff, Azim & Tennom,, 2017. "Cooperating with Machines," IAST Working Papers 17-68, Institute for Advanced Study in Toulouse (IAST).
      • Jacob Crandall & Mayada Oudah & Fatimah Ishowo-Oloko Tennom & Fatimah Ishowo-Oloko & Sherief Abdallah & Jean-François Bonnefon & Manuel Cebrian & Azim Shariff & Michael Goodrich & Iyad Rahwan, 2018. "Cooperating with machines," Post-Print hal-01897802, HAL.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:oropre:v:46:y:1998:i:6:p:776-784. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.