IDEAS home Printed from https://ideas.repec.org/a/eee/labeco/v46y2017icp189-199.html
   My bibliography  Save this article

Technological innovations in monitoring and evaluation: Evidence of performance impacts among Major League Baseball umpires

Author

Listed:
  • Mills, Brian M.

Abstract

This paper examines the performance-enhancing role of changes in monitoring, evaluation, and training technology in an experience-diverse expert workforce: Major League Baseball umpires. I find improvements in job performance across the league that is consistent with the timing of innovations in monitoring technology and later enhancements in training and feedback. Performance improvements associated with increased training and immediate feedback are more pronounced for younger umpires. Implications for the differential effects of evaluation and feedback across experience levels of firm employees are discussed.

Suggested Citation

  • Mills, Brian M., 2017. "Technological innovations in monitoring and evaluation: Evidence of performance impacts among Major League Baseball umpires," Labour Economics, Elsevier, vol. 46(C), pages 189-199.
    • Handle: RePEc:eee:labeco:v:46:y:2017:i:c:p:189-199
    DOI: 10.1016/j.labeco.2016.10.004
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0927537116302184
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.labeco.2016.10.004?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Kostiuk, Peter F & Follmann, Dean A, 1989. "Learning Curves, Personal Characteristics, and Job Performance," Journal of Labor Economics, University of Chicago Press, vol. 7(2), pages 129-146, April.
    2. repec:iza:izawol:journl:y:2015:p:152 is not listed on IDEAS
    3. Scott Tainsky & Brian M. Mills & Jason A. Winfree, 2015. "Further Examination of Potential Discrimination Among MLB Umpires," Journal of Sports Economics, , vol. 16(4), pages 353-374, May.
    4. Edward P. Lazear, 2000. "The Power of Incentives," American Economic Review, American Economic Association, vol. 90(2), pages 410-414, May.
    5. Sue Fernie & David Metcalf, 1999. "It’s Not What You Pay it’s the Way that You Pay it and that’s What Gets Results: Jockeys’ Pay and Performance," LABOUR, CEIS, vol. 13(2), pages 385-411, June.
    6. Canice Prendergast, 1999. "The Provision of Incentives in Firms," Journal of Economic Literature, American Economic Association, vol. 37(1), pages 7-63, March.
    7. Christopher A. Parsons & Johan Sulaeman & Michael C. Yates & Daniel S. Hamermesh, 2011. "Strike Three: Discrimination, Incentives, and Evaluation," American Economic Review, American Economic Association, vol. 101(4), pages 1410-1435, June.
    8. Joseph Price & Justin Wolfers, 2010. "Racial Discrimination Among NBA Referees," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 125(4), pages 1859-1887.
    9. Victor Lavy, 2009. "Performance Pay and Teachers' Effort, Productivity, and Grading Ethics," American Economic Review, American Economic Association, vol. 99(5), pages 1979-2011, December.
    10. Edward P. Lazear, 2000. "Performance Pay and Productivity," American Economic Review, American Economic Association, vol. 90(5), pages 1346-1361, December.
    11. Claudio Lucifora & Federica Origo, 2015. "Performance-Related Pay and Firm Productivity," ILR Review, Cornell University, ILR School, vol. 68(3), pages 606-632, May.
    12. Baker, George P, 1992. "Incentive Contracts and Performance Measurement," Journal of Political Economy, University of Chicago Press, vol. 100(3), pages 598-614, June.
    13. Gary Solon & Steven J. Haider & Jeffrey M. Wooldridge, 2015. "What Are We Weighting For?," Journal of Human Resources, University of Wisconsin Press, vol. 50(2), pages 301-316.
    14. Thomas Dohmen & Jan Sauermann, 2016. "Referee Bias," Journal of Economic Surveys, Wiley Blackwell, vol. 30(4), pages 679-695, September.
    15. C. Kirabo Jackson & Jonah E. Rockoff & Douglas O. Staiger, 2014. "Teacher Effects and Teacher-Related Policies," Annual Review of Economics, Annual Reviews, vol. 6(1), pages 801-825, August.
    16. Franceschelli, Ignacio & Galiani, Sebastian & Gulmez, Eduardo, 2010. "Performance pay and productivity of low- and high-ability workers," Labour Economics, Elsevier, vol. 17(2), pages 317-322, April.
    17. Eric S. Taylor & John H. Tyler, 2012. "The Effect of Evaluation on Teacher Performance," American Economic Review, American Economic Association, vol. 102(7), pages 3628-3651, December.
    18. Rosen, Sherwin, 1981. "The Economics of Superstars," American Economic Review, American Economic Association, vol. 71(5), pages 845-858, December.
    19. Bentley Coffey & M. T. Maloney, 2010. "The Thrill of Victory: Measuring the Incentive to Win," Journal of Labor Economics, University of Chicago Press, vol. 28(1), pages 87-112, January.
    20. Eric Zitzewitz, 2012. "Forensic Economics," Journal of Economic Literature, American Economic Association, vol. 50(3), pages 731-769, September.
    21. Esther Duflo & Rema Hanna & Stephen P. Ryan, 2012. "Incentives Work: Getting Teachers to Come to School," American Economic Review, American Economic Association, vol. 102(4), pages 1241-1278, June.
    22. Jonah E. Rockoff & Douglas O. Staiger & Thomas J. Kane & Eric S. Taylor, 2012. "Information and Employee Evaluation: Evidence from a Randomized Intervention in Public Schools," American Economic Review, American Economic Association, vol. 102(7), pages 3184-3213, December.
    23. Claudio Lucifora, 2015. "Performance-related pay and labor productivity," IZA World of Labor, Institute of Labor Economics (IZA), pages 152-152, May.
    24. Harry J. Paarsch & Bruce S. Shearer, 1999. "The Response of Worker Effort to Piece Rates: Evidence from the British Columbia Tree-Planting Industry," Journal of Human Resources, University of Wisconsin Press, vol. 34(4), pages 643-667.
    25. Lawrence M. Kahn, 2000. "The Sports Business as a Labor Market Laboratory," Journal of Economic Perspectives, American Economic Association, vol. 14(3), pages 75-94, Summer.
    26. Michael J. Podgursky & Matthew G. Springer, 2007. "Teacher performance pay: A review," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 26(4), pages 909-950.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Dawson, Peter & Massey, Patrick & Downward, Paul, 2020. "Television match officials, referees, and home advantage: Evidence from the European Rugby Cup," Sport Management Review, Elsevier, vol. 23(3), pages 443-454.
    2. Terri L. Griffith & Emma S. Nordbäck & John E. Sawyer & Ronald E. Rice, 2018. "Field study of complements to supervisory leadership in more and less flexible work settings," Journal of Organization Design, Springer;Organizational Design Community, vol. 7(1), pages 1-26, December.
    3. Deshpande Sameer K. & Wyner Abraham, 2017. "A hierarchical Bayesian model of pitch framing," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 13(3), pages 95-112, September.
    4. Mike Hsu, 2024. "Umpire Home Bias in Major League Baseball," Journal of Sports Economics, , vol. 25(4), pages 423-442, May.
    5. Mills, Brian M. & Salaga, Steven, 2018. "A natural experiment for efficient markets: Information quality and influential agents," Journal of Financial Markets, Elsevier, vol. 40(C), pages 23-39.
    6. Finigan, Duncan & Mills, Brian M. & Stone, Daniel F., 2020. "Pulling starters," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 89(C).
    7. Hunter David J., 2018. "New metrics for evaluating home plate umpire consistency and accuracy," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 14(4), pages 159-172, December.
    8. Kayas, Oliver G., 2023. "Workplace surveillance: A systematic review, integrative framework, and research agenda," Journal of Business Research, Elsevier, vol. 168(C).
    9. John Charles Bradbury, 2019. "Monitoring and Employee Shirking: Evidence From MLB Umpires," Journal of Sports Economics, , vol. 20(6), pages 850-872, August.
    10. Eric Fesselmeyer, 2021. "The impact of temperature on labor quality: Umpire accuracy in Major League Baseball," Southern Economic Journal, John Wiley & Sons, vol. 88(2), pages 545-567, October.
    11. Ulrike Holder & Thomas Ehrmann & Arne König, 2022. "Monitoring experts: insights from the introduction of video assistant referee (VAR) in elite football," Journal of Business Economics, Springer, vol. 92(2), pages 285-308, February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Thiele, Veikko, 2007. "Task-Specific Abilities in Multi-Task Agency Relations," MPRA Paper 2470, University Library of Munich, Germany.
    2. Brian M. Mills, 2017. "Policy Changes In Major League Baseball: Improved Agent Behavior And Ancillary Productivity Outcomes," Economic Inquiry, Western Economic Association International, vol. 55(2), pages 1104-1118, April.
    3. David Butler & Robert Butler & Robert Simmons, 2022. "Contracts, pay and performance in the sport of kings: Evidence from horse racing," British Journal of Industrial Relations, London School of Economics, vol. 60(1), pages 152-175, March.
    4. Belloc, Filippo, 2022. "Profit sharing and innovation across organizational layers," Journal of Economic Behavior & Organization, Elsevier, vol. 197(C), pages 598-623.
    5. Klein Teeselink, Bouke & Potter van Loon, Rogier J.D. & van den Assem, Martijn J. & van Dolder, Dennie, 2020. "Incentives, performance and choking in darts," Journal of Economic Behavior & Organization, Elsevier, vol. 169(C), pages 38-52.
    6. Benno Torgler & Sascha L. Schmidt & Bruno S. Frey, 2006. "The Power of Positional Concerns: A Panel Analysis," CREMA Working Paper Series 2006-19, Center for Research in Economics, Management and the Arts (CREMA).
    7. Derek C. Jones & Takao Kato, 2011. "The Impact of Teams on Output, Quality, and Downtime: An Empirical Analysis Using Individual Panel Data," ILR Review, Cornell University, ILR School, vol. 64(2), pages 215-240, January.
    8. James Andreoni & Michael Callen & Karrar Hussain & Muhammad Yasir Khan & Charles Sprenger, 2023. "Using Preference Estimates to Customize Incentives: An Application to Polio Vaccination Drives in Pakistan," Journal of the European Economic Association, European Economic Association, vol. 21(4), pages 1428-1477.
    9. Cardella, Eric & Depew, Briggs, 2016. "Testing for the Ratchet Effect: Evidence from a Real-Effort Work Task," IZA Discussion Papers 9981, Institute of Labor Economics (IZA).
    10. Dhushyanth Raju, 2017. "Public School Teacher Management in Sri Lanka," South Asia Economic Journal, Institute of Policy Studies of Sri Lanka, vol. 18(1), pages 39-63, March.
    11. Ricardo Pagan & Miguel Ángel Malo, 2021. "Performance Appraisal and Job Satisfaction for Workers Without and With Disabilities by Gender," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 153(3), pages 1011-1039, February.
    12. Jirjahn, Uwe & Mohrenweiser, Jens, 2023. "Variable Payment Schemes and Productivity: Do Individual-Based Schemes Really Have a Stronger Influence than Collective Ones?," IZA Discussion Papers 16267, Institute of Labor Economics (IZA).
    13. Karthik Muralidharan & Venkatesh Sundararaman, 2011. "Teacher Performance Pay: Experimental Evidence from India," Journal of Political Economy, University of Chicago Press, vol. 119(1), pages 39-77.
    14. Benno Torgler & Sascha L. Schmidt & Bruno S. Frey, 2006. "Relative Income Position And Performance: An Empirical Panel Analysis," IEW - Working Papers 268, Institute for Empirical Research in Economics - University of Zurich.
    15. Berlinski, Samuel & Ramos, Alejandra, 2020. "Teacher mobility and merit pay: Evidence from a voluntary public award program," Journal of Public Economics, Elsevier, vol. 186(C).
    16. Bernd Irlenbusch, 2006. "Experimental perspectives on incentives in organisations," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 14(1), pages 1-24, February.
    17. Paarsch, Harry J. & Shearer, Bruce S., 2009. "The response to incentives and contractual efficiency: Evidence from a field experiment," European Economic Review, Elsevier, vol. 53(5), pages 481-494, July.
    18. Justina A.V. Fischer & Benno Torgler, 2006. "Does Envy Destroy Social Fundamentals? The Impact of Relative Income Position on Social Capital," University of St. Gallen Department of Economics working paper series 2006 2006-04, Department of Economics, University of St. Gallen.
    19. Bentley Coffey & M. T. Maloney, 2010. "The Thrill of Victory: Measuring the Incentive to Win," Journal of Labor Economics, University of Chicago Press, vol. 28(1), pages 87-112, January.
    20. Benno Torgler & Sascha L. Schmidt & Bruno S. Frey, 2008. "The Power of Positional Concerns," CREMA Working Paper Series 2008-07, Center for Research in Economics, Management and the Arts (CREMA).

    More about this item

    Keywords

    Performance monitoring; Performance evaluation; Baseball; Sports officials;
    All these keywords.

    JEL classification:

    • Z22 - Other Special Topics - - Sports Economics - - - Labor Issues
    • M50 - Business Administration and Business Economics; Marketing; Accounting; Personnel Economics - - Personnel Economics - - - General
    • J42 - Labor and Demographic Economics - - Particular Labor Markets - - - Monopsony; Segmented Labor Markets
    • J59 - Labor and Demographic Economics - - Labor-Management Relations, Trade Unions, and Collective Bargaining - - - Other

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:labeco:v:46:y:2017:i:c:p:189-199. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/labeco .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.