IDEAS home Printed from https://ideas.repec.org/p/ipp/wpaper/1402.html
   My bibliography  Save this paper

Human computing via online labor markets. The perils and promises of crowdsourcing in data-rich ecosystems

Author

Listed:
  • Matthijs den Besten
  • Catalina Martínez
  • Nicolas Besson
  • Stéphane Maraut
  • Jean-Michel Dalle

Abstract

In this article, we focus on the need for "human computing" in data-rich ecosystems, notably as a consequence of data variety and typically for name disambiguation, and explore ways to manage it via online platforms for paid crowdsourcing. Based on several studies of Amazon Mechanical Turk, a well-established platform for matching data treatment tasks to human beings willing to carry them out, we illustrate the difficulties involved as requesters compete for the attention of workers. We suggest that researchers should shift from a technical analysis and tentative resolution of human computing perils and pitfalls, towards a more economic and managerial analysis of human computing platforms understood as online labor markets, notably in their multi-sided nature and with respect to how they manage the attention of online workers.

Suggested Citation

  • Matthijs den Besten & Catalina Martínez & Nicolas Besson & Stéphane Maraut & Jean-Michel Dalle, 2014. "Human computing via online labor markets. The perils and promises of crowdsourcing in data-rich ecosystems," Working Papers 1402, Instituto de Políticas y Bienes Públicos (IPP), CSIC.
    • Handle: RePEc:ipp:wpaper:1402
    as

    Download full text from publisher

    File URL: http://investigacion.cchs.csic.es/RePEc/ipp/wpaper/csic-ipp-wp-2014-02_denbesten.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Rajagopal, 2014. "The Human Factors," Palgrave Macmillan Books, in: Architecting Enterprise, chapter 9, pages 225-249, Palgrave Macmillan.
    2. Francesco Lissoni & Patrick Llerena & Maureen McKelvey & Bulat Sanditov, 2008. "Academic patenting in Europe: new evidence from the KEINS database," Research Evaluation, Oxford University Press, vol. 17(2), pages 87-102, June.
    3. John Horton & David Rand & Richard Zeckhauser, 2011. "The online laboratory: conducting experiments in a real labor market," Experimental Economics, Springer;Economic Science Association, vol. 14(3), pages 399-425, September.
    4. Raffo, Julio & Lhuillery, Stéphane, 2009. "How to play the "Names Game": Patent retrieval comparing different heuristics," Research Policy, Elsevier, vol. 38(10), pages 1617-1627, December.
    5. Matthias Meyer, 2011. "Bibliometrics, Stylized Facts and the Way Ahead: How to Build Good Social Simulation Models of Science?," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 14(4), pages 1-4.
    6. Thomas Gurney & Edwin Horlings & Peter van den Besselaar, 2012. "Author disambiguation using multi-aspect similarity indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 91(2), pages 435-449, May.
    7. Sidonia von Proff & Guido Buenstorf & Martin Hummel, 2012. "University Patenting in Germany before and after 2002: What Role Did the Professors' Privilege Play?," Industry and Innovation, Taylor & Francis Journals, vol. 19(1), pages 23-44, January.
    8. Thursby, Jerry & Fuller, Anne W. & Thursby, Marie, 2009. "US faculty patenting: Inside and outside the university," Research Policy, Elsevier, vol. 38(1), pages 14-25, February.
    9. Daron Acemoglu & Mohamed Mostagir & Asuman Ozdaglar, 2014. "Managing Innovation in a Crowd," NBER Working Papers 19852, National Bureau of Economic Research, Inc.
    10. Francesco Lissoni & Peter Lotz & Jens Schovsbo & Adele Treccani, 2009. "Academic patenting and the professor's privilege: evidence on Denmark from the KEINS database," Science and Public Policy, Oxford University Press, vol. 36(8), pages 595-607, October.
    11. Franzoni, Chiara & Sauermann, Henry, 2014. "Crowd science: The organization of scientific research in open collaborative projects," Research Policy, Elsevier, vol. 43(1), pages 1-20.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Anja Schoen & Dominik Heinisch & Guido Buenstorf, 2014. "Playing the ‘Name Game’ to identify academic patents in Germany," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(1), pages 527-545, October.
    2. Francesco Lissoni & Michele Pezzoni & Bianca Potì & Sandra Romagnosi, 2012. "University autonomy, IP legislation and academic patenting: Italy, 1996-2007," Post-Print hal-00779750, HAL.
    3. Ejermo, Olof & Toivanen, Hannes, 2018. "University invention and the abolishment of the professor's privilege in Finland," Research Policy, Elsevier, vol. 47(4), pages 814-825.
    4. van Burg, Elco & Du, Jingshu & Kers, Jannigje Gerdien, 2021. "When do academics patent outside their university? An in-depth case study," Technovation, Elsevier, vol. 107(C).
    5. Fabiano, Gianluca & Marcellusi, Andrea & Favato, Giampiero, 2021. "R versus D, from knowledge creation to value appropriation: Ownership of patents filed by European biotechnology founders," Technovation, Elsevier, vol. 108(C).
    6. Geuna, Aldo & Rossi, Federica, 2011. "Changes to university IPR regulations in Europe and the impact on academic patenting," Research Policy, Elsevier, vol. 40(8), pages 1068-1076, October.
    7. Brantnell, Anders & Baraldi, Enrico, 2022. "Understanding the roles and involvement of technology transfer offices in the commercialization of university research," Technovation, Elsevier, vol. 115(C).
    8. Czarnitzki, Dirk & Doherr, Thorsten & Hussinger, Katrin & Schliessler, Paula & Toole, Andrew A., 2015. "Individual versus institutional ownership of university-discovered inventions," ZEW Discussion Papers 15-007, ZEW - Leibniz Centre for European Economic Research.
    9. Pluvia Zuniga, 2011. "The State of Patenting at Research Institutions in Developing Countries: Policy Approaches and Practices," WIPO Economic Research Working Papers 04, World Intellectual Property Organization - Economics and Statistics Division, revised Dec 2011.
    10. Charlotta Dahlborg & Danielle Lewensohn & Rickard Danell & Carl Johan Sundberg, 2017. "To invent and let others innovate: a framework of academic patent transfer modes," The Journal of Technology Transfer, Springer, vol. 42(3), pages 538-563, June.
    11. Sterzi, Valerio, 2013. "Patent quality and ownership: An analysis of UK faculty patenting," Research Policy, Elsevier, vol. 42(2), pages 564-576.
    12. repec:wip:wpaper:4 is not listed on IDEAS
    13. Cornelia Lawson, 2013. "Academic Inventions Outside the University: Investigating Patent Ownership in the UK," Industry and Innovation, Taylor & Francis Journals, vol. 20(5), pages 385-398, July.
    14. Paola Giuri & Federico Munari & Martina Pasquini, 2013. "What Determines University Patent Commercialization? Empirical Evidence on the Role of IPR Ownership," Industry and Innovation, Taylor & Francis Journals, vol. 20(5), pages 488-502, July.
    15. Nicolas Carayol & Elodie Carpentier, 2022. "The spread of academic invention: a nationwide case study on French data (1995–2012)," The Journal of Technology Transfer, Springer, vol. 47(5), pages 1395-1421, October.
    16. Patrick S. W. Fong & Xuhua Chang & Qiang Chen, 2018. "Faculty patent assignment in the Chinese mainland: evidence from the top 35 patent application universities," The Journal of Technology Transfer, Springer, vol. 43(1), pages 69-95, February.
    17. Antonio Della Malva & Francesco Lissoni & Patrick Llerena, 2013. "Institutional change and academic patenting: French universities and the Innovation Act of 1999," Journal of Evolutionary Economics, Springer, vol. 23(1), pages 211-239, January.
    18. Gandullia, Luca & Lezzi, Emanuela & Parciasepe, Paolo, 2020. "Replication with MTurk of the experimental design by Gangadharan, Grossman, Jones & Leister (2018): Charitable giving across donor types," Journal of Economic Psychology, Elsevier, vol. 78(C).
    19. Peter T. Gianiodis & Gideon D. Markman & Andreas Panagopoulos, 2016. "Entrepreneurial universities and overt opportunism," Small Business Economics, Springer, vol. 47(3), pages 609-631, October.
    20. Francesco Lissoni, 2013. "Intellectual property and university–industry technology transfer," Chapters, in: Faïz Gallouj & Luis Rubalcaba & Paul Windrum (ed.), Public–Private Innovation Networks in Services, chapter 7, pages 164-194, Edward Elgar Publishing.
    21. Foray, Dominique & Lissoni, Francesco, 2010. "University Research and Public–Private Interaction," Handbook of the Economics of Innovation, in: Bronwyn H. Hall & Nathan Rosenberg (ed.), Handbook of the Economics of Innovation, edition 1, volume 1, chapter 0, pages 275-314, Elsevier.

    More about this item

    Keywords

    Online Labor Markets; Crowd-Sourcing; Big Data; Amazon Mechanical Turk; Human Computing;
    All these keywords.

    JEL classification:

    • C81 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Microeconomic Data; Data Access
    • C90 - Mathematical and Quantitative Methods - - Design of Experiments - - - General
    • O30 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ipp:wpaper:1402. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Adelheid Holl (email available below). General contact details of provider: https://edirc.repec.org/data/ippcses.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.