IDEAS home Printed from https://ideas.repec.org/p/gre/wpaper/2024-16.html

Some searches may not work properly. We apologize for the inconvenience.

   My bibliography  Save this paper

The Evaluation of Creativity

Author

Listed:
  • Michela Chessa

    (Université Côte d'Azur, France
    GREDEG CNRS)

  • Benjamin Prissé

    (Singapore University of Technology and Design, Singapour)

Abstract

Creativity is the basis of any innovation. However, there is a long and well documented academic dispute about how to best assess creativity. The Consensual Assessment Technique (CAT) is the most widely used instrument for this task. The CAT is based on a consensual definition of creativity: a product is creative to the extent that expert raters independently agree upon this judgment. It operates on the principle that no external factors should impact the assessment. In this paper, we ask whether this holds true, and we scrutinize the CAT by experimentally investigating potential discrepancies in evaluations of drawings due to three external factors: order effects, social norms, and communication. Our results confirm the robustness of the CAT in serving as a valuable method for assessing creativity at the aggregate level. However, we also identify certain weaknesses at the individual level, particularly regarding the evaluation of drawings in first positions and when subjects are allowed to communicate.

Suggested Citation

  • Michela Chessa & Benjamin Prissé, 2024. "The Evaluation of Creativity," GREDEG Working Papers 2024-16, Groupe de REcherche en Droit, Economie, Gestion (GREDEG CNRS), Université Côte d'Azur, France.
    • Handle: RePEc:gre:wpaper:2024-16
    as

    Download full text from publisher

    File URL: http://195.220.190.85/GREDEG-WP-2024-16.pdf
    File Function: First version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Armin Falk & James J. Heckman, 2009. "Lab Experiments are a Major Source of Knowledge in the Social Sciences," Working Papers 200935, Geary Institute, University College Dublin.
    2. Giuseppe Attanasi & Michela Chessa & Sara Gil-Gallen & Patrick Llerena, 2021. "A survey on experimental elicitation of creativity in economics," Revue d'économie industrielle, De Boeck Université, vol. 0(2), pages 273-324.
    3. Gary Charness & Daniela Grieco, 2023. "Creativity and Corporate Culture," The Economic Journal, Royal Economic Society, vol. 133(653), pages 1846-1870.
    4. Emanuela Marrocu & Raffaele Paci, 2012. "Education or Creativity: What Matters Most for Economic Performance?," Economic Geography, Taylor & Francis Journals, vol. 88(4), pages 369-401, October.
    5. Edmund Phelps, 2015. "Mass Flourishing: How Grassroots Innovation Created Jobs, Challenge, and Change," Economics Books, Princeton University Press, edition 1, number 10058-2.
    6. Dan Ariely & Uri Gneezy & George Loewenstein & Nina Mazar, 2009. "Large Stakes and Big Mistakes," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 76(2), pages 451-469.
    7. Glenn Dutcher & Cortney S. Rodet, 2022. "Which two heads are better than one? Uncovering the positive effects of diversity in creative teams," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 31(4), pages 884-897, November.
    8. Gary Charness & Daniela Grieco, 2019. "Creativity and Incentives," Journal of the European Economic Association, European Economic Association, vol. 17(2), pages 454-496.
    9. Rodet, Cortney S., 2022. "Does cognitive load affect creativity? An experiment using a divergent thinking task," Economics Letters, Elsevier, vol. 220(C).
    10. Sanjiv Erat & Uri Gneezy, 2016. "Incentives for creativity," Experimental Economics, Springer;Economic Science Association, vol. 19(2), pages 269-280, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Giuseppe Attanasi & Michela Chessa & Sara Gil-Gallen & Patrick Llerena, 2021. "A survey on experimental elicitation of creativity in economics," Revue d'économie industrielle, De Boeck Université, vol. 0(2), pages 273-324.
    2. Cortney S. Rodet, 2021. "The wellspring of creativity? Using divergent‐thinking tasks to understand creative characteristics," Managerial and Decision Economics, John Wiley & Sons, Ltd., vol. 42(6), pages 1435-1453, September.
    3. Benslimane, Ismaël & Crosetto, Paolo & Magni-Berton, Raul & Varaine, Simon, 2023. "Intellectual property reform in the laboratory," Journal of Economic Behavior & Organization, Elsevier, vol. 206(C), pages 204-221.
    4. Giuseppe Attanasi & Michela Chessa & Carlo Ciucani & Sara Gil Gallen, 2020. "Children's GrI-Creativity: Effects of Limited Resources in Creative Drawing," GREDEG Working Papers 2020-34, Groupe de REcherche en Droit, Economie, Gestion (GREDEG CNRS), Université Côte d'Azur, France.
    5. Charness, Gary & Gneezy, Uri & Henderson, Austin, 2018. "Experimental methods: Measuring effort in economics experiments," Journal of Economic Behavior & Organization, Elsevier, vol. 149(C), pages 74-87.
    6. Anne-Gaëlle Maltese & Sara Gil-Gallen & Patrick Llerena, 2023. "Disentangling the role of surface and deep-level variables on individuals’ and groups’ creative performance: A cross-level experimental evidence," Working Papers of BETA 2023-19, Bureau d'Economie Théorique et Appliquée, UDS, Strasbourg.
    7. Giuseppe Attanasi & Massimo Egidi & Elena Manzoni, 2023. "Target-the-Two: a lab-in-the-field experiment on routinization," Journal of Evolutionary Economics, Springer, vol. 33(1), pages 1-33, January.
    8. Glenn Dutcher & Cortney S. Rodet, 2022. "Which two heads are better than one? Uncovering the positive effects of diversity in creative teams," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 31(4), pages 884-897, November.
    9. Giuseppe Attanasi & Ylenia Curci & Patrick Llerena & Adriana Carolina Pinate & Maria del Pino Ramos-Sosa & Giulia Urso, 2019. "Looking at Creativity from East to West: Risk Taking and Intrinsic Motivation in Socially and Culturally Diverse Countries," GREDEG Working Papers 2019-21, Groupe de REcherche en Droit, Economie, Gestion (GREDEG CNRS), Université Côte d'Azur, France.
    10. Katharina Laske & Marina Schroeder, 2016. "Quantity, Quality, and Originality: The Effects of Incentives on Creativity," Cologne Graduate School Working Paper Series 07-01, Cologne Graduate School in Management, Economics and Social Sciences.
    11. Gill, David & Prowse, Victoria L., 2021. "The Creativity Premium," IZA Discussion Papers 14421, Institute of Labor Economics (IZA).
    12. Englmaier, Florian & Grimm, Stefan & Schindler, David & Schudy, Simeon, 2018. "The Effect of Incentives in Non-Routine Analytical Team Tasks - Evidence From a Field Experiment," Rationality and Competition Discussion Paper Series 71, CRC TRR 190 Rationality and Competition.
    13. Dohmen, Thomas, 2014. "Behavioral labor economics: Advances and future directions," Labour Economics, Elsevier, vol. 30(C), pages 71-85.
    14. Samuel Bowles & Sandra Polania-Reyes, 2011. "Economic incentives and social preferences: substitutes or complements?," Department of Economics University of Siena 617, Department of Economics, University of Siena.
    15. Buchanan, J., 2022. "Willingness to be paid: Who trains for tech jobs?," Labour Economics, Elsevier, vol. 79(C).
    16. Joaquin Artes & Jennifer Graves & Meryl Motika, 2019. "Creativity under Pressure: Performance Payments, Task Type and Productivity," Working Papers 20190028, New York University Abu Dhabi, Department of Social Science, revised Oct 2019.
    17. Jared Rubin & Anya Samek & Roman M. Sheremeta, 2018. "Loss aversion and the quantity–quality tradeoff," Experimental Economics, Springer;Economic Science Association, vol. 21(2), pages 292-315, June.
    18. van Lent, Max, 2024. "Peer Creativity and Academic Achievement," IZA Discussion Papers 16847, Institute of Labor Economics (IZA).
    19. Sara Gil-Gallen and Anne-Gaëlle Maltese, 2023. "How can technologies help disclose new insights into collective behaviors?," Journal of Behavioral Economics for Policy, Society for the Advancement of Behavioral Economics (SABE), vol. 7(2), pages 21-32, December.
    20. Florian Englmaier & Stefan Grimm & Dominik Grothe & David Schindler & Simeon Schudy, 2018. "The Effect of Incentives in Non-Routine Analytical Team Tasks," CESifo Working Paper Series 6903, CESifo.

    More about this item

    Keywords

    Creativity; Innovation; Consensual Assessment Technique; Experiments;
    All these keywords.

    JEL classification:

    • C91 - Mathematical and Quantitative Methods - - Design of Experiments - - - Laboratory, Individual Behavior
    • I25 - Health, Education, and Welfare - - Education - - - Education and Economic Development
    • O31 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Innovation and Invention: Processes and Incentives

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gre:wpaper:2024-16. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Patrice Bougette (email available below). General contact details of provider: https://edirc.repec.org/data/credcfr.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.