IDEAS home Printed from https://ideas.repec.org/p/osf/socarx/qznpk.html
   My bibliography  Save this paper

Experiments on Crowdsourcing Policy Assessment

Author

Listed:
  • Prpić, John

Abstract

Can Crowds serve as useful allies in policy design? How do non-expert Crowds perform relative to experts in the assessment of policy measures? Does the geographic location of non-expert Crowds, with relevance to the policy context, alter the performance of non-experts Crowds in the assessment of policy measures? In this work, we investigate these questions by undertaking experiments designed to replicate expert policy assessments with non-expert Crowds recruited from Virtual Labor Markets. We use a set of ninety six climate change adaptation policy measures previously evaluated by experts in the Netherlands as our control condition to conduct experiments using two discrete sets of non-expert Crowds recruited from Virtual Labor Markets. We vary the composition of our non-expert Crowds along two conditions: participants recruited from a geographical location directly relevant to the policy context and participants recruited at-large. We discuss our research methods in detail and provide the findings of our experiments. Prpić, J., Taeihagh, A., & Melton, J. (2014). Experiments on Crowdsourcing Policy Assessment. Oxford Internet Institute, University of Oxford - IPP 2014 - Crowdsourcing for Politics and Policy.

Suggested Citation

  • Prpić, John, 2017. "Experiments on Crowdsourcing Policy Assessment," SocArXiv qznpk, Center for Open Science.
    • Handle: RePEc:osf:socarx:qznpk
    DOI: 10.31219/osf.io/qznpk
    as

    Download full text from publisher

    File URL: https://osf.io/download/589d6bab594d9001fcddd15b/
    Download Restriction: no
    File URL: https://libkey.io/10.31219/osf.io/qznpk?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Ben Taieb, Souhaib & Hyndman, Rob J., 2014. "A gradient boosting approach to the Kaggle load forecasting competition," International Journal of Forecasting, Elsevier, vol. 30(2), pages 382-394.
    2. Karim R. Lakhani & Jill A. Panetta, 2007. "The Principles of Distributed Innovation," Innovations: Technology, Governance, Globalization, MIT Press, vol. 2(3), pages 97-112, July.
    3. repec:cup:judgdm:v:5:y:2010:i:5:p:411-419 is not listed on IDEAS
    4. Triparna de Vreede & Cuong Nguyen & Gert-Jan de Vreede & Imed Boughzala & Onook Oh & Roni Reiter-Palmon, 2013. "A theoretical model of user engagement in crowdsourcing," Grenoble Ecole de Management (Post-Print) hal-01244682, HAL.
    5. Kelly, Charlotte & May, Anthony D. & Jopson, Ann, 2008. "The development of an option generation tool to identify potential transport policy packages," Transport Policy, Elsevier, vol. 15(6), pages 361-371, November.
    6. Taeihagh, Araz & Bañares-Alcántara, René & Givoni, Moshe, 2014. "A virtual environment for the formulation of policy packages," Transportation Research Part A: Policy and Practice, Elsevier, vol. 60(C), pages 53-68.
    7. Kietzmann, Jan H. & Hermkens, Kristopher & McCarthy, Ian P. & Silvestre, Bruno S., 2011. "Social media? Get serious! Understanding the functional building blocks of social media," Business Horizons, Elsevier, vol. 54(3), pages 241-251, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Prpić, John & Shukla, Prashant P. & Kietzmann, Jan H. & McCarthy, Ian P., 2015. "How to work a crowd: Developing crowd capital through crowdsourcing," Business Horizons, Elsevier, vol. 58(1), pages 77-85.
    2. Prpić, John, 2017. "A Framework for Policy Crowdsourcing," SocArXiv pmfdx, Center for Open Science.
    3. Prpić, John, 2017. "MOOCs and Crowdsourcing: Massive Courses and Massive Resources," SocArXiv uwess, Center for Open Science.
    4. Prpić, John, 2017. "How To Work A Crowd: Developing Crowd Capital Through Crowdsourcing," SocArXiv jer9k, Center for Open Science.
    5. Prpić, John, 2017. "The Fundamentals of Policy Crowdsourcing," SocArXiv wdtvh, Center for Open Science.
    6. Araz Taeihagh, 2017. "Network-centric policy design," Policy Sciences, Springer;Society of Policy Sciences, vol. 50(2), pages 317-338, June.
    7. Täuscher, Karl, 2017. "Leveraging collective intelligence: How to design and manage crowd-based business models," Business Horizons, Elsevier, vol. 60(2), pages 237-245.
    8. Araz Taeihagh, 2017. "Crowdsourcing: a new tool for policy-making?," Policy Sciences, Springer;Society of Policy Sciences, vol. 50(4), pages 629-647, December.
    9. Moeinaddini, Amin & Habibian, Meeghat, 2024. "Acceptability of transportation demand management policy packages considering interactions and socio-economic heterogeneity," Research in Transportation Economics, Elsevier, vol. 103(C).
    10. Smith, Andrew N. & Fischer, Eileen & Yongjian, Chen, 2012. "How Does Brand-related User-generated Content Differ across YouTube, Facebook, and Twitter?," Journal of Interactive Marketing, Elsevier, vol. 26(2), pages 102-113.
    11. Fan, Cheng & Sun, Yongjun & Zhao, Yang & Song, Mengjie & Wang, Jiayuan, 2019. "Deep learning-based feature engineering methods for improved building energy prediction," Applied Energy, Elsevier, vol. 240(C), pages 35-45.
    12. Krystyna Mazurek-Lopacinska & Magdalena Sobocinska, 2021. "Social Media in Marketing Activities of Enterprises in the Light of the Analysis of Empirical Research Results," European Research Studies Journal, European Research Studies Journal, vol. 0(4B), pages 647-658.
    13. Monica Patrut, 2015. "Candidates In The Presidential Elections In Romania (2014): The Use Of Social Media In Political Marketing," Studies and Scientific Researches. Economics Edition, "Vasile Alecsandri" University of Bacau, Faculty of Economic Sciences, issue 21.
    14. Marcel Rosenberger & Christiane Lehrer & Reinhard Jung, 0. "Integrating data from user activities of social networks into public administrations," Information Systems Frontiers, Springer, vol. 0, pages 1-14.
    15. Sikandar Ali Qalati & Dragana Ostic & Gu Shuibin & Fan Mingyue, 2022. "A mediated–moderated model for social media adoption and small and medium‐sized enterprise performance in emerging countries," Managerial and Decision Economics, John Wiley & Sons, Ltd., vol. 43(3), pages 846-861, April.
    16. Fracarolli Nunes, Mauro & Lee Park, Camila & Shin, Hyunju, 2021. "Corporate social and environmental irresponsibilities in supply chains, contamination, and damage of intangible resources: A behavioural approach," International Journal of Production Economics, Elsevier, vol. 241(C).
    17. Rydén, Pernille & Ringberg, Torsten & Wilke, Ricky, 2015. "How Managers' Shared Mental Models of Business–Customer Interactions Create Different Sensemaking of Social Media," Journal of Interactive Marketing, Elsevier, vol. 31(C), pages 1-16.
    18. Yongjun Tang & Qi Li & Fen Zhou & Mingjia Sun, 2024. "Does Clan Culture Promote Corporate Natural Resource Disclosure? Evidence from Chinese Natural Resource-Based Listed Companies," Journal of Business Ethics, Springer, vol. 192(1), pages 167-190, June.
    19. Vasile-Daniel Păvăloaia & Elena-Mădălina Teodor & Doina Fotache & Magdalena Danileţ, 2019. "Opinion Mining on Social Media Data: Sentiment Analysis of User Preferences," Sustainability, MDPI, vol. 11(16), pages 1-21, August.
    20. Zhang, Ning & Li, Zhiying & Zou, Xun & Quiring, Steven M., 2019. "Comparison of three short-term load forecast models in Southern California," Energy, Elsevier, vol. 189(C).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:osf:socarx:qznpk. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: OSF (email available below). General contact details of provider: https://arabixiv.org .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.