IDEAS home Printed from https://ideas.repec.org/p/osf/socarx/qznpk.html
   My bibliography  Save this paper

Experiments on Crowdsourcing Policy Assessment

Author

Listed:
  • Prpić, John

Abstract

Can Crowds serve as useful allies in policy design? How do non-expert Crowds perform relative to experts in the assessment of policy measures? Does the geographic location of non-expert Crowds, with relevance to the policy context, alter the performance of non-experts Crowds in the assessment of policy measures? In this work, we investigate these questions by undertaking experiments designed to replicate expert policy assessments with non-expert Crowds recruited from Virtual Labor Markets. We use a set of ninety six climate change adaptation policy measures previously evaluated by experts in the Netherlands as our control condition to conduct experiments using two discrete sets of non-expert Crowds recruited from Virtual Labor Markets. We vary the composition of our non-expert Crowds along two conditions: participants recruited from a geographical location directly relevant to the policy context and participants recruited at-large. We discuss our research methods in detail and provide the findings of our experiments. Prpić, J., Taeihagh, A., & Melton, J. (2014). Experiments on Crowdsourcing Policy Assessment. Oxford Internet Institute, University of Oxford - IPP 2014 - Crowdsourcing for Politics and Policy.

Suggested Citation

  • Prpić, John, 2017. "Experiments on Crowdsourcing Policy Assessment," SocArXiv qznpk, Center for Open Science.
    • Handle: RePEc:osf:socarx:qznpk
    DOI: 10.31219/osf.io/qznpk
    as

    Download full text from publisher

    File URL: https://osf.io/download/589d6bab594d9001fcddd15b/
    Download Restriction: no
    File URL: https://libkey.io/10.31219/osf.io/qznpk?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Ben Taieb, Souhaib & Hyndman, Rob J., 2014. "A gradient boosting approach to the Kaggle load forecasting competition," International Journal of Forecasting, Elsevier, vol. 30(2), pages 382-394.
    2. Karim R. Lakhani & Jill A. Panetta, 2007. "The Principles of Distributed Innovation," Innovations: Technology, Governance, Globalization, MIT Press, vol. 2(3), pages 97-112, July.
    3. repec:cup:judgdm:v:5:y:2010:i:5:p:411-419 is not listed on IDEAS
    4. Taeihagh, Araz & Bañares-Alcántara, René & Givoni, Moshe, 2014. "A virtual environment for the formulation of policy packages," Transportation Research Part A: Policy and Practice, Elsevier, vol. 60(C), pages 53-68.
    5. Kietzmann, Jan H. & Hermkens, Kristopher & McCarthy, Ian P. & Silvestre, Bruno S., 2011. "Social media? Get serious! Understanding the functional building blocks of social media," Business Horizons, Elsevier, vol. 54(3), pages 241-251, May.
    6. Triparna de Vreede & Cuong Nguyen & Gert-Jan de Vreede & Imed Boughzala & Onook Oh & Roni Reiter-Palmon, 2013. "A theoretical model of user engagement in crowdsourcing," Grenoble Ecole de Management (Post-Print) hal-01244682, HAL.
    7. Kelly, Charlotte & May, Anthony D. & Jopson, Ann, 2008. "The development of an option generation tool to identify potential transport policy packages," Transport Policy, Elsevier, vol. 15(6), pages 361-371, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Prpić, John & Shukla, Prashant P. & Kietzmann, Jan H. & McCarthy, Ian P., 2015. "How to work a crowd: Developing crowd capital through crowdsourcing," Business Horizons, Elsevier, vol. 58(1), pages 77-85.
    2. Prpić, John, 2017. "A Framework for Policy Crowdsourcing," SocArXiv pmfdx, Center for Open Science.
    3. Prpić, John, 2017. "MOOCs and Crowdsourcing: Massive Courses and Massive Resources," SocArXiv uwess, Center for Open Science.
    4. Prpić, John, 2017. "How To Work A Crowd: Developing Crowd Capital Through Crowdsourcing," SocArXiv jer9k, Center for Open Science.
    5. Araz Taeihagh, 2017. "Network-centric policy design," Policy Sciences, Springer;Society of Policy Sciences, vol. 50(2), pages 317-338, June.
    6. Araz Taeihagh, 2017. "Crowdsourcing: a new tool for policy-making?," Policy Sciences, Springer;Society of Policy Sciences, vol. 50(4), pages 629-647, December.
    7. Moeinaddini, Amin & Habibian, Meeghat, 2024. "Acceptability of transportation demand management policy packages considering interactions and socio-economic heterogeneity," Research in Transportation Economics, Elsevier, vol. 103(C).
    8. Prpić, John, 2017. "The Fundamentals of Policy Crowdsourcing," SocArXiv wdtvh, Center for Open Science.
    9. Täuscher, Karl, 2017. "Leveraging collective intelligence: How to design and manage crowd-based business models," Business Horizons, Elsevier, vol. 60(2), pages 237-245.
    10. Krystyna Mazurek-Lopacinska & Magdalena Sobocinska, 2021. "Social Media in Marketing Activities of Enterprises in the Light of the Analysis of Empirical Research Results," European Research Studies Journal, European Research Studies Journal, vol. 0(4B), pages 647-658.
    11. Sikandar Ali Qalati & Dragana Ostic & Gu Shuibin & Fan Mingyue, 2022. "A mediated–moderated model for social media adoption and small and medium‐sized enterprise performance in emerging countries," Managerial and Decision Economics, John Wiley & Sons, Ltd., vol. 43(3), pages 846-861, April.
    12. Rydén, Pernille & Ringberg, Torsten & Wilke, Ricky, 2015. "How Managers' Shared Mental Models of Business–Customer Interactions Create Different Sensemaking of Social Media," Journal of Interactive Marketing, Elsevier, vol. 31(C), pages 1-16.
    13. Yongjun Tang & Qi Li & Fen Zhou & Mingjia Sun, 2024. "Does Clan Culture Promote Corporate Natural Resource Disclosure? Evidence from Chinese Natural Resource-Based Listed Companies," Journal of Business Ethics, Springer, vol. 192(1), pages 167-190, June.
    14. Vasile-Daniel Păvăloaia & Elena-Mădălina Teodor & Doina Fotache & Magdalena Danileţ, 2019. "Opinion Mining on Social Media Data: Sentiment Analysis of User Preferences," Sustainability, MDPI, vol. 11(16), pages 1-21, August.
    15. Zhang, Chu-Bing & Zhang, Zhuo-Ping & Chang, Ying & Li, Tian-Ge & Hou, Ru-Jing, 2022. "Effect of WeChat interaction on brand evaluation: A moderated mediation model of para-social interaction and affiliative tendency," Journal of Retailing and Consumer Services, Elsevier, vol. 64(C).
    16. Shiwei Shen & Marios Sotiriadis & Qing Zhou, 2020. "Could Smart Tourists Be Sustainable and Responsible as Well? The Contribution of Social Networking Sites to Improving Their Sustainable and Responsible Behavior," Sustainability, MDPI, vol. 12(4), pages 1-21, February.
    17. Perez-Vega, Rodrigo & Hopkinson, Paul & Singhal, Aishwarya & Mariani, Marcello M., 2022. "From CRM to social CRM: A bibliometric review and research agenda for consumer research," Journal of Business Research, Elsevier, vol. 151(C), pages 1-16.
    18. Reilly, Anne H. & Hynan, Katherine A., 2014. "Corporate communication, sustainability, and social media: It's not easy (really) being green," Business Horizons, Elsevier, vol. 57(6), pages 747-758.
    19. TANASE, George Cosmin, 2017. "Managing the Brand and Communication in Social Media," Romanian Distribution Committee Magazine, Romanian Distribution Committee, vol. 8(2), pages 20-22, June.
    20. Sumit Chaturvedi & Sachin Gupta & Devendra Singh Hada, 2016. "Perceived Risk, Trust and Information Seeking Behavior as Antecedents of Online Apparel Buying Behavior in India: An Exploratory Study in Context of Rajasthan," International Review of Management and Marketing, Econjournals, vol. 6(4), pages 935-943.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:osf:socarx:qznpk. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: OSF (email available below). General contact details of provider: https://arabixiv.org .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.