Web mining of firm websites: A framework for web scraping and a pilot study for Germany
Author
Abstract
Suggested Citation
Download full text from publisher
References listed on IDEAS
- Janz, Norbert & Ebling, Günther & Gottschalk, Sandra & Peters, Bettina & Schmidt, Tobias, 2002. "Innovationsverhalten der deutschen Wirtschaft: Indikatorenbericht zur Innovationserhebung 2001," The Annual German Innovation Survey, Key Figures Reports 111699, ZEW - Leibniz Centre for European Economic Research.
- Manfred M. Fischer & Arthur Getis (ed.), 2010. "Handbook of Applied Spatial Analysis," Springer Books, Springer, number 978-3-642-03647-7, January.
- Sanjay K. Arora & Jan Youtie & Philip Shapira & Lidan Gao & TingTing Ma, 2013. "Entry strategies in an emerging technology: a pilot web-based study of graphene firms," Scientometrics, Springer;Akadémiai Kiadó, vol. 95(3), pages 1189-1207, June.
- Mohammad Arzaghi & J. Vernon Henderson, 2008.
"Networking off Madison Avenue,"
The Review of Economic Studies, Review of Economic Studies Ltd, vol. 75(4), pages 1011-1038.
- J. Vernon Henderson & Mohammad Arzaghi, 2005. "Networking Off Madison Avenue," Working Papers 05-15, Center for Economic Studies, U.S. Census Bureau.
- Bersch, Johannes & Gottschalk, Sandra & Müller, Bettina & Niefert, Michaela, 2014. "The Mannheim Enterprise Panel (MUP) and firm statistics for Germany," ZEW Discussion Papers 14-104, ZEW - Leibniz Centre for European Economic Research.
- Max Nathan & Anna Rosso, 2017.
"Innovative events,"
Development Working Papers
429, Centro Studi Luca d'Agliano, University of Milano, revised 08 Apr 2019.
- Nathan, Max & Rosso, Anna, 2019. "Innovative Events," IZA Discussion Papers 12213, Institute of Labor Economics (IZA).
- Max Nathan & Anna Rosso, 2019. "Innovative events," CEP Discussion Papers dp1607, Centre for Economic Performance, LSE.
- Nathan, Max & Rosso, Anna, 2019. "Innovative events," LSE Research Online Documents on Economics 102626, London School of Economics and Political Science, LSE Library.
- Nathan, Max & Rosso, Anna, 2019. "Innovative Events," SocArXiv t3jrq, Center for Open Science.
- Rammer, Christian & Kinne, Jan & Blind, Knut, 2016. "Microgeography of innovation in the city: Location patterns of innovative firms in Berlin," ZEW Discussion Papers 16-080, ZEW - Leibniz Centre for European Economic Research.
- Zoltan J. Acs & Luc Anselin & Attila Varga, 2008.
"Patents and Innovation Counts as Measures of Regional Production of New Knowledge,"
Chapters, in: Entrepreneurship, Growth and Public Policy, chapter 11, pages 135-151,
Edward Elgar Publishing.
- Acs, Zoltan J. & Anselin, Luc & Varga, Attila, 2002. "Patents and innovation counts as measures of regional production of new knowledge," Research Policy, Elsevier, vol. 31(7), pages 1069-1085, September.
- Rammer, Christian & Berger, Marius & Doherr, Thorsten & Hud, Martin & Hünermund, Paul & Iferd, Younes & Peters, Bettina & Schubert, Torben, 2017. "Innovationsverhalten der deutschen Wirtschaft: Indikatorenbericht zur Innovationserhebung 2016," The Annual German Innovation Survey, Key Figures Reports 155758, ZEW - Leibniz Centre for European Economic Research.
- Gilles Duranton & J. V. Henderson & William C. Strange (ed.), 2015. "Handbook of Regional and Urban Economics," Handbook of Regional and Urban Economics, Elsevier, edition 1, volume 5, number 5.
- Rammer, Christian & Crass, Dirk & Doherr, Thorsten & Hud, Martin & Hünermund, Paul & Iferd, Younes & Köhler, Christian & Peters, Bettina & Schubert, Torben, 2016. "Innovationsverhalten der deutschen Wirtschaft: Indikatorenbericht zur Innovationserhebung 2015," The Annual German Innovation Survey, Key Figures Reports 128149, ZEW - Leibniz Centre for European Economic Research.
Citations
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
Cited by:
- Proeger, Till & Meub, Lukas & Pölert, Hauke, 2021. "Analyse des Digitalisierungsgrads von Bildungseinrichtungen auf Basis von Webscraping - eine methodische Vorstudie," Göttinger Beiträge zur Handwerksforschung 56, Volkswirtschaftliches Institut für Mittelstand und Handwerk an der Universität Göttingen (ifh).
- Proeger, Till & Meub, Lukas, 2022. "Innovative Betriebe und Innovationsmuster im Hamburger Handwerk," ifh Forschungsberichte 7, Volkswirtschaftliches Institut für Mittelstand und Handwerk an der Universität Göttingen (ifh).
- Janna Axenbeck & Patrick Breithaupt, 2021. "Innovation indicators based on firm websites—Which website characteristics predict firm-level innovation activity?," PLOS ONE, Public Library of Science, vol. 16(4), pages 1-23, April.
- Jan Kinne & David Lenz, 2021. "Predicting innovative firms using web mining and deep learning," PLOS ONE, Public Library of Science, vol. 16(4), pages 1-18, April.
- Axenbeck, Janna & Breithaupt, Patrick, 2019. "Web-based innovation indicators: Which firm website characteristics relate to firm-level innovation activity?," ZEW Discussion Papers 19-063, ZEW - Leibniz Centre for European Economic Research.
- Böhmecke-Schwafert, Moritz & García Moreno, Eduardo, 2023. "Exploring blockchain-based innovations for economic and sustainable development in the global south: A mixed-method approach based on web mining and topic modeling," Technological Forecasting and Social Change, Elsevier, vol. 191(C).
- Abbasiharofteh, Milad & Kinne, Jan & Krüger, Miriam, 2021. "The strength of weak and strong ties in bridging geographic and cognitive distances," ZEW Discussion Papers 21-049, ZEW - Leibniz Centre for European Economic Research.
- Rammer, Christian & Es-Sadki, Nordine, 2023.
"Using big data for generating firm-level innovation indicators - a literature review,"
Technological Forecasting and Social Change, Elsevier, vol. 197(C).
- Rammer, Christian & Es-Sadki, Nordine, 2022. "Using big data for generating firm-level innovation indicators: A literature review," ZEW Discussion Papers 22-007, ZEW - Leibniz Centre for European Economic Research.
- Kinne, Jan & Krüger, Miriam & Lenz, David & Licht, Georg & Winker, Peter, 2020. "Coronavirus pandemic affects companies differently: A high-frequency website analysis of companies' reactions to the coronavirus pandemic in Germany," ZEW Expert Briefs 20-05e, ZEW - Leibniz Centre for European Economic Research.
- German Data Forum RatSWD (ed.), 2020. "Big data in social, behavioural, and economic sciences: Data access and research data management," RatSWD Output Series, German Data Forum (RatSWD), volume 6, number 6-4en.
- Meub, Lukas & Proeger, Till & Bizer, Kilian, 2022. "Vernetzung von Unternehmen und Forschungseinrichtungen in regionalen Innovationssystemen durch Webscraping," Göttinger Beiträge zur Handwerksforschung 62, Volkswirtschaftliches Institut für Mittelstand und Handwerk an der Universität Göttingen (ifh).
- Proeger, Till & Meub, Lukas & Bizer, Kilian, 2021. "Webscraping als Instrument zur tagesaktuellen und umfassenden digitalen Analyse des Handwerks," Göttinger Beiträge zur Handwerksforschung 55, Volkswirtschaftliches Institut für Mittelstand und Handwerk an der Universität Göttingen (ifh).
- Meub, Lukas & Proeger, Till & Fuhrich, Svenja & Ullrich, Matthias & Bizer, Kilian, 2023. "Zukunftsfelder für Smart City: Eine Webscraping-Analyse von Betrieben und Organisationen der Landkreise Hildesheim, Peine und der Region Hannover," ifh Forschungsberichte 15, Volkswirtschaftliches Institut für Mittelstand und Handwerk an der Universität Göttingen (ifh).
Most related items
These are the items that most often cite the same works as this one and are cited by the same works as this one.- Jan Kinne & Janna Axenbeck, 2020. "Web mining for innovation ecosystem mapping: a framework and a large-scale pilot study," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2011-2041, December.
- Axenbeck, Janna & Breithaupt, Patrick, 2019. "Web-based innovation indicators: Which firm website characteristics relate to firm-level innovation activity?," ZEW Discussion Papers 19-063, ZEW - Leibniz Centre for European Economic Research.
- Janna Axenbeck & Patrick Breithaupt, 2021. "Innovation indicators based on firm websites—Which website characteristics predict firm-level innovation activity?," PLOS ONE, Public Library of Science, vol. 16(4), pages 1-23, April.
- Tobias Schlegel & Curdin Pfister & Dietmar Harhoff & Uschi Backes-Gellner, 2022.
"Innovation effects of universities of applied sciences: an assessment of regional heterogeneity,"
The Journal of Technology Transfer, Springer, vol. 47(1), pages 63-118, February.
- Tobias Schlegel & Curdin Pfister & Dietmar Harhoff & Uschi Backes-Gellner, 2019. "Innovation Effects of Universities of Applied Sciences: an Assessment of Regional Heterogeneity," Economics of Education Working Paper Series 0161, University of Zurich, Department of Business Administration (IBW), revised Mar 2021.
- Jonathan I. Dingel & Felix Tintelnot, 2020.
"Spatial Economics for Granular Settings,"
NBER Working Papers
27287, National Bureau of Economic Research, Inc.
- Dingel, Jonathan & Tintelnot, Felix, 2020. "Spatial Economics for Granular Settings," CEPR Discussion Papers 14819, C.E.P.R. Discussion Papers.
- Jonathan I. Dingel & Felix Tintelnot, 2020. "Spatial Economics for Granular Settings," Working Papers 2020-71, Becker Friedman Institute for Research In Economics.
- Karen Miranda & Oscar Martínez Ibáñez & Miguel Manjón Antolín, 2015.
"Estimating Individual Effects and their Spatial Spillovers in Linear Panel Data Models,"
Post-Print
hal-01430809, HAL.
- Miranda, Karen & Martínez Ibáñez, Oscar & Manjón Antolín, Miquel Carlos,, 2015. "Estimating individual effects and their spatial spillovers in linear panel data models," Working Papers 2072/261028, Universitat Rovira i Virgili, Department of Economics.
- Thisse, Jacques-François & Proost, Stef, 2015. "Skilled Cities, Regional Disparities, and Efficient Transport: The state of the art and a research agenda," CEPR Discussion Papers 10790, C.E.P.R. Discussion Papers.
- Carlino, Gerald & Kerr, William R., 2015.
"Agglomeration and Innovation,"
Handbook of Regional and Urban Economics, in: Gilles Duranton & J. V. Henderson & William C. Strange (ed.), Handbook of Regional and Urban Economics, edition 1, volume 5, chapter 0, pages 349-404,
Elsevier.
- Gerald A. Carlino & William R. Kerr, 2014. "Agglomeration and innovation," Working Papers 14-26, Federal Reserve Bank of Philadelphia.
- Carlino, Gerald & Kerr, William R., 2015. "Agglomeration and innovation," Bank of Finland Research Discussion Papers 27/2015, Bank of Finland.
- Gerald Carlino & William R. Kerr, 2014. "Agglomeration and Innovation," NBER Working Papers 20367, National Bureau of Economic Research, Inc.
- Gerald Carlino & William R. Kerr, 2014. "Agglomeration and Innovation," Harvard Business School Working Papers 15-007, Harvard Business School.
- Behrens, Kristian & Kichko, Sergei & Thisse, Jacques-Francois, 2024.
"Working from home: Too much of a good thing?,"
Regional Science and Urban Economics, Elsevier, vol. 105(C).
- Kristian Behrens & Sergey Kichko & Jacques-Francois Thisse & Sergei Kichko, 2021. "Working from Home: Too Much of a Good Thing?," CESifo Working Paper Series 8831, CESifo.
- Thisse, Jacques-François & Behrens, Kristian & Kichko, Sergey, 2021. "Working from home: Too much of a good thing?," CEPR Discussion Papers 15669, C.E.P.R. Discussion Papers.
- Stephen J. Redding, 2020.
"Trade and Geography,"
NBER Working Papers
27821, National Bureau of Economic Research, Inc.
- Stephen J. Redding, 2020. "Trade and geography," CEP Discussion Papers dp1718, Centre for Economic Performance, LSE.
- Redding, Stephen, 2020. "Trade and geography," LSE Research Online Documents on Economics 108235, London School of Economics and Political Science, LSE Library.
- Stephen J Redding, 2020. "Trade and Geography," Working Papers 266, Princeton University, Department of Economics, Center for Economic Policy Studies..
- Redding, Stephen, 2020. "Trade and Geography," CEPR Discussion Papers 15268, C.E.P.R. Discussion Papers.
- Adelheid Holl & Bettina Peters & Christian Rammer, 2023.
"Local knowledge spillovers and innovation persistence of firms,"
Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 32(6), pages 826-850, August.
- Holl, Adelheid & Peters, Bettina & Rammer, Christian, 2020. "Local knowledge spillovers and innovation persistence of firms," ZEW Discussion Papers 20-005, ZEW - Leibniz Centre for European Economic Research.
- Hamidi, Shima & Zandiatashbar, Ahoura & Bonakdar, Ahmad, 2019. "The relationship between regional compactness and regional innovation capacity (RIC): Empirical evidence from a national study," Technological Forecasting and Social Change, Elsevier, vol. 142(C), pages 394-402.
- Faggio, G. & Schluter, T. & vom Berge, P., 2019. "Interaction of Public and Private Employment: Evidence from a German Government Move," Working Papers 19/09, Department of Economics, City University London.
- Combes, Pierre-Philippe & Gobillon, Laurent, 2015.
"The Empirics of Agglomeration Economies,"
Handbook of Regional and Urban Economics, in: Gilles Duranton & J. V. Henderson & William C. Strange (ed.), Handbook of Regional and Urban Economics, edition 1, volume 5, chapter 0, pages 247-348,
Elsevier.
- Pierre-Philippe Combes & Laurent Gobillon, 2014. "The Empirics of Agglomeration Economies," PSE Working Papers halshs-01071761, HAL.
- Pierre-Philippe Combes & Laurent Gobillon, 2014. "The empirics of agglomeration economies," Working Papers hal-03460237, HAL.
- Pierre-Philippe Combes & Laurent Gobillon, 2015. "The Empirics of Agglomeration Economies," SciencePo Working papers Main hal-01457401, HAL.
- Pierre-Philippe Combes & Laurent Gobillon, 2014. "The Empirics of Agglomeration Economies," Working Papers halshs-01071761, HAL.
- Combes, Pierre-Philippe & Gobillon, Laurent, 2014. "The Empirics of Agglomeration Economies," IZA Discussion Papers 8508, Institute of Labor Economics (IZA).
- Combes, Pierre-Philippe & Gobillon, Laurent, 2014. "The empirics of agglomeration economies," CEPR Discussion Papers 10174, C.E.P.R. Discussion Papers.
- Pierre-Philippe Combes & Laurent Gobillon, 2015. "The Empirics of Agglomeration Economies," PSE-Ecole d'économie de Paris (Postprint) hal-01457401, HAL.
- Pierre-Philippe Combes & Laurent Gobillon, 2015. "The Empirics of Agglomeration Economies," Post-Print hal-01457401, HAL.
- Pierre-Philippe Combes & Laurent Gobillon, 2014. "The empirics of agglomeration economies," SciencePo Working papers Main hal-03460237, HAL.
- Bosquet, Clément & Combes, Pierre-Philippe, 2017.
"Sorting and agglomeration economies in French economics departments,"
Journal of Urban Economics, Elsevier, vol. 101(C), pages 27-44.
- Bosquet, Clément & Combes, Pierre-Philippe, 2013. "Do large departments make academics more productive? agglomeration and peer effects in research," LSE Research Online Documents on Economics 58306, London School of Economics and Political Science, LSE Library.
- Clément Bosquet & Pierre-Philippe Combes, 2013. "Do Large Departments Make Academics More Productive? Agglomeration and Peer Effects in Research," SERC Discussion Papers 0133, Centre for Economic Performance, LSE.
- Clément Bosquet & Pierre-Philippe Combes, 2013. "Do Large Departments Make Academics More Productive? Agglomeration and Peer Effects in Research," Working Papers halshs-00812490, HAL.
- Clément Bosquet & Pierre-Philippe Combes, 2015. "Do large departments make academics more productive? Sorting and agglomeration economies in research," THEMA Working Papers 2015-16, THEMA (THéorie Economique, Modélisation et Applications), Université de Cergy-Pontoise.
- Combes, Pierre-Philippe & Bosquet, Clément, 2013. "Do large departments make academics more productive? Agglomeration and peer effects in research," CEPR Discussion Papers 9401, C.E.P.R. Discussion Papers.
- Clément Bosquet & Pierre-Philippe Combes, 2013. "Do Large Departments Make Academics More Productive? Agglomeration and Peer Effects in Research," AMSE Working Papers 1326, Aix-Marseille School of Economics, France, revised 10 Apr 2013.
- Clément Bosquet & Pierre-Philippe Combes, 2013. "Do large departments make academics more productive? Agglomeration and peer effects in research," Working Papers hal-03460912, HAL.
- Eva Coll-Martínez, 2019.
"Creativity and the city: testing the attenuation of agglomeration economies in Barcelona,"
Journal of Cultural Economics, Springer;The Association for Cultural Economics International, vol. 43(3), pages 365-395, September.
- E. Coll-Martínez, 2019. "Creativity and the city testing the attenuation of agglomeration economies in Barcelona," Post-Print hal-02864922, HAL.
- Riccardo Crescenzi & Alexander Jaax, 2017.
"Innovation in Russia: The Territorial Dimension,"
Economic Geography, Taylor & Francis Journals, vol. 93(1), pages 66-88, January.
- Riccardo Crescenzi & Alexander Jaax, 2015. "Innovation in Russia: the territorial dimension," Papers in Evolutionary Economic Geography (PEEG) 1509, Utrecht University, Department of Human Geography and Spatial Planning, Group Economic Geography, revised Apr 2015.
- Crescenzi, Riccardo & Jaax, Alexander, 2017. "Innovation in Russia: the territorial dimension," LSE Research Online Documents on Economics 66948, London School of Economics and Political Science, LSE Library.
- Stephen J. Redding & Esteban Rossi-Hansberg, 2017.
"Quantitative Spatial Economics,"
Annual Review of Economics, Annual Reviews, vol. 9(1), pages 21-58, September.
- Stephen J. Redding & Esteban Rossi-Hansberg, 2016. "Quantitative spatial economics," CEP Discussion Papers dp1452, Centre for Economic Performance, LSE.
- Stephen Redding & Esteban Hansberg, 2016. "Quantitative Spatial Economics," Working Papers id:11340, eSocialSciences.
- Stephen J. Redding & Esteban Rossi-Hansberg, 2016. "Quantitative Spatial Economics," NBER Working Papers 22655, National Bureau of Economic Research, Inc.
- Redding, Stephen J. & Rossi-Hansberg, Esteban, 2016. "Quantitative spatial economics," LSE Research Online Documents on Economics 69020, London School of Economics and Political Science, LSE Library.
- Redding, Stephen & Rossi-Hansberg, Esteban, 2016. "Quantitative Spatial Economics," CEPR Discussion Papers 11500, C.E.P.R. Discussion Papers.
- Michaela Wrede & Tobias Dauth, 2020. "A temporal perspective on the relationship between top management team internationalization and firms' innovativeness," Managerial and Decision Economics, John Wiley & Sons, Ltd., vol. 41(4), pages 542-561, June.
- Chen, Ying & Henderson, J. Vernon & Cai, Wei, 2017. "Political favoritism in China’s capital markets and its effect on city sizes," Journal of Urban Economics, Elsevier, vol. 98(C), pages 69-87.
More about this item
Keywords
Web Mining; Web Scraping; R&D; R&I; STI; Innovation; Indicators; Text Mining;All these keywords.
JEL classification:
- O30 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - General
- C81 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Microeconomic Data; Data Access
- C88 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Other Computer Software
NEP fields
This paper has been announced in the following NEP Reports:- NEP-BIG-2018-09-03 (Big Data)
- NEP-CMP-2018-09-03 (Computational Economics)
- NEP-ICT-2018-09-03 (Information and Communication Technologies)
Statistics
Access and download statisticsCorrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:zewdip:18033. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/zemande.html .
Please note that corrections may take a couple of weeks to filter through the various RePEc services.