IDEAS home Printed from https://ideas.repec.org/a/inm/orisre/v35y2024i2p686-705.html
   My bibliography  Save this article

Transporting Causal Effects Across Populations Using Structural Causal Modeling: An Illustration to Work-from-Home Productivity

Author

Listed:
  • Sujin Park

    (College of Business Administration, University of Illinois at Chicago, Chicago, Illinois 60607)

  • Ali Tafti

    (College of Business Administration, University of Illinois at Chicago, Chicago, Illinois 60607)

  • Galit Shmueli

    (Institute of Service Science, National Tsing Hua University, Hsinchu 30013, Taiwan)

Abstract

Transportability is a structural causal modeling approach aimed at “transporting” a causal effect from a randomized experimental study in one population to a different population where only observational data are available. It offers a way to overcome the practical constraints in inferring causal relationships, such as endogeneity concerns in observational data and the infeasibility of replicating certain experiments. Although transportability holds significant promise for research and practice, it has thus far seldom been implemented in practice, likely because of the lack of practical guidelines for application of transportability theory or the lack of guidance on handling the statistical challenges that might arise. Using a practical problem as an illustration—estimating the effect of telecommuting on worker productivity—we attempt to bridge the theory-practice gap and delineate some challenges faced when putting transportability theory to practice. We offer a detailed procedure for transporting a causal effect across different populations, and we discuss some practical considerations for its implementation, including how to conceptualize causal diagrams, determine the feasibility of transport, select an appropriate diagram, and evaluate its credibility. We also discuss the current limitations, challenges, and opportunities for future research on transportability that would make it more amenable for broad practical use.

Suggested Citation

  • Sujin Park & Ali Tafti & Galit Shmueli, 2024. "Transporting Causal Effects Across Populations Using Structural Causal Modeling: An Illustration to Work-from-Home Productivity," Information Systems Research, INFORMS, vol. 35(2), pages 686-705, June.
  • Handle: RePEc:inm:orisre:v:35:y:2024:i:2:p:686-705
    DOI: 10.1287/isre.2023.1236
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/isre.2023.1236
    Download Restriction: no

    File URL: https://libkey.io/10.1287/isre.2023.1236?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Ritu Agarwal & Jayesh Prasad, 1998. "A Conceptual and Operational Definition of Personal Innovativeness in the Domain of Information Technology," Information Systems Research, INFORMS, vol. 9(2), pages 204-215, June.
    2. Daniel C. Castro & Ian Walker & Ben Glocker, 2020. "Causality matters in medical imaging," Nature Communications, Nature, vol. 11(1), pages 1-10, December.
    3. Nicholas Bloom & James Liang & John Roberts & Zhichun Jenny Ying, 2015. "Does Working from Home Work? Evidence from a Chinese Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 130(1), pages 165-218.
    4. Gordon Burtch & Anindya Ghose & Sunil Wattal, 2015. "The Hidden Cost of Accommodating Crowdfunder Privacy Preferences: A Randomized Field Experiment," Management Science, INFORMS, vol. 61(5), pages 949-962, May.
    5. Kevin Zhu & Kenneth L. Kraemer, 2005. "Post-Adoption Variations in Usage and Value of E-Business by Organizations: Cross-Country Evidence from the Retail Industry," Information Systems Research, INFORMS, vol. 16(1), pages 61-84, March.
    6. Ali Tafti & Galit Shmueli, 2020. "Beyond Overall Treatment Effects: Leveraging Covariates in Randomized Experiments Guided by Causal Structure," Information Systems Research, INFORMS, vol. 31(4), pages 1183-1199, December.
    7. Xitong Li & Jörn Grahl & Oliver Hinz, 2022. "How Do Recommender Systems Lead to Consumer Purchases? A Causal Mediation Analysis of a Field Experiment," Information Systems Research, INFORMS, vol. 33(2), pages 620-637, June.
    8. Kara E. Rudolph & Jonathan Levy & Mark J. van der Laan, 2021. "Transporting stochastic direct and indirect effects to new populations," Biometrics, The International Biometric Society, vol. 77(1), pages 197-211, March.
    9. Sinan Aral & Dylan Walker, 2011. "Creating Social Contagion Through Viral Product Design: A Randomized Trial of Peer Influence in Networks," Management Science, INFORMS, vol. 57(9), pages 1623-1639, February.
    10. Kara E. Rudolph & Mark J. Laan, 2017. "Robust estimation of encouragement design intervention effects transported across sites," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 79(5), pages 1509-1525, November.
    11. Manabu Kuroki & Judea Pearl, 2014. "Measurement bias and effect restoration in causal inference," Biometrika, Biometrika Trust, vol. 101(2), pages 423-437.
    12. Rajiv Kohli & Sarv Devaraj, 2003. "Measuring Information Technology Payoff: A Meta-Analysis of Structural Variables in Firm-Level Empirical Research," Information Systems Research, INFORMS, vol. 14(2), pages 127-145, June.
    13. Peter Weill, 1992. "The Relationship Between Investment in Information Technology and Firm Performance: A Study of the Valve Manufacturing Sector," Information Systems Research, INFORMS, vol. 3(4), pages 307-333, December.
    14. Sanjeev Dewan & Kenneth L. Kraemer, 2000. "Information Technology and Productivity: Evidence from Country-Level Data," Management Science, INFORMS, vol. 46(4), pages 548-562, April.
    15. Alan Felstead & Nick Jewson & Sally Walters, 2003. "Managerial Control of Employees Working at Home," British Journal of Industrial Relations, London School of Economics, vol. 41(2), pages 241-264, June.
    16. Christopher J. Bryan & Elizabeth Tipton & David S. Yeager, 2021. "Behavioural science is unlikely to change the world without a heterogeneity revolution," Nature Human Behaviour, Nature, vol. 5(8), pages 980-989, August.
    17. Sunil Mithas & M. S. Krishnan, 2009. "From Association to Causation via a Potential Outcomes Approach," Information Systems Research, INFORMS, vol. 20(2), pages 295-313, June.
    18. Imbens,Guido W. & Rubin,Donald B., 2015. "Causal Inference for Statistics, Social, and Biomedical Sciences," Cambridge Books, Cambridge University Press, number 9780521885881, October.
    19. Mingfeng Lin & Henry C. Lucas & Galit Shmueli, 2013. "Research Commentary ---Too Big to Fail: Large Samples and the p -Value Problem," Information Systems Research, INFORMS, vol. 24(4), pages 906-917, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Saggi Nevo & Michael Wade & Wade D. Cook, 2010. "An empirical study of IT as a factor of production: The case of Net-enabled IT assets," Information Systems Frontiers, Springer, vol. 12(3), pages 323-335, July.
    2. Stefan Schweikl & Robert Obermaier, 2020. "Lessons from three decades of IT productivity research: towards a better understanding of IT-induced productivity effects," Management Review Quarterly, Springer, vol. 70(4), pages 461-507, November.
    3. Yun Young Hur & Fujie Jin & Xitong Li & Yuan Cheng & Yu Jeffrey Hu, 2023. "Does Social Influence Change with Other Information Sources? A Large-Scale Randomized Experiment in Medical Crowdfunding," Information Systems Research, INFORMS, vol. 34(4), pages 1476-1492, December.
    4. Marta Fana & Francesco Sabato Massimo & Angelo Moro, 2021. "Autonomy and control in mass remote working during the Covid-19 pandemic. Evidence from a cross-professional and cross-national analysis," LEM Papers Series 2021/28, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
    5. Martínez-Caro, Eva & Cegarra-Navarro, Juan Gabriel & Alfonso-Ruiz, Francisco Javier, 2020. "Digital technologies and firm performance: The role of digital organisational culture," Technological Forecasting and Social Change, Elsevier, vol. 154(C).
    6. Elisa Gerten & Michael Beckmann & Elisa Gerten & Matthias Kräkel, 2022. "Information and Communication Technology, Hierarchy, and Job Design," ECONtribute Discussion Papers Series 189, University of Bonn and University of Cologne, Germany.
    7. Ehrenhard, Michel & Wijnhoven, Fons & van den Broek, Tijs & Zinck Stagno, Marc, 2017. "Unlocking how start-ups create business value with mobile applications: Development of an App-enabled Business Innovation Cycle," Technological Forecasting and Social Change, Elsevier, vol. 115(C), pages 26-36.
    8. Scott, Susan V. & Van Reenen, John & Zachariadis, Markos, 2017. "The long-term effect of digital innovation on bank performance: An empirical study of SWIFT adoption in financial services," Research Policy, Elsevier, vol. 46(5), pages 984-1004.
    9. Elbashir, Mohamed Z. & Collier, Philip A. & Davern, Michael J., 2008. "Measuring the effects of business intelligence systems: The relationship between business process and organizational performance," International Journal of Accounting Information Systems, Elsevier, vol. 9(3), pages 135-153.
    10. Mohamad, Amri & Zainuddin, Yuserrie & Alam, Nafis & Kendall, Graham, 2017. "Does decentralized decision making increase company performance through its Information Technology infrastructure investment?," International Journal of Accounting Information Systems, Elsevier, vol. 27(C), pages 1-15.
    11. Michael Beckmann & Thomas Cornelissen, 2014. "Self-Managed Working Time and Employee Effort: Microeconometric Evidence," SOEPpapers on Multidisciplinary Panel Data Research 636, DIW Berlin, The German Socio-Economic Panel (SOEP).
    12. Sinan Aral & Peter Weill, 2007. "IT Assets, Organizational Capabilities, and Firm Performance: How Resource Allocations and Organizational Differences Explain Performance Variation," Organization Science, INFORMS, vol. 18(5), pages 763-780, October.
    13. Marie Boltz & Bart Cockx & Ana Maria Diaz & Luz Magdalena Salas, 2023. "How does working‐time flexibility affect workers' productivity in a routine job? Evidence from a field experiment," British Journal of Industrial Relations, London School of Economics, vol. 61(1), pages 159-187, March.
    14. Monteiro, Natália P. & Straume, Odd Rune & Valente, Marieta, 2021. "When does remote electronic access (not) boost productivity? Longitudinal evidence from Portugal," Information Economics and Policy, Elsevier, vol. 56(C).
    15. Bang-Ning Hwang & Chi-Yo Huang & Chih-Hsiung Wu, 2016. "A TOE Approach to Establish a Green Supply Chain Adoption Decision Model in the Semiconductor Industry," Sustainability, MDPI, vol. 8(2), pages 1-30, February.
    16. Clare Leaver & Owen Ozier & Pieter Serneels & Andrew Zeitlin, 2021. "Recruitment, Effort, and Retention Effects of Performance Contracts for Civil Servants: Experimental Evidence from Rwandan Primary Schools," American Economic Review, American Economic Association, vol. 111(7), pages 2213-2246, July.
    17. van Wessel, R.M., 2008. "Realizing business benefits from company IT standardization : Case study research into the organizational value of IT standards, towards a company IT standardization management framework," Other publications TiSEM 4bdde091-4f3f-4be1-84aa-9, Tilburg University, School of Economics and Management.
    18. Prasad, Acklesh & Heales, Jon, 2010. "On IT and business value in developing countries: A complementarities-based approach," International Journal of Accounting Information Systems, Elsevier, vol. 11(4), pages 314-335.
    19. Patrick Piget & Mohamed Kossaï, 2013. "The Relationship between Information and Communication Technology Use and Firm Performance in Developing Countries: A Case Study of Electrical and Electronic Goods Manufacturing SMEs in Tunisia," African Development Review, African Development Bank, vol. 25(3), pages 330-343, September.
    20. Son, Minhee & Han, Kyesook, 2011. "Beyond the technology adoption: Technology readiness effects on post-adoption behavior," Journal of Business Research, Elsevier, vol. 64(11), pages 1178-1182.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:orisre:v:35:y:2024:i:2:p:686-705. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.