IDEAS home Printed from https://ideas.repec.org/a/spr/qualqt/v57y2023i4d10.1007_s11135-022-01523-5.html
   My bibliography  Save this article

Response scale overstretch: linear stretching of response scales does not ensure cross-project equivalence in harmonised data

Author

Listed:
  • Piotr Cichocki

    (Adam Mickiewicz University)

  • Piotr Jabkowski

    (Adam Mickiewicz University)

Abstract

Differences in the response-scale formats constitute a major challenge for ex-post harmonisation of survey data. Linear stretching of original response options onto a common range of values remains a popular response to format differences. Unlike its more sophisticated alternative, simple stretching proves readily applicable without requiring assumptions regarding scale length or access to auxiliary information. The transformation only accounts for response scale length, ignoring all other aspects of measurement quality, which makes the equivalence of harmonised survey variables questionable. This paper focuses on the inherent limitations of linear stretching based on a case study focusing on the measurements of trust in the European Parliament by the Eurobarometer and the European Social Survey—8 timewise corresponding survey waves in 14 European countries (2004–2018). Our analysis demonstrates that the linear stretch approach to harmonising question items with different underlying response scale formats does not make the results of the two surveys equivalent. Despite harmonisation, response scale effects are retained in the distributions of output variables.

Suggested Citation

  • Piotr Cichocki & Piotr Jabkowski, 2023. "Response scale overstretch: linear stretching of response scales does not ensure cross-project equivalence in harmonised data," Quality & Quantity: International Journal of Methodology, Springer, vol. 57(4), pages 3729-3745, August.
    • Handle: RePEc:spr:qualqt:v:57:y:2023:i:4:d:10.1007_s11135-022-01523-5
    DOI: 10.1007/s11135-022-01523-5
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11135-022-01523-5
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11135-022-01523-5?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Sylke Nissen, 2014. "The Eurobarometer and the process of European integration," Quality & Quantity: International Journal of Methodology, Springer, vol. 48(2), pages 713-727, March.
    2. Weijters, Bert & Cabooter, Elke & Schillewaert, Niels, 2010. "The effect of rating scale format on response styles: The number of response categories and response category labels," International Journal of Research in Marketing, Elsevier, vol. 27(3), pages 236-247.
    3. Tineke Jonge & Ruut Veenhoven & Lidia Arends, 2014. "Homogenizing Responses to Different Survey Questions on the Same Topic: Proposal of a Scale Homogenization Method Using a Reference Distribution," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 117(1), pages 275-300, May.
    4. Cassondra Batz & Scott Parrigon & Louis Tay, 2016. "The Impact of Scale Transformations on National Subjective Well-Being Scores," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 129(1), pages 13-27, October.
    5. Bates, Douglas & Mächler, Martin & Bolker, Ben & Walker, Steve, 2015. "Fitting Linear Mixed-Effects Models Using lme4," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 67(i01).
    6. Hobolt, Sara B. & Leeper, Thomas J. & Tilley, James, 2021. "Divided by the Vote: Affective Polarization in the Wake of the Brexit Referendum," British Journal of Political Science, Cambridge University Press, vol. 51(4), pages 1476-1493, October.
    7. Bert Weijters & Maggie Geuens & Hans Baumgartner, 2013. "The Effect of Familiarity with the Response Category Labels on Item Response to Likert Scales," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 40(2), pages 368-381.
    8. Lisa Maria Dellmuth & Jonas Tallberg, 2020. "Why national and international legitimacy beliefs are linked: Social trust as an antecedent factor," The Review of International Organizations, Springer, vol. 15(2), pages 311-337, April.
    9. Matthew Gabel, 2003. "Public Support for the European Parliament," Journal of Common Market Studies, Wiley Blackwell, vol. 41(2), pages 289-308, April.
    10. Cabooter, Elke & Weijters, Bert & Geuens, Maggie & Vermeir, Iris, 2016. "Scale format effects on response option interpretation and use," Journal of Business Research, Elsevier, vol. 69(7), pages 2574-2584.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Weijters, Bert & Millet, Kobe & Cabooter, Elke, 2021. "Extremity in horizontal and vertical Likert scale format responses. Some evidence on how visual distance between response categories influences extreme responding," International Journal of Research in Marketing, Elsevier, vol. 38(1), pages 85-103.
    2. Weijters, Bert & Baumgartner, Hans & Geuens, Maggie, 2016. "The calibrated sigma method: An efficient remedy for between-group differences in response category use on Likert scales," International Journal of Research in Marketing, Elsevier, vol. 33(4), pages 944-960.
    3. Elke Cabooter & Bert Weijters & Alain Beuckelaer & Eldad Davidov, 2017. "Is extreme response style domain specific? Findings from two studies in four countries," Quality & Quantity: International Journal of Methodology, Springer, vol. 51(6), pages 2605-2622, November.
    4. Claire Durand & Luis Patricio Peña Ibarra & Nadia Rezgui & David Wutchiett, 2022. "How to combine and analyze all the data from diverse sources: a multilevel analysis of institutional trust in the world," Quality & Quantity: International Journal of Methodology, Springer, vol. 56(3), pages 1755-1797, June.
    5. Cabooter, Elke & Weijters, Bert & Geuens, Maggie & Vermeir, Iris, 2016. "Scale format effects on response option interpretation and use," Journal of Business Research, Elsevier, vol. 69(7), pages 2574-2584.
    6. Anastasia Charalampi & Catherine Michalopoulou & Clive Richardson, 2020. "Validation of the 2012 European Social Survey Measurement of Wellbeing in Seventeen European Countries," Applied Research in Quality of Life, Springer;International Society for Quality-of-Life Studies, vol. 15(1), pages 73-105, March.
    7. de Rezende, Naia A. & de Medeiros, Denise D., 2022. "How rating scales influence responses’ reliability, extreme points, middle point and respondent’s preferences," Journal of Business Research, Elsevier, vol. 138(C), pages 266-274.
    8. Chauhan, Vivek & Gupta, Akshay & Parida, Manoranjan, 2021. "Demystifying service quality of Multimodal Transportation Hub (MMTH) through measuring users’ satisfaction of public transport," Transport Policy, Elsevier, vol. 102(C), pages 47-60.
    9. JANSSENS, Jochen & DE CORTE, Annelies & SÖRENSEN, Kenneth, 2016. "Water distribution network design optimisation with respect to reliability," Working Papers 2016007, University of Antwerp, Faculty of Business and Economics.
    10. Raymond Hernandez & Elizabeth A. Pyatak & Cheryl L. P. Vigen & Haomiao Jin & Stefan Schneider & Donna Spruijt-Metz & Shawn C. Roll, 2021. "Understanding Worker Well-Being Relative to High-Workload and Recovery Activities across a Whole Day: Pilot Testing an Ecological Momentary Assessment Technique," IJERPH, MDPI, vol. 18(19), pages 1-17, October.
    11. Christopher Hassall & Michael Nisbet & Evan Norcliffe & He Wang, 2024. "The Potential Health Benefits of Urban Tree Planting Suggested through Immersive Environments," Land, MDPI, vol. 13(3), pages 1-12, February.
    12. Jie Zhao & Ji Chen & Damien Beillouin & Hans Lambers & Yadong Yang & Pete Smith & Zhaohai Zeng & Jørgen E. Olesen & Huadong Zang, 2022. "Global systematic review with meta-analysis reveals yield advantage of legume-based rotations and its drivers," Nature Communications, Nature, vol. 13(1), pages 1-9, December.
    13. Elisabeth Beckmann & Lukas Olbrich & Joseph Sakshaug, 2024. "Multivariate assessment of interviewer-related errors in a cross-national economic survey (Lukas Olbrich, Elisabeth Beckmann, Joseph W. Sakshaug)," Working Papers 253, Oesterreichische Nationalbank (Austrian Central Bank).
    14. Eline Moens & Louis Lippens & Philippe Sterkens & Johannes Weytjens & Stijn Baert, 2022. "The COVID-19 crisis and telework: a research survey on experiences, expectations and hopes," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 23(4), pages 729-753, June.
    15. F J Heather & D Z Childs & A M Darnaude & J L Blanchard, 2018. "Using an integral projection model to assess the effect of temperature on the growth of gilthead seabream Sparus aurata," PLOS ONE, Public Library of Science, vol. 13(5), pages 1-19, May.
    16. Valentina Krenz & Arjen Alink & Tobias Sommer & Benno Roozendaal & Lars Schwabe, 2023. "Time-dependent memory transformation in hippocampus and neocortex is semantic in nature," Nature Communications, Nature, vol. 14(1), pages 1-17, December.
    17. Morán-Ordóñez, Alejandra & Ameztegui, Aitor & De Cáceres, Miquel & de-Miguel, Sergio & Lefèvre, François & Brotons, Lluís & Coll, Lluís, 2020. "Future trade-offs and synergies among ecosystem services in Mediterranean forests under global change scenarios," Ecosystem Services, Elsevier, vol. 45(C).
    18. Jack McDonnell & Thomas McKenna & Kathryn A. Yurkonis & Deirdre Hennessy & Rafael Andrade Moral & Caroline Brophy, 2023. "A Mixed Model for Assessing the Effect of Numerous Plant Species Interactions on Grassland Biodiversity and Ecosystem Function Relationships," Journal of Agricultural, Biological and Environmental Statistics, Springer;The International Biometric Society;American Statistical Association, vol. 28(1), pages 1-19, March.
    19. Ana Pinto & Tong Yin & Marion Reichenbach & Raghavendra Bhatta & Pradeep Kumar Malik & Eva Schlecht & Sven König, 2020. "Enteric Methane Emissions of Dairy Cattle Considering Breed Composition, Pasture Management, Housing Conditions and Feeding Characteristics along a Rural-Urban Gradient in a Rising Megacity," Agriculture, MDPI, vol. 10(12), pages 1-18, December.
    20. Damian M. Herz & Manuel Bange & Gabriel Gonzalez-Escamilla & Miriam Auer & Keyoumars Ashkan & Petra Fischer & Huiling Tan & Rafal Bogacz & Muthuraman Muthuraman & Sergiu Groppa & Peter Brown, 2022. "Dynamic control of decision and movement speed in the human basal ganglia," Nature Communications, Nature, vol. 13(1), pages 1-15, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:qualqt:v:57:y:2023:i:4:d:10.1007_s11135-022-01523-5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.