IDEAS home Printed from https://ideas.repec.org/p/ira/wpaper/201821.html
   My bibliography  Save this paper

“A new metric of consensus for Likert scales”

Author

Listed:
  • Oscar Claveria

    (AQR-IREA AQR-IREA, University of Barcelona (UB). Tel. +34-934021825; Fax. +34-934021821. Department of Econometrics, Statistics and Applied Economics, University of Barcelona, Diagonal 690, 08034 Barcelona, Spain.)

Abstract

In this study we present a metric of consensus for Likert-type scales. The measure gives the level of agreement as the percentage of consensus among respondents. The proposed framework allows to design a positional indicator that gives the degree of agreement for each item and for any given number of reply options. In order to assess the performance of the proposed metric of consensus, in an iterated one-period ahead forecasting experiment we test whether the inclusion of the degree of agreement in consumers’ expectations regarding the evolution of unemployment improves out-of-sample forecast accuracy in eight European countries. We find evidence that the degree of agreement among consumers contains useful information to predict unemployment rates in most countries. The obtained results show the usefulness of consensus-based metrics to track the evolution of economic variables.

Suggested Citation

  • Oscar Claveria, 2018. "“A new metric of consensus for Likert scales”," IREA Working Papers 201821, University of Barcelona, Research Institute of Applied Economics, revised Oct 2018.
    • Handle: RePEc:ira:wpaper:201821
    as

    Download full text from publisher

    File URL: http://www.ub.edu/irea/working_papers/2018/201821.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    2. Binder, Carola Conces, 2015. "Whose expectations augment the Phillips curve?," Economics Letters, Elsevier, vol. 136(C), pages 35-38.
    3. Hyndman, Rob J. & Koehler, Anne B., 2006. "Another look at measures of forecast accuracy," International Journal of Forecasting, Elsevier, vol. 22(4), pages 679-688.
    4. Kaufmann, Daniel & Scheufele, Rolf, 2017. "Business tendency surveys and macroeconomic fluctuations," International Journal of Forecasting, Elsevier, vol. 33(4), pages 878-893.
    5. Oscar Claveria & Enric Monte & Salvador Torra, 2017. "A new approach for the quantification of qualitative measures of economic expectations," Quality & Quantity: International Journal of Methodology, Springer, vol. 51(6), pages 2685-2706, November.
    6. von der Gracht, Heiko A., 2012. "Consensus measurement in Delphi studies," Technological Forecasting and Social Change, Elsevier, vol. 79(8), pages 1525-1536.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Oscar Claveria, 2021. "On the Aggregation of Survey-Based Economic Uncertainty Indicators Between Different Agents and Across Variables," Journal of Business Cycle Research, Springer;Centre for International Research on Economic Tendency Surveys (CIRET), vol. 17(1), pages 1-26, April.
    2. Oscar Claveria, 2020. "“Measuring and assessing economic uncertainty”," AQR Working Papers 2012003, University of Barcelona, Regional Quantitative Analysis Group, revised Jul 2020.
    3. Oscar Claveria, 2021. "Forecasting with Business and Consumer Survey Data," Forecasting, MDPI, vol. 3(1), pages 1-22, February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Frank, Johannes, 2023. "Forecasting realized volatility in turbulent times using temporal fusion transformers," FAU Discussion Papers in Economics 03/2023, Friedrich-Alexander University Erlangen-Nuremberg, Institute for Economics.
    2. Cameron Roach & Rob Hyndman & Souhaib Ben Taieb, 2021. "Non‐linear mixed‐effects models for time series forecasting of smart meter demand," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 40(6), pages 1118-1130, September.
    3. Nikitopoulos, Christina Sklibosios & Thomas, Alice Carole & Wang, Jianxin, 2023. "The economic impact of daily volatility persistence on energy markets," Journal of Commodity Markets, Elsevier, vol. 30(C).
    4. Martin Guth, 2022. "Predicting Default Probabilities for Stress Tests: A Comparison of Models," Papers 2202.03110, arXiv.org.
    5. Bialowolski, Piotr & Kuszewski, Tomasz & Witkowski, Bartosz, 2015. "Bayesian averaging vs. dynamic factor models for forecasting economic aggregates with tendency survey data," Economics - The Open-Access, Open-Assessment E-Journal (2007-2020), Kiel Institute for the World Economy (IfW Kiel), vol. 9, pages 1-37.
    6. Kunze, Frederik, 2017. "Predicting exchange rates in Asia: New insights on the accuracy of survey forecasts," University of Göttingen Working Papers in Economics 326, University of Goettingen, Department of Economics.
    7. Drachal, Krzysztof, 2021. "Forecasting crude oil real prices with averaging time-varying VAR models," Resources Policy, Elsevier, vol. 74(C).
    8. Blaskowitz, Oliver & Herwartz, Helmut, 2011. "On economic evaluation of directional forecasts," International Journal of Forecasting, Elsevier, vol. 27(4), pages 1058-1065, October.
    9. Martin Magris, 2019. "A Vine-copula extension for the HAR model," Papers 1907.08522, arXiv.org.
    10. James Mitchell & Saeed Zaman, 2023. "The Distributional Predictive Content of Measures of Inflation Expectations," Working Papers 23-31, Federal Reserve Bank of Cleveland.
    11. Isabel Figuerola‐Ferretti & Alejandro Rodríguez & Eduardo Schwartz, 2021. "Oil price analysts' forecasts," Journal of Futures Markets, John Wiley & Sons, Ltd., vol. 41(9), pages 1351-1374, September.
    12. Bekiroglu, Korkut & Duru, Okan & Gulay, Emrah & Su, Rong & Lagoa, Constantino, 2018. "Predictive analytics of crude oil prices by utilizing the intelligent model search engine," Applied Energy, Elsevier, vol. 228(C), pages 2387-2397.
    13. Potočnik, Primož & Soldo, Božidar & Šimunović, Goran & Šarić, Tomislav & Jeromen, Andrej & Govekar, Edvard, 2014. "Comparison of static and adaptive models for short-term residential natural gas forecasting in Croatia," Applied Energy, Elsevier, vol. 129(C), pages 94-103.
    14. Madadkhani, Shiva & Ikonnikova, Svetlana, 2024. "Toward high-resolution projection of electricity prices: A machine learning approach to quantifying the effects of high fuel and CO2 prices," Energy Economics, Elsevier, vol. 129(C).
    15. Oscar Claveria & Enric Monte & Salvador Torra, 2018. "Tracking economic growth by evolving expectations via genetic programming: A two-step approach," Working Papers XREAP2018-4, Xarxa de Referència en Economia Aplicada (XREAP), revised Oct 2018.
    16. Huang, Tao & Fildes, Robert & Soopramanien, Didier, 2019. "Forecasting retailer product sales in the presence of structural change," European Journal of Operational Research, Elsevier, vol. 279(2), pages 459-470.
    17. Eckert, Florian & Hyndman, Rob J. & Panagiotelis, Anastasios, 2021. "Forecasting Swiss exports using Bayesian forecast reconciliation," European Journal of Operational Research, Elsevier, vol. 291(2), pages 693-710.
    18. Mihaela Bratu, 2012. "A Strategy to Improve the Survey of Professional Forecasters (SPF) Predictions Using Bias-Corrected-Accelerated (BCA) Bootstrap Forecast Intervals," International Journal of Synergy and Research, ToKnowPress, vol. 1(2), pages 45-59.
    19. Krzysztof Drachal, 2022. "Forecasting the Crude Oil Spot Price with Bayesian Symbolic Regression," Energies, MDPI, vol. 16(1), pages 1-29, December.
    20. Xu, Kunliang & Wang, Weiqing, 2023. "Limited information limits accuracy: Whether ensemble empirical mode decomposition improves crude oil spot price prediction?," International Review of Financial Analysis, Elsevier, vol. 87(C).

    More about this item

    Keywords

    Likert scales; consensus; geometry; economic tendency surveys; consumer expectations; unemployment JEL classification:C14; C51; C52; C53; D12; E24;
    All these keywords.

    JEL classification:

    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C5 - Mathematical and Quantitative Methods - - Econometric Modeling

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ira:wpaper:201821. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Alicia García (email available below). General contact details of provider: https://edirc.repec.org/data/feubaes.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.