Assessing What Counts: A Comparative Analysis of Numeracy Instruments Used in Research with General Adult Populations

Authors Marieke Bor-de Vries, Lonneke Boels, Tamara Madern, Paul Drijvers
Published in Numeracy: Advancing Education in Quantitative Literacy
Publication date 2027
Research groups Mathematical and analytical competence of professionals
Type Article

Summary

A wide variety of instruments are available to assess numeracy. However, researchers rarely provide information regarding the specific numeracy aspects assessed and the complexity of the items used. Instruments that differ in content may produce inconsistent patterns of correlation, thereby complicating the interpretation and comparison of findings across studies. This paper addresses this issue through answering the research question: What are the content characteristics of the numeracy instruments used in the context of research on consumers’ f inancial difficulties? In a scoping literature review, we identified nine numeracy instruments used in the context of research on consumers’ financial difficulties (e.g. over indebtedness). We examined the specific numeracy aspects they assess and the complexity of their items. Items were coded for numeracy aspects, using the Common European Numeracy Framework (CENF). For complexity the PIAAC Numeracy Task Complexity Schema was used. Results reveal both similarities and differences across the instruments. A similarity is that all instruments assess only a limited aspect of numeracy. A key difference is the variation in item complexity. The findings facilitate comparisons across studies and assist researchers in selecting or designing suitable numeracy instruments. In conclusion, the study highlights notable differences between numeracy assessment instruments, underscoring the need for caution when interpreting and comparing their results. Further, this article provides some practical guidelines for researchers seeking to assess numeracy.

On this publication contributed

  • Marieke Bor-de Vries
    • PhD candidate
    • Research group: Mathematical and analytical competence of professionals
  • Lonneke Boels
    Lonneke Boels
    • Professor
    • Research group: Mathematical and analytical competence of professionals
  • Picture of Tamara Madern
    Tamara Madern
    • Professor
    • Research group: Debt and Debt Collection
Language English
Published in Numeracy: Advancing Education in Quantitative Literacy
Year and volume 20 1
Key words numeracy, assessment instruments, Common European Numeracy Framework, PIAAC Complexity Schema
Digital Object Identifier 10.5038/1936-4660.20.1.1536