Counting what counts: a multi-dimensional approach to educational gain 

This HEPI blog was kindly authored by Professor Billy Wong, Director of Research and Evaluation (Access & Participation) at the University of Reading. Billy has recently written the paper Rethinking educational gain in higher education: Beyond metrics to a multi-dimensional model, and blogs his thoughts on this below.  

With the next iteration of the Teaching Excellence Framework (TEF) under redevelopment, and confirmation that it will look vastly different to TEF 2023, we have an opportunity to rethink the notion of educational gain – if it is to continue as a core assessment. 

From learning gain to educational gain, the concept is appealing for its emphasis on understanding how students grow and develop over time, and the extent to which higher education institutions can make robust claims about their roles and contributions. 

However, the Office for Students (OfS) left the definition and measurement of educational gain to individual providers to decide for themselves, which left the sector with a multitude of definitions. In the absence of a clear, shared definition of and approach to educational gain, the sector has tended to default to what is most easily measured.  

Yet, an over reliance on student outcome metrics (such as the National Student Survey, continuation/completion or Graduate Outcome data) reduces the indicators of student development into just numbers. More concerningly, this approach meant student groups with small numbers may be lumped together or even excluded in various statistical analyses. When we focus on lived experience as headline statistics, the nuances are swept away. 

Sector conversation 

Recent sector work has explored the complexities of educational gain, from Fung’s (2024) analysis of Gold-rated TEF institutions to Quality Assurance Agency’s Collaborative Enhancement Project, which found diverse, developing but disparate approaches. 

For individual institutions, a context-specific relevant approach makes sense, reflecting their own goals, priorities and practical considerations. But as a sector, including for the OfS, such freedom makes national comparison difficult if not impossible, and we revert to readily accessible and available outcome data. 

Yet, educational gain must not only capture cognitive progress, but also the broader and holistic developments such as confidence and belonging. 

The sector would benefit from a shared but flexible frame of reference for educational gain, which advocates for a diverse approach to evidence student growth over time. 

A multi-dimensional approach to educational gain 

Informed by the foundations of learning gain, this new paper proposes a multi-dimensional model of educational gain through three interrelated domains: cognitive and metacognitive, personal and affective, and social and cultural. Drawing on educational, psychological and sociological perspectives, these domains recognise the different aspects of student development, which also foregrounds the importance of longitudinal data from both qualitative and quantitative methods. 

A multi-dimensional approach appreciates the student experience across the agency-structure spectrum. It provides an overarching frame of reference that enables institutions to tailor the specific approach as appropriate for their contexts. There will be differences across the sector in how institutions apply these in practice, but if the three domains (cognitive and metacognitive, personal and affective, and social and cultural) are broadly shared and operated as a thematic proxy across the sector, then we are at least in a position to explore how different institutions have collectively explored those dimensions. 

For example, for cognitive and metacognitive development, it is conceivable that TASO’s Access and Success Questionnaire (ASQ) is adopted nationally to provide sector-wide comparable data with use value within and across institutions. In parallel, it is also conceivable to run a longitudinal qualitative study that unpacks how students articulate, reflect on and discuss their cognitive and metacognitive development. 

Similarly, quantitative and qualitative methods can explore the extent to which students grow in confidence, resilience and self-efficacy, or whether they expand their social capital, sense of belonging or broader development as global citizens. 

A multi-dimensional approach offers a unified lens for understanding educational gain that recognises sector benchmarks as well as local narratives. Without such a multi-dimensional view, the sector risks defaulting to established metrics that do not capture the full breadth of gains students achieve during their higher education. 

What institutions can do 

Short, funded pilot projects – supported by modest capacity-building grants – would give staff the space to test these methods before it is rolled out more widely. Contextually relevant reflective tasks could be strengthened and encouraged across programmes to encourage students to engage more critically with their own development. Crucially, it is important to ensure that any evidence gathered is conceptually robust and grounded in relevant theories of student progress and gains, for example: cognitive and metacognitive development, personal and affective growth, and social and cultural development. National-level benchmarks can be used effectively alongside the richness of context-specific data and evidence collected over time at the institutional level – reconciling national comparability with institutional distinctiveness. 

What next? 

If educational gain – and variations of it – is part of any next assessments, then the OfS should really be more explicit about what it expects from institutions. The ‘test’ from TEF 2023 to give providers the freedom to set their own criteria may be well-intended, but it served limited value for the sector, and presumably for the regulators themselves. A broad, flexible guiding principle or framework might provide the necessary coherence, preferably one that invites theoretical and methodological foundations in addition to the practical and pragmatic. 

• To read more: Wong, B. (2025). Rethinking educational gain in higher education: Beyond metrics to a multi-dimensional model. Journal of Higher Education Policy and Management. https://doi.org/10.1080/1360080X.2025.2545624