posit-ve

Psychometrics

Evaluation frameworks and instruments for research.

Tasmanian Leaders’ Evaluation and Learning Framework

Tasmanian Leaders uses this framework to understand how participants develop across 17 areas of leadership growth, including self-awareness, perspective-taking and strategic thinking. Dr Joseph Crawford leads independent evaluation across its programmes through the framework.

QATTL

The Quality Assessment Tool for Theory-based and Literature Review Studies helps reviewers appraise conceptual and literature review papers. Read the full manuscript before rating it. For reviewing with other raters or setting inclusion thresholds, consult the original coding guidance.

Open the 15-item appraisal tool

Rate each criterion. Code 4 marks an irrelevant item and excludes it from the mean. The calculator reports the mean and its percentage of the maximum for applicable items.

Cite the original paper

Crawford, J., Kelder, J.-A., & Wilson, G. (2025). Quality assessment tool for theory-based and literature review studies (QATTL): Development and validation of a critical appraisal tool. Quality & Quantity, 59, 1089–1102. https://doi.org/10.1007/s11135-024-02003-8

AI use in higher education

Three self-report items capture the frequency, depth and duration of students’ AI conversations. The study used short-text responses and standardised them during analysis. It reports internal consistency of α = .60.

Open the three-item questionnaire

These prompts are reconstructed from the paper’s Measures section. Use short-text responses and retain the units shown.

Responses stay in your browser on this page. The article does not specify a composite scoring rule.

Cite the original paper

Crawford, J., Allen, K.-A., Pani, B., & Cowling, M. (2024). When artificial intelligence substitutes humans in higher education: The cost of loneliness, student success, and retention. Studies in Higher Education, 49(5), 883–897. https://doi.org/10.1080/03075079.2024.2326956

Forthcoming