All Journals

Language Teaching Research Quarterly

European Journal of Studies in Management and Business

International Journal of Behavior Studies in Organizations

Studies in Educational Management

New Challenges in Accounting and Finance

Language Testing in Focus: An International Journal

Marketing and Branding Research

Individual Differences in Language Education: An International Journal 

Feedback Research in Second Language 

Management Issues in Healthcare System

Language Teacher Education Research

Artificial Intelligence Knowledge Development

<p style="text-align: justify;">Our designs of language tests understandably focus on the endpoint: a useful test with interpretable results. We should not neglect what precedes that endpoint: the critical phases in the development of the test. We do not reflect enough on the development process, perhaps because we think that this is not worthy of research. Awareness of the stages of test design is useful, however: it pays handsome dividends when the quality of the end product is examined. The wide-ranging scholarly work of Carol Chapelle has focussed, among other issues, on two critically important components of testing language ability: assessing vocabulary knowledge and computer-assisted platforms for taking language tests. Their interaction will be highlighted here. Using a five-phase approach to language test design, this contribution sets out how the intuitive initial solution becomes the prompt to greater deliberation; how the articulated specification of what is being tested leads to greater theoretical defensibility; and how considerations of economy can be accommodated, leading to justifiable technical compromises in devising a quick test of reading levels. The initial solution associated reading ability closely with vocabulary knowledge only. The more deliberate subsequent design sought to overcome some of the limitations of that premise, by enriching the test with the addition of several further task types. The record of these design decisions indicates the rise in language assessment literacy (LAL) among the design team members, and how useful such a design record can be to enhance the quality of the eventual measure.</p>

ltrq.2025.50.08.pdf

Perspective Article

ltrq.2025.50.08.xml

Underestimated Utility: Recording Design Decisions in Language Test Development

Guest-editors: 
Christine Coombe 
Higher Colleges of Technology, Dubai, UAE 
Tony Clark 
Cambridge University Press & Assessment, UK 
Hassan Mohebbi 
European Knowledge Development Institute, Turkey


Special Issue: In Honour of Carol A. Chapelle’s Contributions to Language Assessment and Learning (Volume 50-First Part)

<p style="text-align:justify;">This contribution investigates gains in technical economy in measuring language ability by considering one recurrent interest of JD Brown: cloze tests. In the various versions of the Test of Academic Literacy Levels (TALL), its Sesotho and Afrikaans (Toets van Akademiese Geletterdheidsvlakke – TAG) counterparts, as well as related other tests used in South Africa, the test designers have used a modification of this procedure to very good effect. This paper reports on the steady evolution of its format over many years, how it is currently used, what its outstanding empirical properties are, and how the kind of technical economy it brings to the measurement of the ability to handle the demands of academic language at the level of tertiary education can be further applied. The modification involves the conventional, more or less systematic mutilation of a selected text, with two multiple choice questions about every gap in it: where the gap is, and which word has been omitted. We have not seen anywhere else analyses of this format, which in itself may be of interest to test designers. We proceed by defining technical economy, and then develop an argument on the basis of the empirical properties of TALL on how that idea can be applied, in particular to the design and task selection of such tests, before giving illustrations of how such choices may contribute to further and other productive and responsible designs and test formats.</p>

ltrq.2023.37.07.pdf

Original Research 

ltrq.2023.37.07.xml

Achieving Technical Economy: A Modification of Cloze Procedure

Guest-editors: 
Christine Coombe, PhD, Higher Colleges of Technology, Dubai, UAE
Tony Clark, PhD, Cambridge University Press & Assessment, UK
Hassan Mohebbi, PhD, Independent Researcher, Turkey


Special Issue: In Honour of James Dean Brown’s Five-Decade Contribution to Language Testing