Language Testing in Focus: An International Journal

This study explores the use of poetry-based cloze tests as a language assessment tool for European Portuguese (EP) as a Foreign Language (PFL) at beginner-to-intermediate proficiency levels. Three rational cloze tests, developed from Portuguese poetry, were pretested with 24 native speakers and validated with 32 PFL learners. Data included response accuracy, perceived test difficulty, and sociolinguistic background. Test- and item-level analyses confirmed high internal consistency and item discrimination for the intended construct. Learners’ sociolinguistic profiles – self-assessed proficiency, country of residence, and native language – influenced performance. Item design features, namely hints and the structured response format for omitted words, may have contributed to the consistency in complexity across all cloze tests. This study highlights the role of poem selection criteria in test development, such as cultural relevance, narrative coherence, and lexical richness. Findings support the integration of poetry into PFL testing practices to promote holistic test development. These findings provide a methodological contribution to the field of PFL assessment, encourage the comparability of cloze testing methods in PFL research involving similar learner populations.