Authenticity is regarded as an important feature of language tests, but commonly the notion is related only to the use of authentic material. In the course of this class, however, we found out that the concept of authenticity is actually far more comprehensive. It does indeed include characteristics of the input of test tasks, but it is also concerned with the interaction between input and expected response, the setting and the format of a test. Hence, we decided to work mainly on the topic of authenticity in this final report of our course on language assessment.
Table of Contents
1. Authenticity in Language Assessment
2. Reflections about authenticity
Objective and Thematic Focus
The primary objective of this assignment is to evaluate the authenticity of a reading test developed during a course on language assessment by applying theoretical frameworks, specifically those of Bachman and Palmer (1996) and Alderson (2000).
- The conceptual evolution of authenticity in language testing.
- Distinction between situational and interactional authenticity.
- Critical analysis of test task characteristics including setting, rubrics, input, and expected response.
- Limitations in test design and the compromise between ideal and practical assessment constraints.
Excerpt from the Book
Characteristics of the input
The third category ‘characteristics of the input’ is probably the most important for determining the authenticity of our class project test. Alderson (2000:152) states that while Bachmann and Palmer only consider the prompts when they speak about input, in reading we also have to consider the texts and hence, input refers to the combination of a text and the respective task. In our case the input consisted of language only, which is not very authentic since in the real-world texts often combine visual and textual input. Furthermore, the layout of some of the texts was evidently altered, which means that the ‘vehicle’, “the means by which input is delivered” (Bachman & Palmer 1996: 53), was changed. In addition, some texts were clearly shortened, so that for many items the students only get to read a passage of a whole text. Moreover, texts of fairly equal length were chose on purpose, which reflects other considerations, but clearly does not enhance authenticity since real-world texts can consist either of a few letters in case of a sign or of hundreds of pages in case of a novel, for instance.
Summary of Chapters
Authenticity in Language Assessment: This chapter introduces the definition of authenticity, tracing its development from the 1960s, and applies the framework of Bachman and Palmer to analyze the specific characteristics of the class project reading test.
Reflections about authenticity: This concluding section discusses the practical challenges encountered during the test development phase and acknowledges the difficulties in evaluating authenticity without empirical data from test takers.
Keywords
Authenticity, Language Assessment, Bachman and Palmer, Reading Test, TLU Domain, Situational Authenticity, Interactional Authenticity, Task Characteristics, Test Design, Assessment Framework, Language Testing, Test Validity, Input Characteristics, Expected Response, Applied Linguistics
Frequently Asked Questions
What is the core subject of this assignment?
The assignment fundamentally addresses the concept of authenticity in the context of language testing, specifically evaluating how a student-developed reading test aligns with real-world language use.
What are the central themes covered in the text?
Central themes include the theoretical definitions of authenticity, the distinction between situational and interactional authenticity, and the systematic evaluation of test components like settings, rubrics, and input types.
What is the primary research goal?
The goal is to assess the level of authenticity of a specific reading test designed for a class project and to identify how test development choices impact the correspondence between test tasks and target language use.
Which scientific methodology is applied?
The authors apply the theoretical framework established by Bachman and Palmer (1996) for evaluating test usefulness, alongside Alderson’s (2000) adaptations for assessing reading proficiency.
What topics are discussed in the main body?
The main body examines four key categories: characteristics of the setting, characteristics of the test rubrics, characteristics of the input, and characteristics of the expected response.
Which keywords define this work?
Key terms include authenticity, TLU (target language use) domain, task characteristics, reading assessment, and language testing methodology.
Why is the reading test described as semi-authentic regarding its setting?
The authors argue it is semi-authentic because, while classroom reading is a real-life activity, the students were subject to artificial time constraints and lacked a natural purpose for reading compared to real-world contexts.
How does the choice of a "selected response" format impact authenticity?
The authors conclude that the multiple-choice format is inherently inauthentic because it is rarely used in real-world reading tasks, differing significantly from how people interact with texts in daily life.
- Citation du texte
- Katharina Eder (Auteur), 2010, Authenticity in Language Assessment, Munich, GRIN Verlag, https://www.grin.com/document/172655
