Microsoft Word Aptis scoring system layout docx
Yüklə 1,95 Mb. Pdf görüntüsü
|
- Bu səhifədəki naviqasiya:
- APTIS SCORING SYSTEM
|
A0 A1 A2 B1 B2 C(1) 2 C2 General
ü
ü ü
ü
ü ü
N/A Teachers ü
ü
ü
ü ü
N/A Teens
ü
ü ü
ü
ü ü
N/A Advanced A0–A2 1
ü
ü
ü
1 Aptis Advanced does not differentiate between A0–A2 level achievement. 2 Only Aptis Advanced differentiates between C1 and C2 level achievements; other variants designate achievement above B2 as “C” level.
2 The original CEFR documentation contains 57 different scales detailing communicative activities, strategies, and competencies, with further scales added in the Companion Volume.
APTIS SCORING SYSTEM KAREN DUNN
PAGE 7
6. ALIGNING APTIS WITH THE CEFR Upon first development, standard setting exercises were carried out for Listening, Reading, Writing and Speaking skill components of Aptis to provide confident translations of numeric score achieved to a CEFR level that reflects the candidates’ English language proficiency. This involved calling on a panel of expert judges, each bringing keen insight into indicators and measurement of L2 language proficiency. These judges were tasked with independently setting the cut scores representing the minimum score required for a candidate to achieve each CEFR level in each skill area. To achieve this, the team of judges followed four broad steps: 1. Familiarisation 2. Specification 3. Standard setting 4. Validation. For further details of the full alignment procedure please refer to O’Sullivan (2015).
Aptis has benefited from being able to base test specification, task development, and rating scale development from the outset on the CEFR. It is important to note that standard setting itself, while essential, is only one part of a comprehensive alignment process. In addition, ongoing research continues to contribute to the validation of the CEFR alignment (e.g. Dunlea et al., 2018). The Aptis approach to best practice in project delivery across not only exams but all of the areas of activity of the British Council is driven by an evidence-centred approach.
6.1 CEFR levels and the Core component As noted in Section 3 above, a CEFR level is allocated for each of the individual skill areas, but not the Core component. The Core component assesses candidates’ grammar and vocabulary knowledge. Since this knowledge underpins all language skills, it is an essential component in the Aptis testing system. However, CEFR levels are not reported for the Core component at the current time, because the position of grammar and vocabulary knowledge within the CEFR is one of the most under- specified elements of the framework. As described in the Technical Manual (O’Sullivan and Dunlea, 2015, p. 28), work on relating Core component to the CEFR is ongoing. The Core component does nonetheless play a role in the CEFR level allocation system for each skill component, as is elaborated in Section 7 below. The Core component is therefore an essential element in all packages of the Aptis test, and CEFR level allocation will not be finalised for any candidates who do not complete this component. 6.2 Comparability with other tests The CEFR provides a descriptive context that may be used to interpret the meaning and practical significance of scores on language tests. If a test developed by another organisation
has undergone a similar rigorous process of alignment with the CEFR as Aptis and is testing the same language areas, then the CEFR level awarded for Aptis will be broadly comparable. However, as noted above, the CEFR includes numerous individual scales targeting different communicative activities, meaning that there is scope for a wide degree of variation in the opportunities a candidate may be given to display their skills across different tests. When trying to interpret results from any test, and particularly if attempting to compare results from different tests, it is essential to consult the test specifications of each to understand clearly what aspects of language proficiency the test is designed to measure.
|