Assessment literacy of national examination interviewers and raters – experience with the CEFR

Ene Alas, Suliko Liiv

Abstract


The article investigates the training needs for the English language national examination interviewers and raters in Estonia in light of the new national examination that is set to measure students’ proficiency at level B of the Common European Framework of Reference for Languages (henceforth CEFR) scale. A questionnaire study was designed to explore CEFR-related assessment literacy – the extent to which the target population employed the CEFR in their daily professional life, how accessible they felt the CEFR was for their professional needs and if they thought they could accurately place students on the CEFR levels. Additionally, the respondents assigned CEFR can do statements to the levels deemed appropriate. The results revealed ambiguity about the CEFR levels among the respondents, which lead the authors to propose a training sequence designed to empower the interviewers and raters to function more efficiently within the new national examination speaking test in Estonia.

DOI: http://dx.doi.org/10.5128/ERYa10.01


Keywords


assessment literacy; interviewer; rater; oral proficiency interview; CEFR; training

Full Text:

PDF

References


Alas, Ene 2010. The English Language National Examination Validity Defined by Its Oral Proficiency Interview Interlocutor Behaviour. Tallinn University Dissertations on Humanities 22. Tallinn: Tallinn University Press.

Brindley, Geoff 2001. Language assessment and professional development. – C. Elder, A. Brown, E. Grove, K. Hall, N. Iwashita, T. Lumley, T. McNamara, K. O’Loughlin (Eds.). Experimenting with Uncertainty. Essays in Honour of Alan Davies. Studies in Language Testing. Cambridge: Cambridge University Press, 126–136.

Brown, James Dean; Bailey, Kathleen M. 2008. Language testing courses: What are they in 2007? – Language Testing, 25 (3), 349–385. http://dx.doi.org/10.1177/0265532208090157

CEFR = Council of Europe 2001. Common European Framework of Reference for Languages: Learning, Teaching, Assessment. Cambridge: Cambridge University Press.

Davies, Alan 2008. Textbook trends in teaching language testing. – Language Testing, 25 (3), 327–349. http://dx.doi.org/10.1177/0265532208090156

European Commission 2012. First European Survey on Language Competences: Final Report. http://ec.europa.eu/languages/policy/strategic-framework/documents/language-survey-final-report_en.pdf (11.2.2014).

Figueras, Neus; North, Brian; Takala, Sauli; Verhelst, Norman; van Avermaet, Piet 2005. Relating examinations to the Common European Framework: A manual. – Language Testing, 22 (3), 261–279. http://dx.doi.org/10.1191/0265532205lt308oa

Fulcher, Glenn 2012. Assesment literacy for the language classroom. – Language Assessment Quarterly, 9 (2), 113–132. http://dx.doi.org/10.1080/15434303.2011.642041

Fulcher, Glenn; Davidson, Fred; Kemp, Jenny 2011. Effective rating scale development for speaking tests: Performance decision trees. – Language Testing, 28 (1), 5–29. http://dx.doi.org/10.1177/0265532209359514

Gümnaasiumi riiklik õppekava. [National curriculum for upper secondary schools.] RT I, 28.8.2013, 8. https://www.riigiteataja.ee/akt/128082013008 (14.2.2014).

Inbar-Lourie, Ofra 2008. Constructing a language assessment knowledge base. A focus on language assessment courses. – Language Testing, 25 (3), 385–403. http://dx.doi.org/10.1177/0265532208090158

Kecker, G.; Eckes, T. 2010. Putting the manual to the test: The test-Daf – CEFR Linking Project. – W. Martyniuk (Ed.). Relating Language Examinations to the Common European Framework of Reference for Languages: Case studies and reflections on the use of the Council of Europe’s Draft Manual. Cambridge: Cambridge University Press, 50–79.

Little, David 2005. The Common European Framework and the European Language Portfolio: Involving learners and their judgements in the assessment process. – Language Testing, 22 (3), 321–336. http://dx.doi.org/10.1191/0265532205lt311oa

Malone, Margaret E. 2008. Training in language assessment. – E. Shohamy, N. Hornberger (Eds.). Encyclopaedia of Language and Education, Vol. 7: Language Testing and Assessment. 2nd ed. New York: Springer Science and Business Media, 225–233.

Malone, Margaret E. 2013. The essentials of assessment literacy: Contrast between testers and users. – Language Testing, 30 (3), 329–344. http://dx.doi.org/10.1177/0265532213480129

Manual for Language Test Development and Examining. For use with the CEFR. Produced by ALTE on behalf of the Language Policy Division, Council of Europe 2011. Strasbourg: Council of Europe

Martyniuk, Waldemar (Ed.) 2010. Aligning Tests with the CEFR. Studies in Language Testing 33. Cambridge: Cambridge University Press.

Noijons, José; Bérešová, Jana; Breton, Gilles; Szabó, Gábor (Eds.) 2011. Relating Language Examinations to the Common European Framework of Reference for Languages: Learning, Teaching, Assessment (CEFR). Highlights from the Manual. Strasbourg: Council of Europe Publishing.

O’Sullivan, B. 2010. The City and Guilds Communicator Examination Linking Project: A brief overview with reflections on the process. – W. Martyniuk (Ed.). Relating Language Examinations to the Common European Framework of Reference for Languages: Case studies and reflections on the use of the Council of Europe’s Draft Manual. Cambridge: Cambridge University Press, 33–49.

Papageorgiou, Spiros 2010. Investigating the decision-making process of standard setting participants. – Language Testing, 27 (2), 261–282. http://dx.doi.org/10.1177/0265532209349472

Popham, William James 2009. Assessment of literacy of teachers: Faddish or fundamental? – Theory into Practice, 48 (1), 4–11. http://dx.doi.org/10.1080/00405840802577536

Reemann, Edith; Alas, Ene; Liiv, Suliko 2013. Interviewer behaviour during oral proficiency interviews: A gender perspective. – Estonian Papers in Applied Linguistics, 9, 209–227. http://dx.doi.org/10.5128/ERYa9.14

Relating Language Examinations to the Common European Framework of Reference for Languages: Learning, Teaching, Assessment (CEFR). A Manual. Strasbourg: Council of Europe, 2009.

Stiggins, Rick 1991. Assessment literacy. – The Phi Delta Kappan, 72, 534–539.

Stiggins, Rick 1997. Student-Centered Classroom Assessment. Upper Saddle River: Prentice Hall.

Takala, Sauli (Ed.) 2004. Reference Supplement to the Preliminary Version of the Manual for Relating Language Examinations to the Common European Framework of Reference for Languages: Learning, Teaching and Assessment. Strasbourg: Council of Europe.

Türk, Ülle; Tender, Tõnu 2013. Re-designing the school-leaving foreign language examinations in Estonia. – Jozef Colpaert, Mathea Simons, Ann Aerts, Margret Oberhofer (Eds.). Proceedings, “Language Testing in Europe: Time for a New Framework?”. Antwerp: University of Antwerp.




DOI: http://dx.doi.org/10.5128/ERYa10.01

Refbacks

  • There are currently no refbacks.


Copyright (c) 2014 Ene Alas, Suliko Liiv

Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

ISSN 1736-2563 (print)
ISSN 2228-0677 (online)
DOI 10.5128/ERYa.1736-2563