Comparing speaking situations in three different language tests
Abstract
The purpose of this study was to compare learner outcome when five similar speaking situations were offered in the speaking subtest in Finnish, Swedish and English intermediate level tests in the Finnish National Certificates language testing system. The overall aim was to investigate the tasks by comparing learner outcomes across the three tests and to seek explanations for the outcome in the learners’ selfreported demographic, language, educational and professional background.
The speaking situations were selected from the NC item bank meaning that they have undergone the Item Response Theory based analyses which indicate that the tasks function well in all tests. More information was needed to discover possible connections between performance and background information. Performance data and background factors were analysed using descriptive frequency and percent distribution. Cross-tabulation was used to analyse connections between variables. The tasks are discussed in terms of domains and language functions and their connection with the test takers’ background information. Results indicate that though there is some variation in the learner outcomes across languages, situational tasks can be used for different languages.
DOI: http://dx.doi.org/10.5128/ERYa9.01
Keywords
Full Text:
PDFReferences
Alderson, Charles J.; Clapham, Caroline; Wall, Dianne 1995. Language Test Construction and Validation. Cambridge: Cambridge University Press.
ALTE Manual 2011 = Manual for Language Test Development and Examining. For use with the CEFR. Produced by ALTE [Association of Language Testers in Europe] on behalf of the Language Policy Division, Council of Europe, April 2011.
Bachman, Lyle F. 1990. Fundamental Considerations in Language Testing. Oxford: Oxford University Press.
Bachman, Lyle F.; Palmer, Adrian S. 1996. Language Testing in Practice: Designing and Developing Useful Language Tests. Oxford: Oxford University Press.
Bygate, Martin 1987. Speaking. Oxford: Oxford University Press.
Canale, Michael; Swain, Merrill 1980. Theoretical Bases of Communicative Approches to Second Language Teaching and Testing. Applied Linguistics 1 (1). Oxford: Oxford University Press.
CEFR 2001 = Common European Framework of Reference: Learning, Teaching, Assessment 2001. Council of Europe. Cambridge: Cambridge University Press.
Douglas, Dan 1998. Testing methods in contex-based second language research. – Lyle F. Bachman, Andrew D. Cohen (Eds.). Interfaces Between Second Language Acquistion and Language Testing Research. Cambridge: Cambridge University Press, 141–155.
Douglas, Dan 2000. Assessing Languages for Specific Purposes. Cambridge: Cambridge University Press.
Eckes, Thomas 2011. Introduction to Many-Facet Rasch Measurement: Analyzing and Evaluating Rater-Mediated Assessments. Frankfurt am Main: Peter Lang.
Gass, Susan M.; Selinker, Larry 2001. Second Language Acquisition: An Introductory Course. 2nd edition. Mahwah, NJ: Lawrence & Erlbaum Associates Inc.
Holmes, Janet 1998. Women's talk: The question of sociolinguistic universals. – Jennifer Coates (Ed.). Language and Gender: A Reader. Oxford/Malden, MA: Blackwell, 461–483.
Huhta, Ari 2010. Suullisen kielitaidon arviointi: Mitä, miten ja miksi – ja voiko Eurooppalainen viitekehys auttaa siinä? – Sabine Grasz, Joachim Schlabach, Edeltraud Sormunen, Ari Huhta (Hrsg.). QualiDaF – Qualitätssicherung, Lernziele und Beruteilungskriterien für den fachbezogenen Deutschunterricht. Jyväskylä: Jyväskylän yliopisto, Soveltavan kielentutkimuksen keskus, 31–56.
Huhta, Ari; Takala, Sauli 1999. Kielitaidon arviointi. – Kari Sajavaara, Arja Piirainen-Marsh (Toim.). Kielenoppimisen kysymyksiä. Soveltavan kielentutkimuksen teoriaa ja käytäntöä 7. Jyväskylä: Jyväskylän yliopisto, Soveltavan kielentutkimuksen keskus, 179–228.
Jantunen, Jarmo H. 2011. Kansainvälinen oppijansuomen korpus (ICLFI): typologia,taustamuuttujat ja annotointi. – Lähivõrdlusi. Lähivertailuja, 21, 86–105. http://dx.doi.org/10.5128/LV21.04
Luoma, Sari 2004. Assessing Speaking. Cambridge: Cambridge University Press. http://dx.doi.org/10.1017/CBO9780511733017
Messick, Samuel 1996. Validity and washback in language testing. – Language Testing, 13 (3), 241–256. http://dx.doi.org/10.1177/026553229601300302
O’Malley, Michael J.; Valdez Pierce, Lorraine 1996. Authentic Assessment For English Language Learners. Practical Approaches For Teachers. Addison-Wesley Longman.
Sajavaara, Kari 1999. Toisen kielen oppiminen. – Kari Sajavaara, Arja Piirainen-Marsh (Toim.). Kielenoppimisen kysymyksiä. Soveltavan kielentutkimuksen teoriaa ja käytäntöä 7. Jyväskylä: Jyväskylän yliopisto, Soveltavan kielentutkimuksen keskus, 73–102.
Shohamy, Elana 2000. Fairness in language testing. – Antony J. Kunnan (Ed.). Fairness and Validation on Language Assessment. Selected papers from the 19th Language Testing Research Colloquim, Orlando, Florida. Studies in Language Testing 9. Cambridge: Cambridge: Cambridge University Press, 15–19.
Spaan, Mary 2000. Enhancing fairness through a social contract. – Antony J. Kunnan (Ed.). Fairness and Validation on Language Assessment: Selected papers from the 19th Language Testing Research Colloquim, Orlando, Florida. Studies in Language Testing 9. Cambridge: Cambridge: Cambridge University Press, 35–38.
Suni, Minna 1996. Maahanmuuttajaoppilaiden suomen kielen taito peruskoulun päättövaiheessa. – Opetushallituksen moniste 11/1996.
Tarnanen, Mirja; Mäntylä, Katja 2006. Toisen ja vieraan kielen oppijat yleisissä kielitutkinnoissa. – Päivi Pietilä, Pekka Lintunen, Heini-Marja Järvinen (Toim.). Kielenoppija tänään – Language Learners of Today. AFinLa vuosikirja 2006. Suomen soveltavan kielitieteen yhdistyksen julkaisuja 64. Jyväskylä: Jyväskylän yliopistopaino, 105–123.
The Finnish National Board of Education and the University of Jyväskylä 2002. The Framework of the Finnish National Certificates. Helsinki: Edita Prima Oy.
The Finnish National Board of Education and the University of Jyväskylä 2011. The Framework of the Finnish National Certificates. Tampere: Tampereen yliopistopaino.
Weir, Cyrill J. 2005. Language Testing and Validation: An Evidence-Based Approach. Basingstoke: Palgrave Macmillan.
DOI: http://dx.doi.org/10.5128/ERYa9.01
Refbacks
- There are currently no refbacks.
Copyright (c) 2013 Sari Ahola, Tiina Lammervo, Reeta Neittaanmäki, Sari Ohranen, Henna Tossavainen
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
ISSN 1736-2563 (print)
ISSN 2228-0677 (online)
DOI 10.5128/ERYa.1736-2563