Document Type : Research Paper
Authors
Payame Noor University
Abstract
In recent years, a number of large-scale writing assessments (e.g., TOEFL iBT) have employed integrated writing tests to measure test takers’ academic writing ability. Using a quantitative method, the current study examined how written textual features and use of source material(s) varied across two types of text-based integrated writing tasks (i.e., listening-to-write vs. reading-to-write) and two levels of language proficiency (i.e., high vs. low). Sixty Iranian English major students were selected through purposive sampling and divided into low and high proficiency groups based on an IELTS practice test. Then, they were required to write on a listening-to-write and a reading-to-write task. Results of two-way and one-way ANOVAs revealed that firstly, variations in integrated writing tasks together with level of proficiency had a significant effect on all the generated discourse features, secondly, the two types of integrated tasks produced features that shared to a large extent, and thirdly, some features could distinguish a certain level of proficiency. In addition, the results indicated that plagiarism is higher in response to the reading-to-write task than the listening-to-write task especially among the low proficiency writers. Implications of the study are presented.
Keywords
Bachman, L.F. (1990). Fundamental considerations in language testing. Oxford: Oxford University Press.
Bachman, L.F. (2002). Some reflections on task-based language performance assessment. Language Testing, 19(4), 453‒476.
Camp, R. (1993). Changing the model for the direct writing assessment. In M. M. Williamson & B. A. Huot (Eds.).Validating holistic scoring for writing assessment: theoretical and empirical foundations (pp. 45-78). Cresskill, NJ: Hampton Press, Inc.
Chapelle, C.A. (1999).Validity in language assessment. Annual Review of Applied Linguistics, 19, 254‒272.
Cho, Y. (2003). Assessing writing: Are we bound by only one method? Assessing Writing, 8, 165–191.
Cho, Y., Rijmen, F., & Novak, J. (2013). Investigating the effects of prompt characteristics on the comparability of TOEFL iBT integrated writing tasks, Language Testing, 30, 4, 513-534.
Clapham, C. (1996).The development of IELTS: A study in the effect of background knowledge on reading comprehension. Studies in Language Testing 4. Cambridge: UCLES/Cambridge University Press.
Conrad, S. (1996). Academic discourse in two disciplines: professional writing and student development in Biology and History. Unpublished doctoral dissertation, Northern Arizona University.
Connor, U.M., & Kramer, M. G.(1995).Writing-from-sources: Case-studies of-graduate-students-in-business-management. In Diane-Belcher, George Braine-&-Diane-Dewhurst-Belcher (Eds.). Academic-writing-in-a second-language (pp. 155‒182). Norwood, NJ: Ablex-Publishing Corporation.
Corbeil, G.(2000).Exploring-the-effects-of-first-and-second-language proficiency-on-summarizing-in-French-as-a-second-language. Canadian Journal-of-Applied-Linguistics, 3, 35-62.
Cumming, A.(1989). Writing expertise and second language proficiency. Language Learning, 39, 81‒141.
Cumming, A. Grant, L., Mulcahy-Ernt, P., & Powers, D. (2004). A teacher-verification study of speaking and writing prototype tasks for a new TOEFL. Langugae Testing, 21 2, 107-145.
Cumming, A., Kantor, R., Baba, K., Erdosy, U., Eouanzoui, K., & James, M. (2005).Difference in written discourse in independent and integrated prototype tasks for next generation TOEFL. Assessing Writing, 10, 5‒43.
Cumming, A., Kantor, R. Baba, K., Erdoosy, U., Eouanzoui, K., & James, M. (2006).Analysis of discourse features and verification of scoring levels for independent and integrated tasks for the new TOEFL (TOEFL Monograph No. MS-30). Princeton, NJ: ETS.
Cumming, A., Kantor, R., Powers, D. Santos, T., & Taylor, C. (2000).TOEFL 2000 writing framework: A working paper. TOEFL Monograph Series, Report No. 18. Princeton, NJ: Educational Testing Service.
Cumming, A., Grant, L., Mulcahy-Ernt, P., & Powers, D. (2004).A teacher-verification study of speaking and writing prototype tasks for a new TOEFL. Language Testing, 21(2), 159‒197.
Cumming, A. (2013). Assessing integrated writing tasks for academic purposes: Promises and perils. Language Assessment Quarterly, 10, 1, 1-8.
Delaney, Y.A. (2008). Investigating the reading-to-write construct. Journal of English for Academic Purposes, 7, 140-150.
Educational Testing Services.(2005). Test of English as a foreign language. Retrieved April 4, 2012, from www.toefl.org.
Educational Testing Service. (2007). TOEFL iBT Tips: How to prepare for the TOEFL iBT. Princeton, NJ. Retrieved June 7, 2012 from http://www.ets.org/toefl
Enright, M., Bridgeman, B., & Cline, F. (2002, April).Prototyping-a-test-design-for-a-new-TOEFL. In-D. Eignor-(chair),-Research-in-support-of-the-development-of-new-TOEFL. Symposium-conducted-at-the-meeting-of-the-National-Council-on-Measurement-in-Education.New-Orleans.Retrieved-March-13,2010-from-http://ets.org/research/conferences/aera2002.html.
Esmaeili, H. (2002). Integrated-reading-and-writing-tasks-and-ESL-students’ reading-and-writing-performance-in-an-English-language-test. The Canadian-Modern-Language-Review, 58(4), 599-622.
Feak, C. &Dobson, B. (1996).Building on the impromptu: a source-based academic writing assessment. College ESL, 6(1), 73-84.
Gebril, A. (2006). Indpendent and Integrated academic writing tasks: A study in generalizability and test method. Unpublished doctoral dissertation, The University of Iowa, Iowa City.
Gebril, A. (2009).Score generalizability of academic writing tasks: Does one test method fit it all? Journal of Language Testing, 26(4), 507–531.
Gebril, A. &Plakans, L. (2009).Investigating source use, discourse features, and process in integrated writing tests. Spaan Fellow Working Papers in Second or Foreign Language Assessment, 7, 47-84.
Guo, L. (2011). Product and process in TOEFL iBT independent and integrated writing tasks: An investigation of construct validity. Unpublished doctoral dissertation, Georgia State University.
Hamp-Lyons, L. & Kroll, B. (1996).Issues in ESL writing assessment: an overview. College ESL, 6(1), 52-72.
Johns, A., & Mayes, P. (1990).An analysis of summary protocols of university ESL students. Applied Linguistics, 11, 253-271.
Kirkland, M., & Saunders, M. (1990).Maximizing student performance in summary writing: managing cognitive load. TESOL Quarterly, 25, 105-121.
Kim, Y. (2010). An Argument-Based Validity Inquiry into the Empirically-Derived Descriptor-Based Diagnostic (EDD) Assessment in ESL Academic Writing. Unpublished doctoral dissertation. University of Toronto.
Leki, I. & Carson, J. (1997).Completely different worlds: EAP and the writing experiences of ESL students in university courses. TESOL Quarterly, 31, 36-69.
Lewkowicz, J. (1994).Writing from sources: does source material help or hinder students’ performance? Paper presented at the Annual International Language in Education Conference, Hong Kong. [ERIC Document Reproduction Service No. ED386050].
Lewkowicz, J. (1997).The integrated testing of a second language. In C. Calpham (Ed.), Encyclopedia of language and education, Vol. 7: Language testing and assessment (pp. 121–130). Dordrecht, The Netherlands: Kluwer Academic Publishers.
Matalene, C. (1985).Contrastive rhetoric: An American writing teacher in China. College English, 47, 789–807.
Mathison, M. A. (1996).Writing the critique, a text about a text. Written Communication, 13, 314-354.
Messer, S. D. (1997).Evaluating-ESL-written-summaries:-an-investigation-of-the-ESL-Integrated-Summary-Profile-(ISP)-as- a-measure-of-the-summary-writing-ability-of-ESL-students. Unpublished-doctoral-dissertation, Florida-State-University. Tallahassee, FL.
Oller, J. W. Jr. (1979). Language tests at school: A pragmatic approach. London: Longman.
Pennycook, A. (1996).Borrowing others’ words: Text, ownership, memory and plagiarism. TESOL Quarterly, 30, 201–230.
Plakans, L. (2007). Second language writing and reading-to-write assessment tasks: a process study. Unpublished doctoral dissertation.The University of Iowa.
Plakans, L. (2008). Comparing composing processes in writing-only and reading-to-write test tasks. Assessing Writing, 13, 111-129.
Plakans, L., &Gebril, A. (2012).A Close Investigation into Source Use in Integrated Second Language Writing Tasks. Assessing Writing, 17(1), 18-34.
Read, J. (1990). Providing relevant content in an EAP writing test.English for Specific Purposes, 9, 109‒121.
Reid, J. (1990). Responding-to-different-topic-types:-a-quantitative-analysis-from-a-contrastive-rhetoric-perspective. In-B. Kroll (Ed.).Second Language-Writing:-research-insights-for-the- classroom (pp. 191-210). Cambridge: Cambridge-University-Press.
Sharpe, P. J. (2010).Barron's TOEFL iBT: Internet-based test. Hauppauge, N.Y: Barrons Educational Series, Inc.
Spearman, C. (1904). General Intelligence objectively determined and measured. The American Journal of Psychology, 15 (5), 201-292.
Spolsky, B. (1968). Language testing: The problem of validation. TESOL Quarterly, 2 (2), 88-94.
Trites, L. & McGroarty, M. (2005). Reading to learn and reading to integrate: new tasks for reading comprehension test? Language Testing, 22, 174-210.
University of Cambridge. Local Examinations Syndicate. (2000).Cambridge IELTS 2: examination papers from the University of Cambridge Local Examinations Syndicate. With answers ed. Cambridge: Cambridge University Press.
Watanabe, Y. (2001).Read-to-write tasks for the assessment of second language academic writing skills: investigating text features and rater reactions. Unpublished doctoral dissertation. University of Hawaii.
Wallace, C. (1997). IELTS: global implications of curriculum and materials design. ELT Journal, 51, 370-373.
Weigle, S.C. (2002). Assessing Writing. Cambridge: Cambridge University Press.
Weigle, S.C. (2004).Integrating reading and writing in a competency test for non-native speakers of English. Assessing Writing, 9, 27-55.
Weigle, S.C., & Parker, K. (2012).Source text borrowing in an integrated reading/writing assessment. Journal of Second Language Writing, 21(2), 118-133.
Weir, C.J. (1983).Identifying the language needs of overseas students in tertiary education in the United Kingdom. Unpublished PhD Thesis, University of London Institute of Education.
Weir, C.J. (1993).Understanding and developing language tests. Hemel, Hamstead, England: Prentice Hall.
Wesche, B. (1987).Second language performance testing: The Ontario test of ESL as an example. Language Testing, 4(1), 28‒47.
Yang, H.C. (2009).Exploring the complexity of second language writers’ strategy use and performance on an integrated writing test through structural equation modeling and qualitative approaches. Unpublished doctoral dissertation.The University of Texas at Austin.
', './data/jtls/coversheet/cover_en.jpg'))