التأليف الرقمي متعدد الوسائط في فصول اللغة الثانية: أجندة بحثية
الملخص
لقد زاد البحث في التأليف الرقمي متعدد الوسائط (DMC) في فصول اللغة الثانية (L2) بشكل كبير في السنوات الأخيرة، إلى حد كبير استجابةً لتغير مشهد الاتصال الرقمي ومتعدد الوسائط. تقدم هذه المقالة أجندة بحثية حول DMC في فصول L2. نبدأ بنظرة عامة نظرية على منحة DMC. ثم نفحص سبعة مواضيع بحثية للاستفسار المستقبلي، والتي نستخلص منها سبعة مهام بحثية. المواضيع السبعة هي: (1) فعالية DMC في تطوير الكتابة في L2؛ (2) تصميم مهام DMC؛ (3) تعليم/تدريب معلمي L2 لتنفيذ DMC؛ (4) ممارسة التغذية الراجعة لـ DMC؛ (5) تقييم DMC؛ (6) DMC التعاوني كمساحة للتواصل اللغوي؛ و(7) نشر DMC من أجل المهارات الرقمية النقدية. على مدار المقالة، نشير إلى المنح الدراسية والأساليب متعددة التخصصات من تعددية الوسائط، وكتابة L2، ودراسات التأليف، ودراسات الأمية الجديدة، وتعليم معلمي اللغة، وتعلم اللغة بمساعدة الكمبيوتر. تمثل المهام البحثية السبعة ما نراه كخطوات أساسية لفهم DMC، وهو مجال شاب لديه إمكانات كبيرة لتعزيز تعليم اللغة والأمية في L2 في العصر الرقمي.
1. المقدمة
2. المسارات المفاهيمية للبحث في DMC
صنع المعنى متعدد الوسائط داخل وعبر الأنماط، تم اعتماد مفاهيم نظرية مثل السيميائيات المتعددة (الدمج العفوي لنظامين سيميائيين أو أكثر)، إعادة تمثيل السيميائية (الطرق المختلفة التي يتم بها إعادة تمثيل المواد/الأداء السيميائي وإعادة نسجها عبر الأنماط/الوسائط)، الميتا-خطاب البصري (الإشارات والعلامات البصرية التي تربط بين العناصر البصرية المختلفة لتلبية الاحتياجات البصرية للجماهير)، وإعادة المزج (دمج القطع الثقافية في خلطات إبداعية جديدة) من قبل العديد من الباحثين في L2 (هافنر، 2015؛ كنوبل ولانكشير، 2007؛ لي وآخرون، 2023؛ برايور وهينغست، 2010؛ توهي وداغيناي، 2015). تم اعتماد نهج وظيفي نظامي لتحليل الخطاب متعدد الوسائط (SF-MDA)، يركز على قواعد الموارد السيميائية لفهم المعاني الناتجة عن الخيارات والتركيبات السيميائية (جيويت وآخرون، 2016؛ أنسوورث، 2006)، أيضًا لتوجيه تحليل الخيارات متعددة الوسائط، والعلاقات بين الأنماط، وبناء المعاني خلال عملية DMC (شين وآخرون، 2020).
3. مواضيع البحث ومهام البحث
3.1 موضوع البحث: فعالية DMC في تطوير الكتابة في L2
نظرًا للأدلة على فوائدها في تطوير الكتابة التقليدية التي تركز على اللغة، فإن المزيد من البحث حول الفوائد اللغوية لـ DMC مطلوب. وهذا يقودنا إلى مهمة البحث الأولى، كما يلي.
استكشف الفوائد اللغوية لـ DMC من خلال دراسة فعالية DMC في تعزيز تطوير الكتابة بلغة ثانية.
3.2 موضوع البحث: تصميم مهام DMC
تطوير استراتيجيات نظرية ونماذج يمكن أن تفسر الاختلافات في تصميم مهام DMC وأطر الدعم عبر السياقات بالإضافة إلى أي قواسم مشتركة أساسية. وهذا يقودنا إلى المهمة البحثية الثانية، كما يلي.
استكشاف أبعاد تصميم مهام DMC وكيف تؤثر الأبعاد المختلفة على نتائج التعلم.
3.3 موضوع البحث: تعليم معلمي L2
& رين، 2021؛ لي، 2020). ومع ذلك، غالبًا ما أبلغ معلمو L2 عن شعورهم بعدم الاستعداد في هذا الصدد (ميلز وإكلي، 2014؛ تان وماكويليام، 2009؛ يي وأنغاي-كراودر، 2016). بالمقارنة مع العديد من الدراسات التي أجريت حول استخدام DMC لتعلم الطلاب، كانت هناك دراسات قليلة نسبيًا تناولت قضية DMC من منظور المعلمين. في الواقع، تظل خبرة المعلم بشكل عام منطقة غير مستكشفة تقريبًا في البحث عن الكتابة في L2 (هيرفيلا وبلشر، 2022؛ سويليس وفيك، 2023). درست الدراسات حول إعداد المعلمين لـ DMC كيف يمكن أن يستفيد المعلمون في الخدمة من مهام DMC المدمجة في برامج تدريب المعلمين الخاصة بهم (لي، 2020)، لكنها لم تأخذ في الاعتبار المعلمين في الخدمة وكيف يمكن أن يساعد الانخراط في DMC هؤلاء المعلمين على التعلم والتغيير وتطوير الكفاءات اللازمة لتنفيذ DMC في فصول L2. فيما يتعلق بتنفيذ DMC في فصل L2، يحتاج المعلمون إلى تطوير تقدير للحاجة والأساس المنطقي لتعليم DMC، وكفاءة تواصل متعددة الأوضاع، ووعي شبه لغوي، ومعرفة محتوى بيداغوجي سليم لـ DMC. على هذا النحو، من الضروري لفهم كيفية تطوير المعلمين في L2 للخبرة ذات الصلة، في عدد من الأبعاد. تشمل هذه الأبعاد تصورات المعلمين عن DMC، عن كفاءتهم التواصلية متعددة الأوضاع مقارنة بكفاءتهم الفعلية كما لوحظت في الممارسة الصفية، وعن قدرتهم على تنفيذ DMC مقارنة بقدرتهم الفعلية كما لوحظت في الممارسة الصفية. يقودنا هذا إلى مهمة البحث 3، كما يلي.
مهمة البحث 3
تعلم وتوليد الكفاءة متعددة الأبعاد المطلوبة في اللغة الثانية ومعرفة المحتوى التربوي لـ DMC. الدراسات التي أجريت حول تفاعل المعلمين مع DMC (جيانغ وآخرون، 2021؛ ليم وآخرون، 2022ب) واستراتيجيات المعلمين للتعامل مع تحديات استخدام DMC (جيانغ وآخرون، 2022ب؛ ليم وأونسورث، 2023) تقدم نقطة انطلاق جيدة لمزيد من البحث في هذا المجال. بحث لي (2020) حول دمج مشروعين من DMC (أي، مهمة تأمل متعددة الأبعاد متوسطة المدى ومهمة تصميم مواد تعليمية متعددة الأبعاد) في دورتين دراسيتين عبر الإنترنت لتطوير معرفة ومهارات معلمي اللغة قبل الخدمة في تدريس التربية الرقمية متعددة الأبعاد يقدم مثالاً ناجحاً على إعداد المعلمين قبل الخدمة/في الخدمة لتجاوز الفجوة بين محو الأمية التقليدية ومتعددات الأمية. وبالتالي، فإنه يقدم نموذجاً جيداً للباحثين في DMC في المستقبل. الهدف على المدى الطويل هو تقديم رؤى قيمة قائمة على السياق حول الخبرات والمهارات الأساسية المتعلقة باستخدام DMC لتأسيس نتائج تعلم مهمة لبرامج تعليم معلمي اللغة الثانية.
3.4 موضوع البحث: ممارسة التغذية الراجعة على DMC
مهمة البحث 4
كقدرة على ترتيب “الموارد المتاحة لصنع المعنى في كيان متعدد الأبعاد، واتخاذ قرارات مؤلف مناسبة لجماهير وأغراض محددة” (شين وآخرون، 2020، ص. 2). بالإضافة إلى ذلك، لفت العلماء في مجال تعددية الأبعاد الانتباه إلى الطريقة التي توفر بها الأوضاع المختلفة (اللغوية، البصرية، الإيمائية، إلخ) إمكانيات مختلفة لصنع المعنى وتتفاعل مع بعضها البعض بطرق متنوعة. تتطلب الكفاءة التواصلية متعددة الأبعاد وعياً بهذه الإمكانيات والتفاعلات وكيف تختلف هذه ضمن وبين الأوضاع والوسائط من خلال عمليات التحويل (الأفعال التي تعيد ترتيب المعاني ضمن وضع واحد) والتحويل (إعادة تنظيم المعاني عبر الأوضاع). من خلال استهداف مثل هذه الكفاءة التواصلية متعددة الأبعاد، يمكن لمعلمي اللغة الثانية تقديم تغذية راجعة أكثر تحديداً حول تواصل الطلاب ضمن وبين الأوضاع، مع الانتباه ليس فقط للقضايا اللغوية ولكن أيضاً للطريقة التي ينقل بها متعلمو اللغة الثانية المعاني عبر الأوضاع عند الضرورة.
3.5 موضوع البحث: تقييم DMC
سيكون مفيدًا، وهذا يثير قضايا متى وماذا يجب تقييمه (هافنر وهو، 2020). كما أنه لا يزال غير واضح ما هي طرق التقييم التي ستعزز التقييم الذاتي وتقييم الأقران بين الطلاب المؤلفين. أخيرًا، كانت الأدبيات تميل إلى تصوير معلمي L2 على أنهم يفتقرون إلى الاستعداد ومقاومين لتقييم DMC، مع توثيق محدود لممارسات التقييم لهؤلاء المعلمين المبتكرين الذين يدمجون أشكالًا مختلفة من DMC في فصولهم الدراسية. يمكن أن يوفر التركيز على تجربة هؤلاء المعلمين طريقًا مثمرًا لتطوير وتقييم طرق تقييم DMC المبتكرة. لمعالجة هذه الفجوات البحثية، نقترح مهمة البحث 5، كما يلي.
مهمة البحث 5
مهارة حاسمة يجب على الطلاب تطويرها ككتّاب ومؤلفين ناجحين. أخيرًا، سيركز النهج الموقعي على ممارسات المعلمين المبتكرين في السياقات الموقعة ويستكشف كيف يقيمون عمليات ومنتجات DMC. لقد ثبت أن مثل هذا النهج في تصميم البحث (مثل هافنر وهو، 2020؛ جيانغ وآخرون، 2022أ) يساعد في تقديم أدلة سياقية لتطوير نماذج تقييم قائمة على الممارسة وصديقة للمعلم لـ DMC.
3.6 موضوع البحث: DMC التعاوني كمساحة للتعدد اللغوي
لا يمكن اعتبار مشاركتهم في DMC التعاوني أمرًا مفروغًا منه. أظهرت الأبحاث السابقة (مثل Smith، 2019) أن عدم المساواة في الكفاءات الرقمية وتجارب الحياة متعددة الوسائط يمكن أن يقيّد الطلاب الذين يعانون من عوائق رقمية ولغوية إلى الحد الذي يجعلهم يساهمون قليلاً أكثر من دور مساعد خلال DMC التعاوني. على الرغم من أن الدراسات (مثل Cummins وآخرون، 2015) قد كشفت عن إمكانيات تأليف نصوص الهوية للتحقق من مهارات القراءة والكتابة المنزلية للمهاجرين الشباب وتمكين مشاركتهم في الفصل الدراسي، لم يتم إيلاء اهتمام كبير لكيفية تعاونهم مع الطلاب الرئيسيين خلال عملية التأليف متعدد الوسائط والآثار ذات الصلة على العدالة التعليمية (Cope & Kalantzis، 2023). في مساحة الترجمة اللغوية التي تم إنشاؤها بواسطة DMC التعاوني، من المهم إذن أن نسأل من يتعاون مع من ولماذا، من يستفيد أكثر، وكيف تشكل ممارسات التعاون المتنوعة فرص التعلم المختلفة (Smith وآخرون، 2022). لتمكين الطلاب المحرومين والمهمشين من تجاوز الأدوار المساعدة وفهم كيف يستخدم الطلاب الموارد متعددة الوسائط أثناء تعاونهم/تفاعلهم مع بعضهم البعض، هناك حاجة إلى مزيد من الأبحاث حول DMC التعاوني كمساحة ترجمة لغوية. وهذا يقودنا إلى مهمة البحث 6، كما يلي.
مهمة البحث 6
تم تتبع أنماط تعاونهم عبر مشاريع DMC المختلفة على مر الزمن. ستساعد هذه المعلومات في إلقاء الضوء على قوة DMC التعاوني كمساحة ترجمة لغوية لتمكين مجموعات متنوعة من متعلمي اللغة الثانية.
3.7 موضوع البحث: نشر DMC من أجل مهارات القراءة والكتابة الرقمية الحرجة
مهمة البحث 7
استجواب العالم، وتنفيذ المشاركة المدنية من أجل تحسين المجتمعات والعدالة الاجتماعية” (جيانغ وغو، 2022، ص. 1030). مع هذا الفهم التشغيلي، يمكن تحديد دور DMC في تعزيز تعلم وتطوير المهارات الرقمية النقدية من خلال الأفعال الموجهة نحو العدالة في إنشاء/تأليف نصوص رقمية متعددة الوسائط. علاوة على ذلك، نظرًا لزيادة المراقبة عبر الإنترنت وقوة المؤثرين عبر الإنترنت، من الضروري التحقيق في كيفية مساعدة DMC للمتعلمين على مقاومة، وإذا أمكن، تحويل الممارسات التلاعبية والاستغلالية في الخطابات والمساحات عبر الإنترنت (دارفين، 2023).
4. الخاتمة
المجال الواعد إلى الأمام والمساعدة في تشكيل التضاريس والمسار لأبحاث DMC في فصول اللغة الثانية المتنوعة بشكل متزايد.
References
Amgott, N. (2018). Critical literacy in #DigitalActivism: Collaborative choice and action. The International Journal of Information and Learning Technology, 35(5), 329-341. doi:10.1108/IJILT-05-2018-0060
Belcher, D. D. (2017). On becoming facilitators of multimodal composing and digital design. Journal of Second Language Writing, 38, 80-85. doi:10.1016/j.jswl.2017.10.004
Burns, A. (1999). Collaborative action research for English language teachers. Cambridge University Press.
Caws, C., & Heift, T. (2016). Evaluation in CALL: Tools, interactions, outcomes. In F. Farr, & L. Murray (Eds.), The Routledge handbook of language learning and technology (pp. 127-140). Routledge.
Cho, H., & Kim, Y. (2021) Comparing the characteristics of EFL students’ multimodal composing and traditional monomodal writing: The case of a reading-to-write task. Language Teaching Research. Advance online publication. doi:10.1177/ 13621688211046740
Cope, B., & Kalantzis, M. (2023). Towards education justice: The multiliteracies project revisited. In G. C. Zapata, M. Kalantzis, & B. Cope (Eds.), Multiliteracies in international educational contexts: Towards education justice. Multiliteracies and second language education (pp. 9-42). Routledge.
Creswell, J. W. (2007). Qualitative inquiry & research design: Choosing among five approaches (2nd ed.). Sage Publications.
Cummins, J., Hu, S., Markus, P., & Kristiina Montero, M. (2015). Identity texts and academic achievement: Connecting the dots in multilingual school contexts. TESOL Quarterly, 49(3), 555-581. doi:10.1002/tesq. 241
D’Angelo, L. (2016). Academic posters: A textual and visual metadiscourse analysis. Peter Lang.
Darvin, R. (2017). Social class and the inequality of English speakers in a globalized world. Journal of English as a Lingua Franca, 6(2), 287-311. doi:10.1515/jelf-2017-0014
Darvin, R. (2023). Sociotechnical structures, materialist semiotics, and online language learning. Language Learning & Technology, 27(2), 28-45. doi:10125/73502
Darvin, R., & Hafner, C. A. (2022). Digital literacies in TESOL: Mapping out the terrain. TESOL Quarterly, 56(3), 865-882. doi:10.1002/tesq. 3161
Darvin, R., & Norton, B. (2015). Identity and a model of investment in applied linguistics. Annual Review of Applied Linguistics, 35, 36-56. doi:10.1017/S0267190514000191
Darvin, R., & Zhang, Y. (2023). Words that don’t translate: Investing in decolonizing practices through translanguaging. Language Awareness, 32(4), 645-661. doi:10.1080/09658416.2023.2238595
DePalma, M.-J., & Ringer, J. M. (2011). Toward a theory of adaptive transfer: Expanding disciplinary discussions of “transfer” in second-language writing and composition studies. Journal of Second Language Writing, 20(2), 134-147. doi:10.1016/ j.jslw.2011.02.003
Dzekoe, R. (2017). Computer-based multimodal composing activities, self-revision, and L2 acquisition through writing. Language Learning & Technology, 21(2), 73-95. doi:10125/44612
Earl, L. (2003). Assessment as learning: Using classroom assessment to maximize student learning. Corwin Press.
Early, M., Kendrick, M., & Potts, D. (2015). Multimodality: Out from the margins of English language teaching. TESOL Quarterly, 49(3), 447-460. doi:10.1002/tesq. 246
Elola, I., & Oskoz, A. (2022). Reexamining feedback on L2 digital writing. Studies in Second Language Learning and Teaching, 12(4), 575-595. doi:10.14746/ssllt.2022.12.4.3
Flower, L., & Hayes, J. R. (1981). A cognitive process theory of writing. College Composition and Communication, 32(4), 365-387. doi:10.2307/356600
Gee, J. (2010). A situated-sociocultural approach to literacy and technology. In E. A. Baker (Ed.), The new literacies: Multiple perspectives on research and practice (pp. 165-193). The Guilford Press.
Gilje,
Grapin, S. (2019). Multimodality in the new content standards era: Implications for English learners. TESOL Quarterly, 53(1), 30-55. doi:10.1002/tesq. 443
Hafner, C. (2014). Embedding digital literacies in English language teaching: Students’ digital video projects as multimodal ensembles. TESOL Quarterly, 48(4), 655-685. doi:10.1002/tesq. 138
Hafner, C., & Miller, L. (2019). English in the disciplines: A multidimensional model for ESP course design. Routledge.
Hafner, C. A. (2013). Digital composition in a second or foreign language. TESOL Quarterly, 47(4), 830-834. doi:10.1002/ tesq. 135.
Hafner, C. A. (2015). Remix culture and English language teaching: The expression of learner voice in digital multimodal compositions. TESOL Quarterly, 49(3), 486-509. doi:10.1002/tesq. 238
Hafner, C. A., Chik, A., & Jones, R. H. (2013). Engaging with digital literacies in TESOL. TESOL Quarterly, 47(3), 812-815. doi:10.1002/tesq. 136
Hafner, C. A., Harrison, S., Ho, J., & Kwan, B. (2023). Digital mediation in ESP genres. English for Specific Purposes, 71(3), 115-122. doi:10.1016/j.esp.2023.03.002
Hafner, C. A., & Ho, W. Y. J. (2020). Assessing digital multimodal composing in second language writing: Towards a processbased model. Journal of Second Language Writing, 47(2), 100710. doi:10.1016/j.jslw.2020.100710
Hatano, G., & Inagaki, K. (1986). Two courses of expertise. In H. Azuma & K. Hakuta (Eds.), Child development in Japan (pp. 262-272). W.H.Freeman.
He, P., & Lin, A. (2023). Dynamic flows of translanguaging/trans-semiotizing in CLIL eco-social systems. Language Awareness. doi:10.1080/09658416.2023.2234824
Hirvela, A., & Belcher, D. (2022). Expertise in L2 writing instruction: The road less travelled. Journal of Second Language Writing, 58(8), 100936. doi:10.1016/j.jslw.2022.100936
Ho, W. Y. J. (2022). The construction of translanguaging space through digital multimodal composing: A case study of students’ creation of instructional videos. Journal of English for Academic Purposes, 58, 101134. doi:10.1016/ j.jeap.2022.101134
Huang, S.-y. (2019). EFL learners’ critical multimodal reflections on the politics of English. TESOL Journal, 10(3), e00435. doi:10.1002/tesj. 435
Hull, A., & Nelson, M. E. (2005). Locating the semiotic power of multimodality. Written Communication, 22(2), 224-261. doi:10.1177/0741088304274170
Jewitt, C., Bezemer, J., & O’Halloran, K. (2016). Introducing multimodality. Routledge.
Jewitt, C., & Kress, G. (2003). Multimodal literacy. Peter Lang.
Jiang, L. (2021). Facilitating EFL students’ civic participation through digital multimodal composing. Language, Culture and Curriculum, 35(1), 102-117. doi:10.1080/07908318.2021.1942032
Jiang, L. (2023). Multilingual youths’ digital activism through multimodal composing in the post-pandemic era. Journal of Multilingual and Multicultural Development. Advance online publication. doi:10.1080/01434632.2023.2181353
Jiang, L., & Gu, M. M. (2022). Toward a professional development model for critical digital literacies in TESOL. TESOL Quarterly, 56(3), 1029-1040. doi:10.1002/tesq. 3138
Jiang, L., Li, Z., & Leung, J. S.C. (2024). Digital multimodal composing as translanguaging assessment in CLIL classrooms. Learning and Instruction, 92, 101900. doi:10.1016/j.learninstruc.2024.101900
Jiang, L., & Luk, J. (2016). Multimodal composing as a learning activity in English classrooms: Inquiring into the sources of its motivational capacity. System, 59, 1-11. doi:10.1016/j.system.2016.04.001
Jiang, L., & Ren, W. (2021). Digital multimodal composing in L2 learning: Ideologies and impact. Journal of Language, Identity & Education, 20(3), 167-182. doi:10.1080/15348458.2020.1753192
Jiang, L., Yang, M., & Yu, S. (2020). Chinese ethnic minority students’ investment in English learning empowered by digital multimodal composing. TESOL Quarterly, 54(4), 954-979. doi:10.1002/tesq. 566
Jiang, L., Yu, S., & Lee, I. (2022a). Developing a genre-based model for assessing digital multimodal composing in second language writing: Integrating theory with practice. Journal of Second Language Writing, 57, 100869. doi:10.1016/ j.jslw.2022.100869
Jiang, L., Yu, S., & Zhao, Y. (2022b). Incorporating digital multimodal composing through collaborative action research: Challenges and coping strategies. Technology, Pedagogy and Education, 31(1), 45-61. doi:10.1080/1475939X.2021.1978534
Jiang, L. J. (2017). The affordances of digital multimodal composing for EFL learning. ELT Journal, 71(4), 413-422. doi:10.1093/elt/ccw098
Jones, R., & Hafner, C. A. (2021). Understanding digital literacies: A practical introduction. Routledge.
Kang, J. (2022). Transfer of knowledge across genres and media: Investigating L2 learners’ multiple composing practices. Journal of English for Academic Purposes, 56, 101096. doi:10.1016/j.jeap.2022.101096
Kellner, D., & Share, J. (2005). Toward critical media literacy: Core concepts, debates, organizations, and policy. Discourse: Studies in the Cultural Politics of Education, 26(3), 369-386. doi:10.1080/01596300500200169
Kendrick, M., Early, M., Michalovich, A., & Mangat, M. (2022). Digital storytelling with youth from refugee backgrounds: Possibilities for language and digital literacy learning. TESOL Quarterly, 56(3), 961-984. doi:10.1002/tesq. 3146
Kim, Y., Belcher, D., & Peyton, C. (2023). Comparing monomodal traditional writing and digital multimodal composing in EAP classrooms: Linguistic performance and writing development. Journal of English for Academic Purposes, 64, 101247. doi:10.1016/j.jeap.2023.101247
Kim, Y., Kang, S., Nam, Y., & Skalicky, S. (2022). Peer interaction, writing proficiency, and the quality of collaborative digital multimodal composing task: Comparing guided and unguided planning. System, 106, 102722. doi:10.1016/j.system.2022. 102722.
Krashen, S. D. (1981). Second language acquisition and second language learning. Pergamon.
Kress, G. (2010). Multimodality: A social semiotic approach to contemporary communication. Routledge.
Lankshear, C., & Knobel, M. (2006). New literacies: Everyday practices and classroom learning (2nd ed.). Open University Press.
Lantolf, J. P., & Thorne, S. L. (2006). Sociocultural theory and the genesis of second language development. Oxford University Press.
Lee, E. (2023). Writing toward a decolonial option: A bilingual student’s multimodal composing as a site of translingual activism and justice. Written Communication, 40(1), 59-89. doi:10.1177/07410883221134640
Lee, I., & Yuan, R. (2021). Understanding L2 writing teacher expertise. Journal of Second Language Writing, 52, 100755. doi:10.1016/j.jslw.2020.100755
Li, M. (2020). Multimodal pedagogy in TESOL teacher education: Students’ perspectives. System, 94, 102337. doi:10.1016/ j.system.2020.102337
Li, M., Gibbons, J., & Pham, Q. (2023). Re-exploring writer-reader interaction: Analyzing metadiscourse in EAP students’ infographics. Journal of English for Academic Purposes, 66, 101303. doi:10.1016/j.jeap.2023.101303
Li, M., & Storch, N. (2017). Second language writing in the age of CMC: Affordances, multimodality, and collaboration. Journal of Second Language Writing, 36, 1-5. doi:10.1016/j.jslw.2017.05.012
Li, M., & Zhang, M. (2023). Collaborative writing in L2 classrooms: A research agenda. Language Teaching, 56(1), 94-112. doi:10.1017/S0261444821000318
Li, W. (2011). Multilinguality, multimodality, and multicompetence: Code- and modeswitching by minority ethnic children in complementary schools. Modern Language Journal, 95(3), 370-384. doi:10.1111/j.1540-4781.2011.01209.x
Li, W. (2014). Who’s teaching whom? Co-learning in multilingual classrooms. In S. May (Ed.), The multilingual turn: Implications for SLA, TESOL, and bilingual education (pp. 167-190). Routledge.
Li, W. (2018). Translanguaging as a practical theory of language. Applied Linguistics, 39(1), 9-30. doi:10.1093/applin/amx039
Liang, W. J., & Lim, F. V. (2021) A pedagogical framework for digital multimodal composing in the English language classroom. Innovation in Language Learning and Teaching, 15(4), 306-320. doi:10.1080/17501229.2020.1800709
Lim, F. V., Chia, A., & Nguyen, T. T. H. (2022a). “From the beginning, I think it was a stretch” – Teachers’ perceptions and practices in teaching multiliteracies. English Teaching: Practice & Critique, 21(4), 379-396. doi:10.1108/ ETPC-04-2021-0025
Lim, F. V., & Toh, W. (2020). Children’s digital multimodal composing: Implications for learning and teaching. Learning, Media and Technology, 45(4), 422-432. doi:10.1080/17439884.2020.1823410
Lim, F. V., Toh, W., & Nguyen, T. T. H. (2022b). Multimodality in the English language classroom: A systematic review of literature. Linguistics and Education, 69, 101048. doi:10.1016/j.linged.2022.101048
Lim, F. V., & Unsworth, L. (2023). Multimodal composing in the English classroom: Recontextualising the curriculum to learning. English in Education, 57(2), 102-119. doi:10.1080/04250494.2023.2187696
Lim, J., & Kessler, M. (2022). Directions for future research on SLA, L2 writing, and multimodality. In R. Manchón, & C. Polio (Eds.), The Routledge handbook of second language acquisition and writing (pp. 300-314). Routledge.
Lim, J., & Polio, C. (2020). Multimodal assignments in higher education: Implications for multimodal writing tasks for L2 writers. Journal of Second Language Writing, 47, 100713. doi:10.1016/j.jslw.2020.100713
Lin, A. (2019). Theories of trans/languaging and trans-semiotizing: Implications for content-based education classrooms. International Journal of Bilingual Education and Bilingualism, 22(1), 5-16. doi:10.1080/13670050.2018.1515175
Manchón, R. M. (2017). The potential impact of multimodal composition on language learning. Journal of Second Language Writing, 38, 94-95. doi:10.1016/j.jslw.2017.10.008
Mendoza, A., Hamman-Ortiz, L., Tian, Z., Rajendram, S., Tai, K. W. H., Ho, W. Y. J., & Sah, P. K. (2023). Sustaining critical approaches to translanguaging in education: A contextual framework. TESOL Quarterly. Advance online publication. doi:10.1002/tesq. 3240
Mirra, N., & Garcia, A. (2020). “I hesitate but I do have hope”: Youth speculative civic literacies for troubled times. Harvard Educational Review, 90(2), 295-321. doi:10.17763/1943-5045-90.2.295
Nelson, M. E. (2006). Mode, meaning, and synaesthesia in multimedia L2 writing. Language Learning & Technology, 10(2), 56-76. doi:10125/44061
New London Group. (1996). A pedagogy of multiliteracies: Designing social futures. Harvard Educational Review, 66(1), 60-92. doi:10.17763/haer.66.1.17370n67v22j160u
Norton, B. (2013). Identity and language learning: Extending the conversation (2nd ed.). Multilingual Matters.
Oskoz, A., & Elola, I. (2020). Digital literacies for writing in the 21st century FL classroom. Equinox.
Pacheco, M. B., Smith, B. E., Deig, A., & Amgott, N. A. (2021). Scaffolding multimodal composition with emergent bilingual students. Journal of Literacy Research, 53(2), 149-173. doi:10.1177/1086296
Pangrazio, L. (2016). Reconceptualising critical digital literacy. Discourse: Studies in the Cultural Politics of Education, 37(2), 163-174. doi: 10.1080/01596306.2014.942836
Pham, Q. N., & Li, M. (2022). Digital multimodal composing using visme: EFL students’ perspectives. The Asia-Pacific Education Researcher, 32, 695-706. doi:10.1007/s40299-022-00687-w
Prasad, G., & Lory, M.-P. (2020). Linguistic and cultural collaboration in schools: Reconciling majority and minoritized language users. TESOL Quarterly, 54(4), 797-822. doi:10.1002/tesq. 560
Prior, P. A., & Hengst, J. A. (2010). Introduction: Exploring semiotic remediation. In P. A. Prior & J. A. Hengst (Eds.), Exploring semiotic remediation as discourse practice (pp. 1-23). Palgrave Macmillan. doi:10.1057/9780230250628_1
Qu, W. (2017). For L2 writers, it is always the problem of the language. Journal of Second Language Writing, 38, 92-93. doi:10.1016/j.jslw.2017.10.007
Schmidt, R. (1990). The role of consciousness in second language learning. Applied Linguistics, 11(2), 17-46. doi:10.1093/ applin/11.2.129
Shin, D., & Cimasko, T. (2008). Multimodal composition in a college ESL class: New tools, traditional norms. Computers and Composition, 25(4), 376-395. doi:10.1016/j.compcom.2008.07.001
Shin, D., Cimasko, T., & Yi, Y. (2020). Development of metalanguage for multimodal composing: A case study of an L2 writer’s design of multimedia texts. Journal of Second Language Writing, 47, 100714. doi:10.1016/j.jslw.2020.100714
Smith, B. E. (2019). Collaborative multimodal composing: Tracing the unique partnerships of three pairs of adolescents composing across three digital projects. Literacy, 53(1), 14-21. doi:10.1111/lit.12153
Smith, B. E., Amgott, N., & Malova, I. (2022). “It made me think in a different way”: Bilingual students’ perspectives on multimodal composing in the English language arts classroom. TESOL Quarterly, 56(2), 525-551. doi:10.1002/ tesq. 3064
Smith, B. E., Pacheco, M. B., & Khorosheva, M. (2020). Emergent bilingual students and digital multimodal composition: A systematic review of research in secondary classrooms. Reading Research Quarterly, 56(1), 33-52. doi:10.1002/rrq. 298
Storch, N. (2011). Collaborative writing in L2 contexts: Processes, outcomes, and future directions. Annual Review of Applied Linguistics, 31, 275-288. doi:10.1017/S0267190511000079
Street, B. (1984). Literacy in theory and practice. Cambridge University Press.
Swain, M., & Lapkin, S. (1995). Problems in output and the cognitive processes they generate: A step towards second language learning. Applied Linguistics, 16(3), 371-391. doi:10.1093/applin/16.3.371
Swain, M., & Lapkin, S. (1998). Interaction and second language learning: Two adolescent French immersion students working together. Modern Language Journal, 82(3), 320-337. doi:10.1111/j.1540-4781.1998.tb01209.x
Swales, J. M., & Feak, C. B. (2023). Task evolution in English for academic purposes writing materials: The case of “information transfer” to “critical commentary”. Journal of Second Language Writing, 61, 101017. doi:10.1016/j.jslw.2023.101017
Tan, J. P. L., & McWilliam, E. (2009). From literacy to multiliteracies: Diverse learners and pedagogical practice. Pedagogies: An International Journal, 4(3), 213-225. doi:10.1080/15544800903076119
Tan, X. (2023). Stories behind the scenes: L2 students’ cognitive processes of multimodal composing and traditional writing. Journal of Second Language Writing, 59, 100958. doi:10.1016/j.jslw.2022.100958
Toohey, K., & Dagenais, D. (2015). Videomaking as sociomaterial assemblage. Language and Education, 29(4), 302-316. doi:10.1080/09500782.2015.1006643
Tour, E. (2015). Digital mindsets: Teachers’ technology use in personal life and teaching. Language Learning & Technology, 19(3), 124-139. doi:10125/44437
Towndrow, P. A., Nelson, M. E., & Yusuf, W. F. B. M. (2013). Squaring literacy assessment with multimodal design: An analytic case for semiotic awareness. Journal of Literacy Research, 45(4), 327-355. doi:10.1177/1086296X13504155
Unsworth, L. (2006). Towards a metalanguage for multiliteracies education: Describing the meaning-making resources of language-image interaction. English Teaching-Practice and Critique, 5(1), 55-76.
Vandommele, G., Van den Branden, K., Van Gorp, K., & De Maeyer, S. (2017). In-school and out-of-school multimodal writing as an L2 writing resource for beginner learners of Dutch. Journal of Second Language Writing, 36, 23-36. https://doi.org/10.1016/j.jslw.2017.05.010
Weninger, C. (2023). Digital literacy as ideological practice. ELT Journal, 77(2), 197-206. doi:10.1093/elt/ccad001
Williams, D. (2009). Assessment for learning: Why, what and how? Institute of Education, University of London.
Xu, F., & Matsuda, P. K. (2017). Disciplinary dialogues section: Perspectives on multimodal composition. Journal of Second Language Writing, 38, 79. doi:10.1016/j.jslw.2017.10.006
Xu, Y. (2021). Investigating the effects of digital multimodal composing on Chinese EFL learners’ writing performance: A quasi-experimental study. Computer Assisted Language Learning, 36(4), 785-805. doi:10.1080/09588221.2021.1945635
Yi, Y. (2017). Establishing multimodal literacy research in the field of L2 writing: Let’s move the field forward. Journal of Second Language Writing, 38, 90-91. doi:10.1016/j.jslw.2017.10.010
Yi, Y., & Angay-Crowder, T. (2016). Multimodal pedagogies for teacher education in TESOL. TESOL Quarterly, 50(4), 988-998. doi:10.1002/tesq. 326
Yi, Y., Shin, B. S., & Cimasko, T. (2020). Special issue: Multimodal composing in multilingual learning and teaching contexts. Journal of Second Language Writing, 47, 100717. doi:10.1016/j.jslw.2020.100717
Yin, R. K. (2009). Case study research: Design and methods (4th ed.). Sage.
Zhang, M., Akoto, M., & Li, M. (2023). Digital multimodal composing in post-secondary L2 settings: A review of the empirical landscape. Computer Assisted Language Learning, 36(4), 694-721. doi:10.1080/09588221.2021.1942068
- © The Author(s), 2024. Published by Cambridge University Press. This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
DOI: https://doi.org/10.1017/s0261444824000107
Publication Date: 2024-05-03
Digital multimodal composing in L2 classrooms: A research agenda
Abstract
Research on digital multimodal composing (DMC) in second language (L2) classrooms has proliferated considerably in recent years, to a large extent in response to the changing digital and multimodal communication landscape. This article offers a research agenda on DMC in L2 classrooms. We begin with a theoretically oriented overview of DMC scholarship. We then examine seven research themes for future research inquiry, from which we draw seven research tasks. The seven themes are: (1) the effectiveness of DMC for L2 writing development; (2) DMC task design; (3) L2 teacher education/training for implementing DMC; (4) feedback practice for DMC; (5) DMC assessment; (6) collaborative DMC as a translanguaging space; and (7) the deployment of DMC for critical digital literacies. Throughout the article, we refer to interdisciplinary scholarship and methods from multimodality, L2 writing, composition studies, new literacy studies, language teacher education, and computer-assisted language learning. The seven research tasks represent what we see as the essential next steps for understanding DMC, which is a young domain that has great potential to advance L2 language and literacy education in the digital age.
1. Introduction
2. Conceptual trajectories for researching DMC
multimodal meaning-making within and across modes, theoretical constructs such as poly-semiotics (the spontaneous combination of two or more semiotic systems), semiotic remediation (the various ways that semiotic performances/materials are re-represented and rewoven across modes/media), visual metadiscourse (the visual cues and markers that connect various visual elements to meet the visual needs of audiences), and remixing (the combination of cultural artefacts into new creative blends) have been adopted by various L2 scholars (Hafner, 2015; Knobel & Lankshear, 2007; Li et al., 2023; Prior & Hengst, 2010; Toohey & Dagenais, 2015). A systemic functional approach to multimodal discourse analysis (SF-MDA), focusing on the grammars of semiotic resources to understand meanings arising from semiotic choices and combinations (Jewitt et al., 2016; Unsworth, 2006), has also been adopted to guide the analysis of multimodal choices, intermodal relations, and meaning constructions during the process of DMC (Shin et al., 2020).
3. Research themes and research tasks
3.1 Research theme: Effectiveness of DMC for L2 writing development
evidence of its benefits for traditional, language-focused writing development, more research on the linguistic benefits of DMC is warranted. This leads us to the first research task, as follows.
Explore the linguistic benefits of DMC by examining the effectiveness of DMC in promoting L2 writing development.
3.2 Research theme: DMC task design
develop theoretical heuristics and models that can explain differences in DMC task designs and scaffolding frameworks across contexts as well as any foundational commonalities. This leads us to the second research task, as follows.
Explore the dimensions of DMC task design and how different dimensions affect learning outcomes.
3.3 Research theme: L2 teacher education
& Ren, 2021; Li, 2020). However, L2 teachers have often reported a perception of being underprepared in this respect (Mills & Exley, 2014; Tan & McWilliam, 2009; Yi & Angay-Crowder, 2016). In contrast with the many studies that have been conducted on the use of DMC for student learning, relatively few studies have attended to the issue of DMC from the teachers’ perspective. Indeed, teacher expertise in general remains almost uncharted terrain in research on L2 writing (Hirvela & Belcher, 2022; Swales & Feak, 2023). Studies on teacher preparation for DMC have examined how pre-service teachers can benefit from DMC assignments that are integrated into their teacher training programmes (Li, 2020), but they have not considered in-service teachers and how engaging with DMC might help such teachers to learn, change, and develop the competences needed to implement DMC in L2 classrooms. With respect to the implementation of DMC in the L2 classroom, teachers need to develop an appreciation of the need and rationale for DMC instruction, sound multimodal communicative competence and semiotic awareness, and sound DMC pedagogical content knowledge. As such, to better prepare L2 teachers to use DMC effectively as an instructional strategy, it is necessary to understand how they develop the relevant expertise, in a number of dimensions. These dimensions include teachers’ perceptions of DMC, of their own multimodal communicative competence compared with their actual competence as observed in classroom practice, and of their ability to implement DMC compared with their actual ability as observed in classroom practice. This leads us to research task 3, as follows.
Research task 3
learning and engender the desired multimodal L2 competence and DMC pedagogical content knowledge. Studies that have been conducted on teacher engagement with DMC (Jiang et al., 2021; Lim et al., 2022b) and on teacher strategies to cope with the challenges of using DMC (Jiang et al., 2022b; Lim & Unsworth, 2023) offer a good starting point for further research along this line. Li’s (2020) research on incorporating two DMC projects (i.e., a mid-term multimodal reflection assignment and a multimodal instructional material design task) in two online graduate courses to develop preservice language teachers’ knowledge and skills of digital multimodal pedagogy presents a successful example of preparing pre-/in-service teachers to cross the gap between traditional literacy and multiliteracies. It thus offers a good model for future DMC researchers. Altogether the long-term goal is to provide valuable context-based insights into the essential expertise and competences in relation to DMC use to establish important learning outcomes of L2 teacher education programmes.
3.4 Research theme: Feedback practice on DMC
Research task 4
competence as the ability to arrange “available meaning-making resources into a multimodal whole, making authorial decisions appropriately for specific audiences and purposes” (Shin et al., 2020, p. 2). In addition, scholars of multimodality have drawn attention to the way that different modes (linguistic, visual, gestural, etc.) provide different affordances for meaning-making and interact with each other in a range of ways. Multimodal communicative competence entails an awareness of such affordances and interactions and of how these vary within and across modes and media through processes of transformation (the actions that reorder meanings within one mode) and transduction (the reorganisation of meanings across modes). By targeting such a multimodal communicative competence, L2 teachers can give more specific feedback on students’ communication within and across modes, attending not only to linguistic issues but also to the way that L2 learners shift meanings across modes when necessary.
3.5 Research theme: DMC assessment
would be beneficial, and this raises issues of when and what to assess (Hafner & Ho, 2020). It also remains unclear what assessment methods would promote self-assessment and peer assessment among student composers. Finally, the literature has tended to portray L2 teachers as mostly lacking preparedness and resistant to assessing DMC, with rather limited documentation of the assessment practices of those innovative teachers who are integrating various forms of DMC into their classrooms. Focusing on the experience of these teachers could provide a fruitful avenue for developing and evaluating innovative DMC assessment methods. To address these research gaps, we suggest research task 5, as follows.
Research task 5
a crucial skill for students to develop as successful writers and composers. Finally, a situated approach would focus on the practices of innovative L2 teachers in situated contexts and explore how they assess the processes and products of DMC. Such an approach to research design has been proven in earlier studies (e.g. Hafner & Ho, 2020; Jiang et al., 2022a) to help in offering contextualised evidence for the development of practice-based and teacher-friendly assessment models for DMC.
3.6 Research theme: Collaborative DMC as a translanguaging space
participation in collaborative DMC cannot be taken for granted. Previous research (e.g. Smith, 2019) has shown that inequalities in digital competences and multimodal life experiences can constrain digitally and linguistically disadvantaged students to the extent that they contribute little more than an assistive role during collaborative DMC. Although studies (e.g. Cummins et al., 2015) have revealed the potential of composing identity texts to validate the home literacies of young immigrants and empowering their classroom participation, little attention has been paid to how they collaborate with mainstream students during the process of multimodal composing and the pertinent implications for education justice (Cope & Kalantzis, 2023). In the translanguaging space constructed by collaborative DMC, it is therefore important to ask who collaborates with whom and why, who benefits the most, and how varied collaboration practices shape different learning opportunities (Smith et al., 2022). To empower disadvantaged and marginalised students to go beyond assistive roles and to understand how students use multimodal resources as they collaborate/interact with each other, more research on collaborative DMC as a translanguaging space is warranted. This leads us to research task 6, as follows.
Research task 6
their collaboration patterns were traced across various DMC projects over time. Such information would help to illuminate the power of collaborative DMC as a translanguaging space to empower diverse groups of L2 learners.
3.7 Research theme: Deployment of DMC for critical digital literacies
Research task 7
interrogate the world, and enact civic participation for the betterment of communities and social equity” (Jiang & Gu, 2022, p. 1030). With this operationalised understanding, the role of DMC in promoting the learning and development of critical digital literacies can be specified through equity-oriented actions of creating/authoring digital multimodal texts. Furthermore, considering increased online surveillance and the power of online influencers, it is imperative to investigate how DMC can help empower learners to resist and, if possible, transform manipulative and exploitative practices in online discourses and spaces (Darvin, 2023).
4. Conclusion
promising area forward and helping to frame the terrain and trajectory of DMC research in increasingly diverse L2 classrooms.
References
Amgott, N. (2018). Critical literacy in #DigitalActivism: Collaborative choice and action. The International Journal of Information and Learning Technology, 35(5), 329-341. doi:10.1108/IJILT-05-2018-0060
Belcher, D. D. (2017). On becoming facilitators of multimodal composing and digital design. Journal of Second Language Writing, 38, 80-85. doi:10.1016/j.jswl.2017.10.004
Burns, A. (1999). Collaborative action research for English language teachers. Cambridge University Press.
Caws, C., & Heift, T. (2016). Evaluation in CALL: Tools, interactions, outcomes. In F. Farr, & L. Murray (Eds.), The Routledge handbook of language learning and technology (pp. 127-140). Routledge.
Cho, H., & Kim, Y. (2021) Comparing the characteristics of EFL students’ multimodal composing and traditional monomodal writing: The case of a reading-to-write task. Language Teaching Research. Advance online publication. doi:10.1177/ 13621688211046740
Cope, B., & Kalantzis, M. (2023). Towards education justice: The multiliteracies project revisited. In G. C. Zapata, M. Kalantzis, & B. Cope (Eds.), Multiliteracies in international educational contexts: Towards education justice. Multiliteracies and second language education (pp. 9-42). Routledge.
Creswell, J. W. (2007). Qualitative inquiry & research design: Choosing among five approaches (2nd ed.). Sage Publications.
Cummins, J., Hu, S., Markus, P., & Kristiina Montero, M. (2015). Identity texts and academic achievement: Connecting the dots in multilingual school contexts. TESOL Quarterly, 49(3), 555-581. doi:10.1002/tesq. 241
D’Angelo, L. (2016). Academic posters: A textual and visual metadiscourse analysis. Peter Lang.
Darvin, R. (2017). Social class and the inequality of English speakers in a globalized world. Journal of English as a Lingua Franca, 6(2), 287-311. doi:10.1515/jelf-2017-0014
Darvin, R. (2023). Sociotechnical structures, materialist semiotics, and online language learning. Language Learning & Technology, 27(2), 28-45. doi:10125/73502
Darvin, R., & Hafner, C. A. (2022). Digital literacies in TESOL: Mapping out the terrain. TESOL Quarterly, 56(3), 865-882. doi:10.1002/tesq. 3161
Darvin, R., & Norton, B. (2015). Identity and a model of investment in applied linguistics. Annual Review of Applied Linguistics, 35, 36-56. doi:10.1017/S0267190514000191
Darvin, R., & Zhang, Y. (2023). Words that don’t translate: Investing in decolonizing practices through translanguaging. Language Awareness, 32(4), 645-661. doi:10.1080/09658416.2023.2238595
DePalma, M.-J., & Ringer, J. M. (2011). Toward a theory of adaptive transfer: Expanding disciplinary discussions of “transfer” in second-language writing and composition studies. Journal of Second Language Writing, 20(2), 134-147. doi:10.1016/ j.jslw.2011.02.003
Dzekoe, R. (2017). Computer-based multimodal composing activities, self-revision, and L2 acquisition through writing. Language Learning & Technology, 21(2), 73-95. doi:10125/44612
Earl, L. (2003). Assessment as learning: Using classroom assessment to maximize student learning. Corwin Press.
Early, M., Kendrick, M., & Potts, D. (2015). Multimodality: Out from the margins of English language teaching. TESOL Quarterly, 49(3), 447-460. doi:10.1002/tesq. 246
Elola, I., & Oskoz, A. (2022). Reexamining feedback on L2 digital writing. Studies in Second Language Learning and Teaching, 12(4), 575-595. doi:10.14746/ssllt.2022.12.4.3
Flower, L., & Hayes, J. R. (1981). A cognitive process theory of writing. College Composition and Communication, 32(4), 365-387. doi:10.2307/356600
Gee, J. (2010). A situated-sociocultural approach to literacy and technology. In E. A. Baker (Ed.), The new literacies: Multiple perspectives on research and practice (pp. 165-193). The Guilford Press.
Gilje,
Grapin, S. (2019). Multimodality in the new content standards era: Implications for English learners. TESOL Quarterly, 53(1), 30-55. doi:10.1002/tesq. 443
Hafner, C. (2014). Embedding digital literacies in English language teaching: Students’ digital video projects as multimodal ensembles. TESOL Quarterly, 48(4), 655-685. doi:10.1002/tesq. 138
Hafner, C., & Miller, L. (2019). English in the disciplines: A multidimensional model for ESP course design. Routledge.
Hafner, C. A. (2013). Digital composition in a second or foreign language. TESOL Quarterly, 47(4), 830-834. doi:10.1002/ tesq. 135.
Hafner, C. A. (2015). Remix culture and English language teaching: The expression of learner voice in digital multimodal compositions. TESOL Quarterly, 49(3), 486-509. doi:10.1002/tesq. 238
Hafner, C. A., Chik, A., & Jones, R. H. (2013). Engaging with digital literacies in TESOL. TESOL Quarterly, 47(3), 812-815. doi:10.1002/tesq. 136
Hafner, C. A., Harrison, S., Ho, J., & Kwan, B. (2023). Digital mediation in ESP genres. English for Specific Purposes, 71(3), 115-122. doi:10.1016/j.esp.2023.03.002
Hafner, C. A., & Ho, W. Y. J. (2020). Assessing digital multimodal composing in second language writing: Towards a processbased model. Journal of Second Language Writing, 47(2), 100710. doi:10.1016/j.jslw.2020.100710
Hatano, G., & Inagaki, K. (1986). Two courses of expertise. In H. Azuma & K. Hakuta (Eds.), Child development in Japan (pp. 262-272). W.H.Freeman.
He, P., & Lin, A. (2023). Dynamic flows of translanguaging/trans-semiotizing in CLIL eco-social systems. Language Awareness. doi:10.1080/09658416.2023.2234824
Hirvela, A., & Belcher, D. (2022). Expertise in L2 writing instruction: The road less travelled. Journal of Second Language Writing, 58(8), 100936. doi:10.1016/j.jslw.2022.100936
Ho, W. Y. J. (2022). The construction of translanguaging space through digital multimodal composing: A case study of students’ creation of instructional videos. Journal of English for Academic Purposes, 58, 101134. doi:10.1016/ j.jeap.2022.101134
Huang, S.-y. (2019). EFL learners’ critical multimodal reflections on the politics of English. TESOL Journal, 10(3), e00435. doi:10.1002/tesj. 435
Hull, A., & Nelson, M. E. (2005). Locating the semiotic power of multimodality. Written Communication, 22(2), 224-261. doi:10.1177/0741088304274170
Jewitt, C., Bezemer, J., & O’Halloran, K. (2016). Introducing multimodality. Routledge.
Jewitt, C., & Kress, G. (2003). Multimodal literacy. Peter Lang.
Jiang, L. (2021). Facilitating EFL students’ civic participation through digital multimodal composing. Language, Culture and Curriculum, 35(1), 102-117. doi:10.1080/07908318.2021.1942032
Jiang, L. (2023). Multilingual youths’ digital activism through multimodal composing in the post-pandemic era. Journal of Multilingual and Multicultural Development. Advance online publication. doi:10.1080/01434632.2023.2181353
Jiang, L., & Gu, M. M. (2022). Toward a professional development model for critical digital literacies in TESOL. TESOL Quarterly, 56(3), 1029-1040. doi:10.1002/tesq. 3138
Jiang, L., Li, Z., & Leung, J. S.C. (2024). Digital multimodal composing as translanguaging assessment in CLIL classrooms. Learning and Instruction, 92, 101900. doi:10.1016/j.learninstruc.2024.101900
Jiang, L., & Luk, J. (2016). Multimodal composing as a learning activity in English classrooms: Inquiring into the sources of its motivational capacity. System, 59, 1-11. doi:10.1016/j.system.2016.04.001
Jiang, L., & Ren, W. (2021). Digital multimodal composing in L2 learning: Ideologies and impact. Journal of Language, Identity & Education, 20(3), 167-182. doi:10.1080/15348458.2020.1753192
Jiang, L., Yang, M., & Yu, S. (2020). Chinese ethnic minority students’ investment in English learning empowered by digital multimodal composing. TESOL Quarterly, 54(4), 954-979. doi:10.1002/tesq. 566
Jiang, L., Yu, S., & Lee, I. (2022a). Developing a genre-based model for assessing digital multimodal composing in second language writing: Integrating theory with practice. Journal of Second Language Writing, 57, 100869. doi:10.1016/ j.jslw.2022.100869
Jiang, L., Yu, S., & Zhao, Y. (2022b). Incorporating digital multimodal composing through collaborative action research: Challenges and coping strategies. Technology, Pedagogy and Education, 31(1), 45-61. doi:10.1080/1475939X.2021.1978534
Jiang, L. J. (2017). The affordances of digital multimodal composing for EFL learning. ELT Journal, 71(4), 413-422. doi:10.1093/elt/ccw098
Jones, R., & Hafner, C. A. (2021). Understanding digital literacies: A practical introduction. Routledge.
Kang, J. (2022). Transfer of knowledge across genres and media: Investigating L2 learners’ multiple composing practices. Journal of English for Academic Purposes, 56, 101096. doi:10.1016/j.jeap.2022.101096
Kellner, D., & Share, J. (2005). Toward critical media literacy: Core concepts, debates, organizations, and policy. Discourse: Studies in the Cultural Politics of Education, 26(3), 369-386. doi:10.1080/01596300500200169
Kendrick, M., Early, M., Michalovich, A., & Mangat, M. (2022). Digital storytelling with youth from refugee backgrounds: Possibilities for language and digital literacy learning. TESOL Quarterly, 56(3), 961-984. doi:10.1002/tesq. 3146
Kim, Y., Belcher, D., & Peyton, C. (2023). Comparing monomodal traditional writing and digital multimodal composing in EAP classrooms: Linguistic performance and writing development. Journal of English for Academic Purposes, 64, 101247. doi:10.1016/j.jeap.2023.101247
Kim, Y., Kang, S., Nam, Y., & Skalicky, S. (2022). Peer interaction, writing proficiency, and the quality of collaborative digital multimodal composing task: Comparing guided and unguided planning. System, 106, 102722. doi:10.1016/j.system.2022. 102722.
Krashen, S. D. (1981). Second language acquisition and second language learning. Pergamon.
Kress, G. (2010). Multimodality: A social semiotic approach to contemporary communication. Routledge.
Lankshear, C., & Knobel, M. (2006). New literacies: Everyday practices and classroom learning (2nd ed.). Open University Press.
Lantolf, J. P., & Thorne, S. L. (2006). Sociocultural theory and the genesis of second language development. Oxford University Press.
Lee, E. (2023). Writing toward a decolonial option: A bilingual student’s multimodal composing as a site of translingual activism and justice. Written Communication, 40(1), 59-89. doi:10.1177/07410883221134640
Lee, I., & Yuan, R. (2021). Understanding L2 writing teacher expertise. Journal of Second Language Writing, 52, 100755. doi:10.1016/j.jslw.2020.100755
Li, M. (2020). Multimodal pedagogy in TESOL teacher education: Students’ perspectives. System, 94, 102337. doi:10.1016/ j.system.2020.102337
Li, M., Gibbons, J., & Pham, Q. (2023). Re-exploring writer-reader interaction: Analyzing metadiscourse in EAP students’ infographics. Journal of English for Academic Purposes, 66, 101303. doi:10.1016/j.jeap.2023.101303
Li, M., & Storch, N. (2017). Second language writing in the age of CMC: Affordances, multimodality, and collaboration. Journal of Second Language Writing, 36, 1-5. doi:10.1016/j.jslw.2017.05.012
Li, M., & Zhang, M. (2023). Collaborative writing in L2 classrooms: A research agenda. Language Teaching, 56(1), 94-112. doi:10.1017/S0261444821000318
Li, W. (2011). Multilinguality, multimodality, and multicompetence: Code- and modeswitching by minority ethnic children in complementary schools. Modern Language Journal, 95(3), 370-384. doi:10.1111/j.1540-4781.2011.01209.x
Li, W. (2014). Who’s teaching whom? Co-learning in multilingual classrooms. In S. May (Ed.), The multilingual turn: Implications for SLA, TESOL, and bilingual education (pp. 167-190). Routledge.
Li, W. (2018). Translanguaging as a practical theory of language. Applied Linguistics, 39(1), 9-30. doi:10.1093/applin/amx039
Liang, W. J., & Lim, F. V. (2021) A pedagogical framework for digital multimodal composing in the English language classroom. Innovation in Language Learning and Teaching, 15(4), 306-320. doi:10.1080/17501229.2020.1800709
Lim, F. V., Chia, A., & Nguyen, T. T. H. (2022a). “From the beginning, I think it was a stretch” – Teachers’ perceptions and practices in teaching multiliteracies. English Teaching: Practice & Critique, 21(4), 379-396. doi:10.1108/ ETPC-04-2021-0025
Lim, F. V., & Toh, W. (2020). Children’s digital multimodal composing: Implications for learning and teaching. Learning, Media and Technology, 45(4), 422-432. doi:10.1080/17439884.2020.1823410
Lim, F. V., Toh, W., & Nguyen, T. T. H. (2022b). Multimodality in the English language classroom: A systematic review of literature. Linguistics and Education, 69, 101048. doi:10.1016/j.linged.2022.101048
Lim, F. V., & Unsworth, L. (2023). Multimodal composing in the English classroom: Recontextualising the curriculum to learning. English in Education, 57(2), 102-119. doi:10.1080/04250494.2023.2187696
Lim, J., & Kessler, M. (2022). Directions for future research on SLA, L2 writing, and multimodality. In R. Manchón, & C. Polio (Eds.), The Routledge handbook of second language acquisition and writing (pp. 300-314). Routledge.
Lim, J., & Polio, C. (2020). Multimodal assignments in higher education: Implications for multimodal writing tasks for L2 writers. Journal of Second Language Writing, 47, 100713. doi:10.1016/j.jslw.2020.100713
Lin, A. (2019). Theories of trans/languaging and trans-semiotizing: Implications for content-based education classrooms. International Journal of Bilingual Education and Bilingualism, 22(1), 5-16. doi:10.1080/13670050.2018.1515175
Manchón, R. M. (2017). The potential impact of multimodal composition on language learning. Journal of Second Language Writing, 38, 94-95. doi:10.1016/j.jslw.2017.10.008
Mendoza, A., Hamman-Ortiz, L., Tian, Z., Rajendram, S., Tai, K. W. H., Ho, W. Y. J., & Sah, P. K. (2023). Sustaining critical approaches to translanguaging in education: A contextual framework. TESOL Quarterly. Advance online publication. doi:10.1002/tesq. 3240
Mirra, N., & Garcia, A. (2020). “I hesitate but I do have hope”: Youth speculative civic literacies for troubled times. Harvard Educational Review, 90(2), 295-321. doi:10.17763/1943-5045-90.2.295
Nelson, M. E. (2006). Mode, meaning, and synaesthesia in multimedia L2 writing. Language Learning & Technology, 10(2), 56-76. doi:10125/44061
New London Group. (1996). A pedagogy of multiliteracies: Designing social futures. Harvard Educational Review, 66(1), 60-92. doi:10.17763/haer.66.1.17370n67v22j160u
Norton, B. (2013). Identity and language learning: Extending the conversation (2nd ed.). Multilingual Matters.
Oskoz, A., & Elola, I. (2020). Digital literacies for writing in the 21st century FL classroom. Equinox.
Pacheco, M. B., Smith, B. E., Deig, A., & Amgott, N. A. (2021). Scaffolding multimodal composition with emergent bilingual students. Journal of Literacy Research, 53(2), 149-173. doi:10.1177/1086296
Pangrazio, L. (2016). Reconceptualising critical digital literacy. Discourse: Studies in the Cultural Politics of Education, 37(2), 163-174. doi: 10.1080/01596306.2014.942836
Pham, Q. N., & Li, M. (2022). Digital multimodal composing using visme: EFL students’ perspectives. The Asia-Pacific Education Researcher, 32, 695-706. doi:10.1007/s40299-022-00687-w
Prasad, G., & Lory, M.-P. (2020). Linguistic and cultural collaboration in schools: Reconciling majority and minoritized language users. TESOL Quarterly, 54(4), 797-822. doi:10.1002/tesq. 560
Prior, P. A., & Hengst, J. A. (2010). Introduction: Exploring semiotic remediation. In P. A. Prior & J. A. Hengst (Eds.), Exploring semiotic remediation as discourse practice (pp. 1-23). Palgrave Macmillan. doi:10.1057/9780230250628_1
Qu, W. (2017). For L2 writers, it is always the problem of the language. Journal of Second Language Writing, 38, 92-93. doi:10.1016/j.jslw.2017.10.007
Schmidt, R. (1990). The role of consciousness in second language learning. Applied Linguistics, 11(2), 17-46. doi:10.1093/ applin/11.2.129
Shin, D., & Cimasko, T. (2008). Multimodal composition in a college ESL class: New tools, traditional norms. Computers and Composition, 25(4), 376-395. doi:10.1016/j.compcom.2008.07.001
Shin, D., Cimasko, T., & Yi, Y. (2020). Development of metalanguage for multimodal composing: A case study of an L2 writer’s design of multimedia texts. Journal of Second Language Writing, 47, 100714. doi:10.1016/j.jslw.2020.100714
Smith, B. E. (2019). Collaborative multimodal composing: Tracing the unique partnerships of three pairs of adolescents composing across three digital projects. Literacy, 53(1), 14-21. doi:10.1111/lit.12153
Smith, B. E., Amgott, N., & Malova, I. (2022). “It made me think in a different way”: Bilingual students’ perspectives on multimodal composing in the English language arts classroom. TESOL Quarterly, 56(2), 525-551. doi:10.1002/ tesq. 3064
Smith, B. E., Pacheco, M. B., & Khorosheva, M. (2020). Emergent bilingual students and digital multimodal composition: A systematic review of research in secondary classrooms. Reading Research Quarterly, 56(1), 33-52. doi:10.1002/rrq. 298
Storch, N. (2011). Collaborative writing in L2 contexts: Processes, outcomes, and future directions. Annual Review of Applied Linguistics, 31, 275-288. doi:10.1017/S0267190511000079
Street, B. (1984). Literacy in theory and practice. Cambridge University Press.
Swain, M., & Lapkin, S. (1995). Problems in output and the cognitive processes they generate: A step towards second language learning. Applied Linguistics, 16(3), 371-391. doi:10.1093/applin/16.3.371
Swain, M., & Lapkin, S. (1998). Interaction and second language learning: Two adolescent French immersion students working together. Modern Language Journal, 82(3), 320-337. doi:10.1111/j.1540-4781.1998.tb01209.x
Swales, J. M., & Feak, C. B. (2023). Task evolution in English for academic purposes writing materials: The case of “information transfer” to “critical commentary”. Journal of Second Language Writing, 61, 101017. doi:10.1016/j.jslw.2023.101017
Tan, J. P. L., & McWilliam, E. (2009). From literacy to multiliteracies: Diverse learners and pedagogical practice. Pedagogies: An International Journal, 4(3), 213-225. doi:10.1080/15544800903076119
Tan, X. (2023). Stories behind the scenes: L2 students’ cognitive processes of multimodal composing and traditional writing. Journal of Second Language Writing, 59, 100958. doi:10.1016/j.jslw.2022.100958
Toohey, K., & Dagenais, D. (2015). Videomaking as sociomaterial assemblage. Language and Education, 29(4), 302-316. doi:10.1080/09500782.2015.1006643
Tour, E. (2015). Digital mindsets: Teachers’ technology use in personal life and teaching. Language Learning & Technology, 19(3), 124-139. doi:10125/44437
Towndrow, P. A., Nelson, M. E., & Yusuf, W. F. B. M. (2013). Squaring literacy assessment with multimodal design: An analytic case for semiotic awareness. Journal of Literacy Research, 45(4), 327-355. doi:10.1177/1086296X13504155
Unsworth, L. (2006). Towards a metalanguage for multiliteracies education: Describing the meaning-making resources of language-image interaction. English Teaching-Practice and Critique, 5(1), 55-76.
Vandommele, G., Van den Branden, K., Van Gorp, K., & De Maeyer, S. (2017). In-school and out-of-school multimodal writing as an L2 writing resource for beginner learners of Dutch. Journal of Second Language Writing, 36, 23-36. https://doi.org/10.1016/j.jslw.2017.05.010
Weninger, C. (2023). Digital literacy as ideological practice. ELT Journal, 77(2), 197-206. doi:10.1093/elt/ccad001
Williams, D. (2009). Assessment for learning: Why, what and how? Institute of Education, University of London.
Xu, F., & Matsuda, P. K. (2017). Disciplinary dialogues section: Perspectives on multimodal composition. Journal of Second Language Writing, 38, 79. doi:10.1016/j.jslw.2017.10.006
Xu, Y. (2021). Investigating the effects of digital multimodal composing on Chinese EFL learners’ writing performance: A quasi-experimental study. Computer Assisted Language Learning, 36(4), 785-805. doi:10.1080/09588221.2021.1945635
Yi, Y. (2017). Establishing multimodal literacy research in the field of L2 writing: Let’s move the field forward. Journal of Second Language Writing, 38, 90-91. doi:10.1016/j.jslw.2017.10.010
Yi, Y., & Angay-Crowder, T. (2016). Multimodal pedagogies for teacher education in TESOL. TESOL Quarterly, 50(4), 988-998. doi:10.1002/tesq. 326
Yi, Y., Shin, B. S., & Cimasko, T. (2020). Special issue: Multimodal composing in multilingual learning and teaching contexts. Journal of Second Language Writing, 47, 100717. doi:10.1016/j.jslw.2020.100717
Yin, R. K. (2009). Case study research: Design and methods (4th ed.). Sage.
Zhang, M., Akoto, M., & Li, M. (2023). Digital multimodal composing in post-secondary L2 settings: A review of the empirical landscape. Computer Assisted Language Learning, 36(4), 694-721. doi:10.1080/09588221.2021.1942068
- © The Author(s), 2024. Published by Cambridge University Press. This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
