Advertisement

The Cognitive and Psychological Effects of YouTube Video Captions and Subtitles on Higher-Level German Language Learners

  • Peter YangEmail author
Chapter
  • 60 Downloads
Part of the New Language Learning and Teaching Environments book series (NLLTE)

Abstract

This chapter reviews the psychological and cognitive role of using videos, YouTube videos and modes of text support in foreign language learning, with a focus on the effect that captioning and subtitling YouTube videos have on intermediate-high and advanced German language learners. The results of the study found that enhanced captioning plays a more positive role on the intermediate-high and advanced German learners’ motivation likely due to more efficient language processing; more specifically the videos are able to provide linguistic integrity, which allows the language learners to focus their incidental attention effectively. The findings provide useful insights into and enthusiasm for the effective use of YouTube videos for the curriculum development of higher-level German courses and hopefully contribute to establishing best practices in this emerging area.

References

  1. Alderson, J., Clapham, C., & Wall, D. (1995). Language test construction and evaluation. Cambridge: Cambridge University Press.Google Scholar
  2. Alimemaj, Z. (2010). YouTube, language learning and teaching techniques. The Magazine of Global English Speaking Higher Education, 2(3), 10–12.Google Scholar
  3. Allen, T. E. (1986). Patterns of academic achievement among hearing impaired students: 1974 and 1983. In A. N. Schildroth & M. A. Karchmer (Eds.), Deaf children in America (pp. 161–206). San Diego, CA: College-Hill Press.Google Scholar
  4. Al-Seghayer, K. (2001). The effect of multimedia annotation modes on L2 vocabulary acquisition: A comparative study. Language Learning & Technology, 5(1), 202–232.Google Scholar
  5. Alwehaibi, H. (2013). The impact of using YouTube in EFL. Proceedings of the Clute International Academic Conference, Paris, France.Google Scholar
  6. Ausubel, D. P. (1978). In defense of advance organizers: A reply to the critics. Review of Educational Research, 48(2), 251–257.CrossRefGoogle Scholar
  7. Baltova, I. (1999). Multisensory language teaching in a multidimensional curriculum: The use of authentic bimodal video in core French. The Canadian Modern Language Review, 56(1), 32–48.CrossRefGoogle Scholar
  8. Başaran, H., & Köse, G. (2013). The effects of captioning on EFL learners’ listening comprehension. Procedia – Social and Behavioral Sciences, 70, 702–708.CrossRefGoogle Scholar
  9. Behroozizad, S., & Majidi, S. (2015). The effect of different modes of English captioning on EL2 learners’ general listening comprehension: Full text vs. keyword captions. Advances in Language and Literary Studies, 6(4), 115–121.Google Scholar
  10. Berk, R. A. (2009). Multimedia teaching with video clips: TV, movies, YouTube videos, and mtvU in the college classroom. International Journal of Technology in Teaching and Learning, 5(1), 1–21.Google Scholar
  11. Bird, S. A., & Williams, J. N. (2002). The effect of bimodal input on implicit and explicit memory: An investigation into the benefits of within-language subtitling. Applied Psycholinguistics, 23(4), 509–533.CrossRefGoogle Scholar
  12. Borras, I., & Lafayette, R. C. (1994). Effect of multimedia courseware subtitling on the speaking performance of college students of French. The Modern Language Journal, 78, 61–75.CrossRefGoogle Scholar
  13. Brett, P. (1997). A comparative study of the effects of the use of multimedia on listening comprehension. System, 25, 39–54.CrossRefGoogle Scholar
  14. Brown, J. S., & Adler, R. P. (2008, January/February). Minds on fire: Open education, the long tail, and learning 2.0. Educause Review, 43(1), 16–32.Google Scholar
  15. Brown, J. S., Collins, A., & Duguid, P. (1989). Situated cognition and the culture of learning. Educational Researcher, 18(1), 32–41.CrossRefGoogle Scholar
  16. Burger, G. (1989). Are TV programs with video subtitles suitable for teaching listening comprehension? Zielsprache Deutsch, 20(4), 10–13.Google Scholar
  17. Chung, J. (1999). The effects of using video texts supported with advance organizers and captions on Chinese college students’ listening comprehension: An empirical study. Foreign Language Annals, 32(3), 295–308.CrossRefGoogle Scholar
  18. Danan, M. (1992). Reversed subtitling and dual coding theory: New directions for foreign language instruction. Language Learning, 42(4), 497–527.CrossRefGoogle Scholar
  19. Danan, M. (1995). Reversed subtitling and dual coding theory: New directions for foreign language instruction. In B. Harley (Ed.), Lexical issues in language learning (pp. 253–282). Ann Arbor, MI: Language Learning/John Benjamins.Google Scholar
  20. Danan, M. (2004). Subtitling and captioning: Undervalued language learning strategies. Meta, 49(1), 67–77.CrossRefGoogle Scholar
  21. Donchev, D. (2017). YouTube statistics – 2016: Facts and numbers. Retrieved from fortunelords.com/YouTube-statistics
  22. Duffy, P. (2008). Engaging the YouTube Google-eyed generation: Strategies for using Web 2.0 in teaching and learning. The Electronic Journal of e-Learning, 6(2), 119–130.Google Scholar
  23. Fox, G. (2003). Teaching normal development using stimulus videotapes in psychiatric education. Academic Psychiatry, 27, 283–288.CrossRefGoogle Scholar
  24. Froehlich, J. (1988). German videos with German subtitles: A new approach to listening comprehension development. Die Unterrichtspraxis/Teaching German, 21(2), 199–203.CrossRefGoogle Scholar
  25. Gardner, H. (2006). Multiple intelligences: New horizons. New York: Basic Books.Google Scholar
  26. Garza, T. J. (1991). Evaluating the use of captioned video materials in intermediate high and advanced foreign language learning. Foreign Language Annals, 24(3), 239–258.CrossRefGoogle Scholar
  27. Gorjian, B. (2014). The effect of movie subtitling on incidental vocabulary learning among EL2 learners. International Journal of Asian Social Science, 4(9), 1013–1026.Google Scholar
  28. Grgurović, M., & Hegelheimer, V. (2007). Help options and multimedia listening: Students’ use of subtitles and the transcript. Language Learning & Technology, 11(1), 45–66.Google Scholar
  29. Grimmer, C. (1992). Supertext English language subtitles: A boon for English language learners. EA Journal, 10(1), 66–75.Google Scholar
  30. Gruba, P. (1997). The role of video media in listening assessment. System, 25, 335–345.CrossRefGoogle Scholar
  31. Guillory, H. G. (1998). The effects of key word captions to authentic French video in foreign language instruction. CALICO Journal, 15(1–3), 89–108.Google Scholar
  32. Hegelheimer, V., & O’Bryan, A. (2008). Mobile technologies and language education: A look at language learning podcasts. In M. Thomas (Ed.), Handbook of research on Web 2.0 and second language learning (pp. 331–349). Hershey, NY: Information Science Reference.Google Scholar
  33. Herron, C. (1994). An investigation of the effectiveness of using an advance organizer to introduce video in the foreign language classroom. Modern Language Journal, 78(2), 190–198.CrossRefGoogle Scholar
  34. Herron, C., Dubreil, S., Corrie, C., & Cole, S. P. (2002). A classroom investigation: Can video improve intermediate-level French language students’ ability to learn about a foreign culture? The Modern Language Journal, 86(1), 36–53.CrossRefGoogle Scholar
  35. Herron, C., Morris, M., Secules, T., & Curtis, L. (1995). A comparison study of the effects of video-based versus text-based instruction in the FL classroom. French Review, 68(5), 775–795.Google Scholar
  36. Huang, H., & Eskey, D. (2000). The effects of closed-captioned television on the listening comprehension of intermediate English as a second language students. Educational Technology Systems, 28, 75–96.CrossRefGoogle Scholar
  37. Kabooha, R., & Elyas, T. (2018). The effects of YouTube in multimedia instruction for vocabulary learning: Perceptions of EFL students and teachers. English Language Teaching, 11(2), 72–81.CrossRefGoogle Scholar
  38. Kelsen, B. (2009). Teaching EFL to the iGeneration: A survey of using YouTube as supplementary material with college EFL students in Taiwan. CALL-EJ Online, 10(2), 10–12.Google Scholar
  39. Kirk, D. (1992). Comparison of student responses to sources of motivation. The Language Teacher, 16(2), 23–25.Google Scholar
  40. Köksal, D. (2004). To kill the blackboard? Technology in language teaching. The Turkish Online Journal of Educational Technology-TOJET, 3(3), 62–72.Google Scholar
  41. Koolstra, C., & Beentjes, W. (1999). Children’s vocabulary acquisition in a foreign/second language through watching subtitled television at home. Educational Technology, Research, and Development, 47, 51–60.CrossRefGoogle Scholar
  42. Lenhart, A., & Madden, M. (2005). Teens content creators and consumers. Washington, DC: Pew Internet & American Life Report. Retrieved from www.pewinternet.org/2005/11/02/teen-content-creators-and-consumers/Google Scholar
  43. Macaluso, E., Noppeney, U., Talsma, D., Vercillo, T., Hartcher-O’Brien, J., & Adam, R. (2016). The curious incident of attention in multisensory integration: Bottom-up vs. Top-down. Multisensory Research. A Journal of Scientific Research on All Aspects of Multisensory Processing, 29(6–7), 557–583.Google Scholar
  44. Medina, M. (2002). A study of Hispanic EFL students learning English within a CALL classroom: Student introspection on learning, technology and community. Unpublished Dissertation, India University of Pennsylvania.Google Scholar
  45. Markham, P. (2001). The influence of culture-specific background knowledge and captions on second language comprehension. Journal of Educational Technology Systems, 29(4), 331–343.CrossRefGoogle Scholar
  46. Markham, P., & Peter, L. (2003). The influence of English language and Spanish language captions on foreign language listening/reading comprehension. Journal of Educational Technology Systems, 31(3), 331–341.CrossRefGoogle Scholar
  47. Markham, P., Peter, L., & McCarthy, T. (2001). The effects of native language vs. target language captions on foreign language students’ DVD video comprehension. Foreign Language Annals, 34(5), 439–445.CrossRefGoogle Scholar
  48. Massaro, D. W. (2004). From multisensory integration to talking heads and language learning. In G. Calvert, C. Spence, & B. E. Stein (Eds.), The handbook of multisensory processes (pp. 153–176). Cambridge, MA: The MIT Press.Google Scholar
  49. Matielo, R., D’Ely, R., & Baretta, L. (2015). The effects of interlingual and intralingual subtitles on second language learning/acquisition: A state-of-the-art review. Trabalhos em Linguística Aplicada, 54(1), 161–182.CrossRefGoogle Scholar
  50. Mayer, R. E. (2005a). Introduction to multimedia learning. In R. E. Mayer (Ed.), The Cambridge handbook of multimedia learning (pp. 1–16). Cambridge, England: Cambridge University Press.CrossRefGoogle Scholar
  51. Mayer, R. E. (2005b). Principles for reducing extraneous processing in multimedia learning: Coherence, signaling, redundancy, spatial contiguity, and temporal contiguity principles. In R. E. Mayer (Ed.), The Cambridge handbook of multimedia learning (pp. 183–200). Cambridge, England: Cambridge University Press.CrossRefGoogle Scholar
  52. Mitterer, H., & McQueen, J. (2009). Foreign subtitles help but native-language subtitles harm foreign speech perception. PLoS ONE, 4(11), e7785.CrossRefGoogle Scholar
  53. Mukhamadiarova, A. F., Merkish, N. E., & Kulkova, M. A. (2018). The advantages of using multimedia cultural and linguistic environment in the process of teaching foreign languages. Revista Publicando, 5(16), 332–339.Google Scholar
  54. Neuman, S. B., & Koskinen, P. (1992). Captioned television as comprehensible input: Effects of incidental word learning from context for language minority students. Reading Research, 27, 94–106.CrossRefGoogle Scholar
  55. Ogasawara, S. (1994). Effectiveness of using English captioned videos on listening comprehension proficiency. Bulletin of Faculty of Liberal Arts, Nagasaki University, Humanities, 35(1), 103–114.Google Scholar
  56. Paivio, A. (1986). Mental representations. New York: Oxford University Press.Google Scholar
  57. Park, M. (2004). The effects of partial captions on Korean EL2 learners’ listening comprehension. Unpublished doctoral dissertation, University of Texas at Austin.Google Scholar
  58. Shrosbree, M. (2008). Digital video in the language classroom. The JALT CALL Journal, 4(1), 75–84.Google Scholar
  59. Solomon, G., & Schrum, L. (2007). Web 2.0: New tools, new schools. Eugene, OR: International Society for Technology in Education.Google Scholar
  60. Swaffar, J., & Vlatten, A. (1997). A sequential model for video viewing in the foreign language curriculum. The Modern Language Journal, 81(2), 175–188.CrossRefGoogle Scholar
  61. Taylor, G. (2005). Perceived processing strategies of students watching captioned video. Foreign Language Annals, 38(3), 422–427.CrossRefGoogle Scholar
  62. Terantino, J. (2011). YouTube for foreign languages: You have to see this video. Journal of Language & Technology, 15(1), 10–16.Google Scholar
  63. Vanderplank, R. (1988). The value of teletext subtitles in language learning. ELT Journal, 42, 272–281.CrossRefGoogle Scholar
  64. Vanderplank, R. (1990). Paying attention to the words: Practical and theoretical problems in watching television programmes with uni-lingual (CEEFAX) sub-titles. System, 18, 221–234.CrossRefGoogle Scholar
  65. Vanderplank, R. (1993). A very verbal medium: Language learning through closed captions. TESOL Journal, 3(1), 10–14.Google Scholar
  66. Wagner, E. (2007). Are they watching? Test-taker viewing behavior during an L2 language video listening test. Language Learning & Technology, 11(1), 67–86.Google Scholar
  67. Wang, H. (2007). The effects of captions on Chinese EFL students’ incidental vocabulary acquisition. CELEA Journal, 30(4), 9–16.Google Scholar
  68. Wang, S., & Vásquez, C. (2012). Web 2.0 and second language learning: What does the research tell us? CALICO Journal, 29(3), 412–430.CrossRefGoogle Scholar
  69. Weyers, J. (1999). The effect of authentic video on communicative competence. Modern Language Journal, 83(3), 339–353.CrossRefGoogle Scholar
  70. Wilkinson, R. (1984). Video-based learning activities. TESL Canada Journal, 1(2), 83–86.CrossRefGoogle Scholar
  71. Wood, D. (1999). Aspects of video movie English teaching. Journal of Chikushi Jogakuin University, 11, 93–104.Google Scholar
  72. Yang, J. C., & Chang, P. (2013). Captions and reduced forms instruction: The impact on EFL students’ listening comprehension. ReCALL, 26(1), 44–61.CrossRefGoogle Scholar
  73. Yoshino, S., Kano, N., & Akahori, K. (2000). The effects of English and Japanese captions on the listening comprehension of Japanese EFL students. Language Laboratory, 37, 111–130.Google Scholar

Copyright information

© The Author(s) 2020

Authors and Affiliations

  1. 1.Case Western Reserve UniversityClevelandUSA

Personalised recommendations