METHODOLOGICAL POTENTIAL OF THE ELAN SOFTWARE IN THE STUDY OF MULTIMODAL EDUCATIONAL VIDEO DISCOURSE

Keywords: communicative strategy, corpus linguistics, cognitive-pragmatic approach, discourse analysis, educational communication, multimodal annotation, persuasiveness, research methodology, semiotic resource

Abstract

This article focuses on an integrated multimodal annotation framework for English educational video discourse implemented in the ELAN environment. The relevance of this research is driven by the need to develop analytical procedures capable of providing a comprehensive representation of the interaction between heterogeneous semiotic modes within a temporally synchronized analytical model. The study aims to substantiate the methodological potential of the ELAN software for investigating multimodal English educational video discourse through the development of an integrated multimodal annotation system. The research is grounded in a cognitivepragmatic approach combined with the social semiotic theory of multimodality and corpus-based methodology. The empirical material comprises English lesson videos, their transcripts, and annotation files. The article introduces an original multimodal annotation model based on the principles of multimodal integration, temporal synchronization, functional and participant-oriented differentiation, hierarchical organization of annotation tiers, and the use of controlled vocabularies. The proposed framework incorporates both basic annotation tiers designed to capture individual semiotic resources and an integrative tier that enables the reconstruction of multimodal communicative strategies underlying persuasive meaning-making The functional capabilities of frame-by-frame annotation of multimodal data enable tracing both the synchronous and sequential unfolding of the communicative process that occurs during teacher-student educational interaction. The application of the annotation model to English educational video fragments made it possible to trace the temporal coordination of verbal, visual, and auditory resources, identify recurrent patterns of their interaction, and interpret organizationaldirective and evaluative-motivational strategies. The findings demonstrate that ELAN provides a robust empirical environment for qualitative and quantitative multimodal analysis, as well as facilitates statistical processing of annotated data. The scientific novelty of the study lies in the development of an integrated multimodal annotation framework that extends the methodological toolkit of contemporary multimodal linguistics and offers a model for the analysis of other types of multimodal discourse.

References

1. Крисанова Т. Анотація як інструмент мультимодального аналізу: від тексту до смислу. Вісник ХНУ імені В. Н. Каразіна. Серія: Іноземна філологія. Методика викладання іноземних мов. 2024. Вип. 100. С. 29–38. https://doi.org/10.26565/2786-5312-2024-100-03
2. Малаховська Я. Вербальні засоби персуазивності в англомовному навчальному відеодискурсі: комунікативно-прагматичний аспект. Вісник ХНУ імені В. Н. Каразіна. Серія: Іноземна філологія. Методика викладання іноземних мов. 2025. Вип. 102. С. 28–34. https://doi.org/10.26565/2786-5312-2025-102-03
3. Crasborn O., Hulsbosch M., Sloetjes H. Linking Corpus NGT annotations to a lexical database using ELAN and LEXUS. Proceedings of LREC 2012. 2012. P. 378–383. https://www.sign-lang.uni-hamburg.de/lrec/pub/12030.html
4. Dreuw P., Ney H. Towards automatic sign language annotation for the ELAN tool. Proceedings of LREC 2008. 2008. P. 254–258.
5. Hanada L. Manual vs. automated annotation of non-manual signs: ELAN vs. FaceReader. Proceedings of the Linguistic Society of America. 2026. Vol. 11(1), p. 6066. https://doi.org/10.3765/plsa.v11i1.6066.
6. Jewitt C. The Routledge Handbook of Multimodal Analysis. London: Routledge, 2016. 544 p.
7. Kress G., van Leeuwen T. Multimodal Discourse: The Modes and Media of Contemporary Communication. London: Arnold, 2001. 142 p.
8. Krysanova T. Unveiling the eco-storytelling: multimodal layers of meaning in Greenpeace’s environmental videos. Cognition, Communication, Discourse, 2024. Vol. 28. С. 33–57. https://doi.org/10.26565/2218-2926-2024-28-03
9. Liu NienEn Bonnie. Performing professionalism in digital discourse: multimodal discourse analysis of Taiwanese educational YouTubers: PhD dissertation. Edinburgh: The University of Edinburgh, School of Linguistics and English Language, 2026. 312 p. https://era.ed.ac.uk/items/1167630d-5723-445d-a523-32f289c36c2e
10. Mulrooney K., Hochgesang J., Morris R., Lee J. Integrating FACS and ELAN for analysis of nonmanual features in ASL. Proceedings of LREC 2014. 2014. P. 124–131.
11. O’Keefe D. J. Persuasion: Theory and Research (Third Edition). Thousand Oaks, CA: Sage Publications. 2016. 408 p.
12. Perloff R. M. The Dynamics of Persuasion: Communication and Attitudes in the Twenty-First Century (6th ed.). New York: Routledge, 2017. 648 p. https://doi.org/10.4324/9780429196959
13. Strashko I. V. Multimedia corpus ‘everyone has their own war’: conception, annotation, and prospects. Scientific Journal of Dragomanov Ukrainian State University. Series 9. Current Trends in Language Development. 2022. Vol. 24. P. 81–93. https://doi.org/10.31392/NPU-nc.series9.2022.24.07
14. Teaching English with Oxford. Teaching 21st Century Skills: Oxford Discover Sample Lesson Level 1 (Part 2) [Video]. 2015. URL: https://www.youtube.com/watch?v=e2dtlPJj0LM&list=PLx-E1zzJKa1eF6Bj5xIGpXco3bTKeyqg3T&index=2
15. Wittenburg P., Brugman H., Russel A., Klassmann A., Sloetjes H. ELAN: a Professional Framework for Multimodality Research. Proceedings of the Fifth International Conference on Language Resources and Evaluation (LREC 2006). 2006. P. 1556–1559. https://doi.org/10.63317/5pwa5zpssv4z
Published
2026-11-18
How to Cite
Krysanova, T. A., & Malakhovska, Y. I. (2026). METHODOLOGICAL POTENTIAL OF THE ELAN SOFTWARE IN THE STUDY OF MULTIMODAL EDUCATIONAL VIDEO DISCOURSE. New Philology, (103), 94-105. https://doi.org/10.26661/2414-1135-2026-103-12
Section
Articles