The ludic potential of free and bound semiotic resources in the postmodernist picturebook
DOI:
https://doi.org/10.21638/spbu09.2024.410Abstract
The paper offers a complex linguosemiotic, cognitive-discursive, and stylistic analysis of various semiotic resources which act synergetically and contribute to the emergence of a new type of children’s fiction, the so-called postmodernist picturebook. Picturebooks created at the end of the 20th and the beginning of the 21st centuries are examined. The paper hypothesizes a multimodal metafictional narrative as a new generic form of Metafiction, a wide-spread postmodernist literary genre. Postulated in this research as a type of postmodernist picturebooks, multimodal metafictional narrative is characterized by explicit ludic modality conditioned in the analyzed fiction by the creative use of free and bound semiotic resources and the cognitive mechanism of multimodal resonance, activated in postmodernist picturebooks. The category of ludic modality is manifested in multimodal metafiction through the visualization mechanism of the “authorial mask” and the visual foregrounding of “creative chronotopos”. The readers of such picturebooks, both young and adult, are transformed into “viewers” and co-creators navigating such multimodal fictional worlds. The paper identifies and describes constitutive features of the multimodal metafictional narrative, such as an introduction of multimodal peritextual elements triggering an explicit ludic effect, modelling an image of the illustrator as a new “co-author” of the book which enhances its physicality effect on the reader; a creative use of free semiotic resources involved in visualizing a topos of “extradiegetic addressee”. The findings of the research also reveal numerous functions of the multimodal resonance as a dynamic cognitive-discursive phenomenon in the multimodal metafiction: it plays a crucial role in the plot construction as well as carries out ludic and emotive functions.
Keywords:
postmodernist picturebook, multimodal metafictional narrative, explicit ludic modality, free and bound semiotic resources, multimodal resonance
Downloads
References
Литература
Бахтин 2000 — Бахтин М. М. Формы времени и хронотопа в романе (очерки по исторической поэтике. 1975). В кн.: Бахтин М. М. Эпос и роман. СПб.: Азбука. 2000. С. 11–193.
Бельская 2020 — Бельская А. О. Особенности оформления английской детской книги эпохи модерна. В сб.: Научные труды. Вып. 53. Проблемы развития зарубежного искусства: сб. науч. тр. Раздольская В. И. (науч. ред.) СПб.: Ин-т им. Репина, 2020. С. 154–173.
Гальперин 1981 — Гальперин И. Р. Текст как объект лингвистического описания. М.: URSS, 1981.
Гвашиани 2022 — Гвашиани Н. Б. «Мультимодальный поворот» в когнитивных исследованиях языка через призму терминов и понятий. Когнитивные исследования языка. 2022, 4 (51): 364–369.
Дымарский 1999 — Дымарский М. Я. Проблемы текстообразования и художественный текст (на материале русской прозы XIX–XX вв.). СПб.: Изд-во С.-Петерб. ун-та, 1999.
Ирисханова 2018 — Ирисханова О. К. Федя, дичь! Или о резонансе в речи и жестах. Когнитивные исследования языка. 2018, (XXXIII): 598–604.
Ирисханова 2021 — Ирисханова О. К. Полимодальный дискурс как объект исследования. В кн.: Полимодальные измерение дискурса. Ирисханова О. К. (отв. ред.). 2-е изд. М.: Языки славянских культур, 2021. С. 15–33.
Левин 1998 — Левин Ю. И. Избранные труды. Поэтика. Семиотика. М.: Языки русской культуры, 1998.
Липовецкий 1997 — Липовецкий М. Н. Русский постмодернизм. Очерки исторической поэтики. Екатеринбург: Урал. гос. пед. ун-т, 1997.
Логинова 2021 — Логинова Е. Г. Семиотический резонанс в моно- и полимодальном дискурсе (на материале русской и английской драмы). Дис. … д-ра филол. наук. М., 2021.
Молодыченко 2022 — Молодыченко Е. Н. Идентичность, стиль и стилизация: социолингвистическая перспектива. Terra Linguistica. 2022, 13 (2): 11–29. https://doi.org/10.18721/JHSS.13202
Мяэотс 2021 — Мяэотс О. Н. Сказка о «Трех поросятах»: эволюция сказочного сюжета в книжке-картинке XX века. Детские чтения. 2021, 19 (1): 215–234. https://doi.org/10.31860/2304-5817-2021-1-19-215-234
Нефёдов 2016 — Нефёдов С. Т. Интенциональная структура и модальность научного текста. Филологические науки. Вопросы теории и практики. 2016, 9 (63): 141–145.
Нефёдов 2022 — Нефёдов С. Т. Оценка значимости в структуре мультимодального научного текста. Немецкая филология в Санкт-Петербургском государственном университете. Вып. 12: сб. ст. СПб.: Изд-во С.-Петерб. ун-та, 2022. С. 116–135. https://doi.org/10.21638/spbu33.2022.106
Никитин 2003 — Никитин М. В. Основания когнитивной семантики. СПб.: Изд-во Рос. гос. пед. ун-та им. А. И. Герцена, 2003.
Рорти 1995 — Рорти Р. Случайность, ирония и солидарность. М.: Русское феноменологическое общество, 1995.
Тимофеева 2004 — Тимофеева З. М. Рефлексивная игра в современном художественном тексте. СПб.: Рос. гос. пед. ун-т им. А. И. Герцена, 2004.
Чемодурова 2017 — Чемодурова З. М. Прагматика и семантика игры в текстах англоязычной постмодернистской прозы. Дис. … д-ра филол. наук. СПб., 2017.
Чемодурова 2019 — Чемодурова З. М. Когнитивный диссонанс как компонент интерпретационной программы постмодернистского художественного текста. Вопросы когнитивной лингвистики. 2019, (2): 55–64. https://doi.org/10.20916/1812-3228-2019-2-55-64
Чернявская 2021 — Чернявская В. Е. Текст и социальный контекст: Социолингвистический и дискурсивный анализ смыслопорождения. М.: Ленанд, 2021.
Шилихина 2014 — Шилихина К. М. Семантика и прагматика вербальной иронии. Воронеж: Наука- Юнипресс, 2014.
Шмид 2003 — Шмид В. Нарратология. М.: Языки славянской культуры, 2003.
Alter 1984 — Alter R. Motives for Fiction. Cambridge (Mass.); London: Harvard University Press, 1984.
Anstey 2002 — Anstey M. “It’s not all black and white”: Postmodern picture books and new literacies. Journal of Adolescent & Adult Literacy. 2002, (45): 444–457.
Chemodurova 2019 — Chemodurova Z. M. The Mechanisms and Types of Foregrounding in Postmodernist Fiction. In: English Language Teaching: Through the Lens of Experience. Haase Ch., Orlova N. (eds). Newcastle: Cambridge Scholars Publishing, 2019. P. 277–295.
Chemodurova 2021 — Chemodurova Z. M. Visual foregrounding in contemporary fiction. Voprosy kognitivnoy lingvistiki. 2021, (2): 5–15. https://doi.org/10.20916/1812-3228-2021-2-5-15
Chemodurova 2022 — Chemodurova Z. M. The Art of Storytelling in the Digital Age: A Multimodal Perspective. Vestnik Volgogradskogo gosudarstvennogo universiteta. Seriya 2. Iazykoznanie. 2022, 21 (6): 110–120. https://doi.org/10.15688/jvolsu2.2022.6.9
Chernyavskaya, Nefedov 2021 — Сhernyavskaya V. E., Nefedov S. T. Towards social Indexicality: From “Kollektiv” to “Team”. And back via Coronavirus Pandemic? Alman Dili ve Edebiyatı Dergisi. Studien zur deutschen Sprache und Literatur. 2021, (46): 1–21. https://doi.org/10.26650/sdsl2021-990815
Fokkema 1986 — Fokkema D. The Postmodern Weltanschauung and its Relation with Modernism. In: Approaching Postmodernism. Fokkema D., Bertens H. (eds). Amsterdam; Philadelphia: John Benjamins Publishing Company, 1986. P. 9–53.
Genette 1988 — Genette G. Narrative Discourse Revisited. Cornell: Cornell University Press, 1988.
Genette 1997 — Genette G. Paratexts: shresholds of interpretation. Cambridge; New York: Cambridge University Press, 1997.
Hallet 2018 — Hallet W. Reading Multimodal Fiction: A Methodological Approach. Anglistik: International Journal of English Studies. 2018, 29 (1 (March 2018)): 25–40.
Hutcheon 1980 — Hutcheon L. Narcissistic Narrative. The Metafictional Paradox. Waterloo: Wilfrid Laurier University Press, 1980.
Hutcheon 1988 — Hutcheon L. A Poetics of Postmodernism. History, Theory, Fiction. London: Routledge, 1988.
Hutcheon 2002 — Hutcheon L. The Politics of Postmodernism. 2nd ed. London; New York: Routledge, 2002.
Jewitt 2009 — Jewitt C. (ed.) Handbook of Multimodal Analysis. London: Routledge, 2009.
Keen 2006 — Keen S. A Theory of Narrative Empathy. Narrative. 2006, 14 (3 (October 2006)): 207–236.
Lakoff, Johnson 2003 — Lakoff G., Johnson M. Metaphors we live by. Chicago: University of Chicago Press, 2003.
McCaffrey 1982 — McCaffery L. The Metafictional Muse. Pittsburgh: University of Pittsburgh Press, 1982.
Nicol 2009 — Nicol B. The Cambridge Introduction to Postmodern Fiction. Cambridge; New York: Cambridge University Press, 2009.
Ryan 2019 — Ryan M-L. “Truth of fiction versus truth in fiction”, Finzioni. Verità, bugie, mondi possibili. Galvagno R., Rizzarelli M., Schilirò M., Scuderi A. (eds). Between, 2019, IX (18): 1–16.
Serafini 2005 — Serafini F. Voices in the park, voices in the classroom: Readers responding to postmodern picture books. Reading Research and Instruction. 2005, 44 (3): 47–64. van Leeuwen 2005 — van Leeuwen Th. Introducing social semiotics. New York; London: Routledge, 2005.
Walton 1990 — Walton R. Mimesis as Make–Believe. London: Harvard University Press, 1990.
Waugh 1984 — Waugh P. Metafiction. The Theory and Practice of Self — Conscious Fiction. London; New York: Methuen, 1984.
Wolfenbarger, Sipe 2007 — Wolfenbarger C. D., Sipe L. R. A unique visual and literary art form: Recent research on picture books. Language Arts. 2007, 84 (3): 273–280.
References
Бахтин 2000 — Bakhtin M. M. The forms of time and chronotopos in the novel (The essays on historical poetics. 1975). In: Bakhtin M. M. Epos i roman. St Petersburg: Azbuka Publ., 2000. P. 11–193. (In Russian)
Бельская 2020 — Belskaia A. O. Specific features of the English children’s book design in the Modern Era. In: Nauchnye trudy. Vyp. 53. Problemy razvitiia zarubezhnogo iskusstva: sbornik nauchnykh trudov. Razdol’skaia V. I. (sci. ed.). St Petesburg: Institut imeni I. Repina Publ., 2020. P. 154–173. (In Russian)
Гальперин 1981 — Galperin I. R. The text as an object of linguistic description. Мoscow: URSS Publ., 1981. (In Russian)
Гвашиани 2022 — Gvashiani N. B. The “multimodal turn” in cognitive studies of the language through the prism of terms and concepts. Kognitivnye issledovaniia iazyka. 2022, 4 (51): 364–369. (In Russian)
Дымарский 1999 — Dymarskii M. Ia. The problems of text formation and literary text (based on the Russian prose of the 19th–20th centuries). St Petersburg: St. Petersburg University Press, 1999. (In Russian)
Ирисханова 2018 — Iriskhanova O. K. Fedya, dich’! Or on the resonance in language and gestures. Kognitivnye issledovaniia iazyka. 2018, (XXXIII): 598–604. (In Russian)
Ирисханова 2021 — Iriskhanova O. K. The polymodal discourse as an object of investigation. In: Polimodal’nye izmereniia diskursa. Iriskhanova O. K. (ed.). 2nd ed. Moscow: Iazyki slavianskikh kul’tur Publ., 2021. P. 15–33. (In Russian)
Левин 1998 — Levin Iu. I. Selected Works. Poetics. Semiotics. Moscow: Iazyki russkoi kul’tury Publ., 1998. (In Russian)
Липовецкий 1997 — Lipovetskii M. N. Russian postmodernism. Essays on historical poetics. Ekaterinburg: Uralskii gosudarsstvennyi pedagogichekii universistet Publ., 1997. (In Russian)
Логинова 2021 — Loginova E. G. The semiotic resonance in mono- and polymodal discourse (on the basis of the Rusian and English drama). Thesis for Dr Sci. in Philological Sciences. Moscow, 2021. (In Russian)
Молодыченко 2022 — Molodychenko E. N. Identity, style, and styling: a sociolinguistic perspective. Terra Linguistica. 2022, 13 (2) (2022): 11–29. https://doi.org/10.18721/JHSS.13202 (In Russian)
Мяэотс 2021 — Miaeots O. N. The fairy tale about “The three little pigs”: The evolution of the fairy-tale plot in the 20th cent. picturebook. Detckie chteniia. 2021, 19 (1): 215–234. https://doi.org/10.31860/2304-5817-2021-1-19-215-234 (In Russian)
Нефёдов 2016 — Nefedov S. T. The intentional structure and modality of the scientific text. Filologicheskie nauki. Voprosy teorii i praktiki. 2016, 9 (63): 141–145. (In Russian)
Нефёдов 2022 — Nefedov S. T. Evaluation of relevance in the structure of a multimodal scientific text. German Philology in St Petersburg State University. Vol. 12: sbornik statei. St Petersburg: St. Petersburg University Press, 2022. P. 116–135. https://doi.org/10.21638/spbu33.2022.106 (In Russian)
Никитин 2003 — Nikitin M. V. The foundations of cognitive semantics. St Petersburg: Izdatel’stvo Rossiiskii gosudarstvennyi pedagogicheskii universitet imeni A. I. Gertsena Publ., 2003. (In Russian)
Рорти 1995 — Rorty R. Contingency, irony and solidarity. Moscow: Russkoe fenomenologicheskoe obscchestvo Publ., 1995. (In Russian)
Тимофеева 2004 — Timofeeva Z. M. The reflexive authorial play in modern fiction. St Petersburg: Rossiiskii gosudarstvennyi pedagogicheskii universitet imeni A. I. GertsenaPubl., 2004. (In Russian)
Чемодурова 2017 — Chemodurova Z. M. Pragmatics and semantics of play in the 20th–21st cent. Englishlanguage proze. Thesis for Dr Sci. in Philological Sciences. St Petersburg, 2017. (In Russian)
Чемодурова 2019 — Chemodurova Z. M. Cognitive dissonance as a component of the interpretational programme in postmodernist fiction. Voprosy kognitivnoi lingvistiki. 2019, (2): 55–64. (In Russian)
Чернявская 2021 — Сherniavskaia V. E. The text and social context: Sociolinguistic and discursive analysis of meaning-making. Moscow: Lenand Publ., 2021. (In Russian)
Шилихина 2014 — Shilikhina K. M. Semantics and pragamtics of verbal irony. Voronezh: Nauka-Unipress Publ., 2014. (In Russian)
Шмид 2003 — Schmid W. Narratology. Moscow: Iazyki slavianskoi kul’tury Publ., 2003. (In Russian)
Alter 1984 — Alter R. Motives for Fiction. Cambridge (Mass.); London: Harvard University Press, 1984.
Anstey 2002 — Anstey M. “It’s not all black and white”: Postmodern picture books and new literacies. Journal of Adolescent & Adult Literacy. 2002, (45): 444–457.
Chemodurova 2019 — Chemodurova Z. M. The Mechanisms and Types of Foregrounding in Postmodernist Fiction. In: English Language Teaching: Through the Lens of Experience. Haase Ch., Orlova N. (eds). Newcastle: Cambridge Scholars Publishing, 2019. P. 277–295.
Chemodurova 2021 — Chemodurova Z. M. Visual foregrounding in contemporary fiction. Voprosy kognitivnoy lingvistiki. 2021, (2): 5–15. https://doi.org/10.20916/1812-3228-2021-2-5-15
Chemodurova 2022 — Chemodurova Z. M. The Art of Storytelling in the Digital Age: A Multimodal Perspective. Vestnik Volgogradskogo gosudarstvennogo universiteta. Seriya 2. Iazykoznanie. 2022, 21 (6): 110–120. https://doi.org/10.15688/jvolsu2.2022.6.9
Chernyavskaya, Nefedov 2021 — Сhernyavskaya V. E., Nefedov S. T. Towards social Indexicality: From “Kollektiv” to “Team”. And back via Coronavirus Pandemic? Alman Dili ve Edebiyatı Dergisi. Studien zur deutschen Sprache und Literatur. 2021, (46): 1–21. https://doi.org/10.26650/sdsl2021-990815
Fokkema 1986 — Fokkema D. The Postmodern Weltanschauung and its Relation with Modernism. In: Approaching Postmodernism. Fokkema D., Bertens H. (eds). Amsterdam; Philadelphia: John Benjamins Publishing Company, 1986. P. 9–53.
Genette 1988 — Genette G. Narrative Discourse Revisited. Cornell: Cornell University Press, 1988.
Genette 1997 — Genette G. Paratexts: shresholds of interpretation. Cambridge; New York: Cambridge University Press, 1997.
Hallet 2018 — Hallet W. Reading Multimodal Fiction: A Methodological Approach. Anglistik: International Journal of English Studies. 2018, 29 (1 (March 2018)): 25–40.
Hutcheon 1980 — Hutcheon L. Narcissistic Narrative. The Metafictional Paradox. Waterloo: Wilfrid Laurier University Press, 1980.
Hutcheon 1988 — Hutcheon L. A Poetics of Postmodernism. History, Theory, Fiction. London: Routledge, 1988.
Hutcheon 2002 — Hutcheon L. The Politics of Postmodernism. 2nd ed. London; New York: Routledge, 2002.
Jewitt 2009 — Jewitt C. (ed.) Handbook of Multimodal Analysis. London: Routledge, 2009.
Keen 2006 — Keen S. A Theory of Narrative Empathy. Narrative. 2006, 14 (3 (October 2006)): 207–236.
Lakoff, Johnson 2003 — Lakoff G., Johnson M. Metaphors we live by. Chicago: University of Chicago Press, 2003.
McCaffrey 1982 — McCaffery L. The Metafictional Muse. Pittsburgh: University of Pittsburgh Press, 1982.
Nicol 2009 — Nicol B. The Cambridge Introduction to Postmodern Fiction. Cambridge; New York: Cambridge University Press, 2009.
Ryan 2019 — Ryan M-L. “Truth of fiction versus truth in fiction”, Finzioni. Verità, bugie, mondi possibili. Galvagno R., Rizzarelli M., Schilirò M., Scuderi A. (eds). Between, 2019, IX (18): 1–16.
Serafini 2005 — Serafini F. Voices in the park, voices in the classroom: Readers responding to postmodern picture books. Reading Research and Instruction. 2005, 44 (3): 47–64. van Leeuwen 2005 — van Leeuwen Th. Introducing social semiotics. New York; London: Routledge, 2005.
Walton 1990 — Walton R. Mimesis as Make–Believe. London: Harvard University Press, 1990.
Waugh 1984 — Waugh P. Metafiction. The Theory and Practice of Self — Conscious Fiction. London; New York: Methuen, 1984.
Wolfenbarger, Sipe 2007 — Wolfenbarger C. D., Sipe L. R. A unique visual and literary art form: Recent research on picture books. Language Arts. 2007, 84 (3): 273–280.
Downloads
Published
How to Cite
Issue
Section
License
Articles of "Vestnik of Saint Petersburg University. Language and Literature" are open access distributed under the terms of the License Agreement with Saint Petersburg State University, which permits to the authors unrestricted distribution and self-archiving free of charge.
