The impact of communicative parameters on the speaker’s spatial orientation in virtual reality
DOI:
https://doi.org/10.21638/spbu09.2024.114Abstract
In this paper, we try to show a specificity of the speaker’s spatial orientation system as a complex of cognitive functions in virtual reality (VR). Spatial orientation can be egocentric, allocentric or geocentric depending on which verbal deictic occurs as a point of reference. The use of one or another type of spatial orientation in VR can be conditioned by various factors. We explore the impact of communicative parameters on the speaker’s spatial orientation in VR. For that purpose, a VR experiment was conducted by applying five scenes with different communicative parameters. The consideration of the connection between the communicative parameters embedded in five different scenes and cognitive processes in the speaker’s orientation in VR is a novelty. The specific features of speaker orientation are presented in terms of three different deictic and communicative aspects: the opposition person-oriented and distance-oriented systems; the communicative situations themselves and their internal parameters; the location of the referent in proximal, medial and distal positions. 24 informants participated in the experiment, and 725 reactions presented in the form of lines were obtained as material which was analyzed and processed in the Semograph Information System. The results showed that in the communication in VR, the allocentric orientation prevails even with the proximal position of the referent, the deictic coordinate system can be fully integrated into some communicative situations, and certain communicative parameters can affect the speaker’s spatial orientation. We discuss the mechanisms that might explain the results and offer recommendations for future experiments.
Keywords:
spatial orientation, virtual reality, point of references, communication, deixis
Downloads
References
References
Anderson, Keenan 1985 — Anderson S. R., Keenan Е. Deixis. In: Language Typology and Syntactic Fieldwork. Vol. 3. Shopen T. (ed.). Cambridge: Cambridge University Press, 1985. P. 259–308.
Anokhin 1968 — Anokhin P. Biology and neurophysiology of the conditioned reflex. Moscow: Meditsina Publ., 1968. (In Russian)
Apresyan 1995 — Apresyan Yu. Selected Works. Lexical semantics. Synonymous language means. 2nd ed., rev. and add. Vol. I. Moscow: Shkola “Iazyki russkoi kul’tury” Publ., 1995. (In Russian)
Becker et al. 2019 — Becker J., Meyer U., Eichler T., Draheim S. A Supernatural VR Environment for Spatial User Rotation. In: IEEE Conference on Virtual Reality and 3D User Interfaces (VR). Abbott D. (ed.). 2019. P. 850–851. https://doi.org/10.1109/VR. 2019.8798290
Berthele 2006 — Berthele R. Ort und Weg. Berlin: Walter de Gruyter, 2006. https://doi.org/10.1515/97831-10890464
Biocca, Levy 1995 — Biocca F., Levy M. R. Communication applications of virtual reality. In: Communication in the age of virtual reality. Jennings B., Dolf Z. (eds). Hillsdale: Erlbaum. 1995. P. 127–157. https://doi.org/10.4324/9781410603128
Blascovich et al. 2002 — Blascovich J., Loomis J., Beall A. C., Swinth K. R., Hoyt C. L., Bailenson J. N. Immersive Virtual Environment Technology as a Methodological Tool for Social Psychology. Psychological Inquiry. 2002, 13 (2): 103–124. https://doi.org/10.1207/S15327965PLI1302_01
Bohil et al. 2009 — Bohil C., Owen C. B., Jeong E., Alicea B., Biocca F. Virtual reality and presence. In: Twenty first century communication: a reference handbook. Eadie W. F. (ed.). Thousand Oaks: SAGE Publications, Inc. 2009, P. 534–544. https://doi.org/10.4135/9781412964005
Bryant 1992 — Bryant D. J. A spatial representation system in humans.Psycholoquy. 1992, 3 (16): 1.
Buckely et al. 2016 — Buckley J., Phelan J., Seery N., Canty D. Assessing visual perception in virtual reality environments. In: Tiernan P. (ed.). Proceedings of the 33rd International Manufacturing Conference. Limerick: University of Limerick, 2016.
Byagowi, Moussavi 2012 — Byagowi A., Moussavi Z. Design of a Virtual Reality Navigational (VRN) experiment for assessment of egocentric spatial cognition. In: 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, San Diego, California, USA. San Diego, 2012. P. 4812–4815. https://doi.org/10.1109/EMBC. 2012.6347070
Creem-Regehr et al. 2015 — Creem-Regehr S. H., Stefanucci J. K., Thompson W. B. Chapter six — Perceiving absolute scale in virtual environments: How theory and application have mutually informed the role of body-based perception. Psychology of Learning and Motivation. 2015, (62): 195–224. https://doi.org/10.1016/bs.plm.2014.09.006
Diessel 1999 — Diessel H. Demonstratives: Form, function, and grammaticalization. Philadelphia: John Benjamins Publishing Company, 1999. https://doi.org/10.1075/tsl.42
Fillmore 1975 — Fillmore C J. Lectures on Deixis 1971. In: Indiana University Linguistics Club. Berkeley: University of California, 1975. P. 217–306.
Fillmore 1982 — Fillmore C. J. Towards a Descriptive Framework for Spatial Deixis. In: Space, Place and Action: Studies in Deixis and Ralated Topics. Jarvella R., Klein W. (eds). Chichester: Wiley, 1982. P. 31–59.
Fox et al. 2009 — Fox J., Arena D., Bailenson J. N. Virtual Reality: A survival guide for the social scientist. Journal of Media Psychology. 2009, 21 (3): 95–113. https://doi.org/10.1027-/1864-1105.21.3.95
Gak 1998 — Gak V. Language transformations. Moscow: Shkola “Iazyki russkoi kul’tury” Publ., 1998. (In Russian)
Gramann 2013 — Gramann K. Embodiment of Spatial Reference Frames and Individual Differences in Reference Frame Proclivity. Spatial Cognition & Computation: An Interdisciplinary Journal. 2013, 13 (1): 1–25. https://doi.org/10.1080/13875868.2011.589038
Interrante et al. 2006 — Interrante V., Ries B., Anderson L. Distance perception in immersive virtual environments, revisited. Virtual Reality Conference, IEEE. 2006: 3–10. https://doi.org/10.1109/VR.2006.52
Jones et al. 2019 — Jones J. A., Hopper J. E., Bolas M. T., Krum D. M. Orientation Perception in Real and Virtual Environments. IEEE Transactions on Visualization and Computer Graphics. 2019, 25 (5): 2050–2060. https://doi.org/10.1109/TVCG.2019.2898798
Jungbluth 2003 — Jungbluth K. Deictics in the Conversation Dyad: Findings in Spanish and Some Crosslinguistic Outlines. In: Deictic Conceptualization of Space, Time and Person. Lenz F. (ed.). Amsterdam; Philadelphia: John Benjamin Publishing Company, 2003. P. 13–40. https://doi.org/10.1075/pbns.112.04jun
Keshner, Kenyon 2009 — Keshner E. A., Kenyon R. V. Postural and spatial orientation driven by virtual reality. Studies in Health Technology and Informatics. 2009, (145): 209–228. https://doi.org/-10.3233/978-1-60750-018-6-209
Klatzky 1998 — Klatzky R. L. Allocentric and egocentric spatial representations: Definitions, distinctions, and interconnections. In: Lecture Notes in Artificial Intelligence. Freksa C., Habel C., Wender K. (eds). Berlin; Heidelberg: Springer, 1998. P. 1–18. https://doi.org/10.1007/3-540-69342-4_1
Levinson 1994 — Levinson S. C. Vision, shape, and linguistic description: Tzeltal body-part terminology and object description. Linguistics. 1994, 32 (4/5): 791–856. https://doi.org/10.1515/ling.1994.32.4-5.791
Levinson 1996 — Levinson S. C. Frames of reference and Molyneux’s question: Crosslinguistic evidence. In: Language and Space. 1996: 109–169. https://doi.org/10.1146/annurev-.anthro.25.1.353
Levinson 2003 — Levinson S. C. Space in language and cognition: Explorations in cognitive diversity. Cambridge: Cambridge University Press, 2003. https://doi.org/10.1017/CBO9780511613609
Leyrer et al. 2011 — Leyrer M., Linkenauger S. A., Bülthoff H. H., Kloos U., Mohler B. The Influence of Eye Height and Avatars on Egocentric Distance Estimates in Immersive Virtual Environments. In: Proceedings of the ACM SIGGRAPH Symposium on Applied Perception in Graphics and Visualization (APGV ‘11), Toulouse, France. Toulouse, 2011. P. 67–74. https://doi.org/10.-1145/2077451.2077464
Lowood 2021 — Lowood H. E. (n. d.). Virtual Reality. Encyclopedia Britannica. Retrieved May 13, 2021, from https://www.britannica.com/technology/virtual-reality (accessed: 15.03.2023).
Mariner 2007 — Mariner L. Cleared for Takeoff: English for Pilots. Book 1. California: AE Link Publications, 2007.
Mohler et al. 2006 — Mohler B. J., Creem-Regehr S. H., Thompson W. B. The influence of feedback on egocentric distance judgments in real and virtual environments. In: Proceedings of the 3rd symposium on Applied perception in graphics and visualization (APGV ‘06), Boston Massachusetts USA. Boston, 2006. P. 9–14. https://doi.org/10.1145/1140491.1140493
Morganti et al. 2013 — Morganti F., Stefanini S., Riva G. From allo- to egocentric spatial ability in early Alzheimer’s disease: A study with virtual reality spatial tasks. Cognitive Neuroscience. 2013, 4 (3–4): 171–180. https://doi.org/10.1080/17588928.2013.854762
Opalka 1982 — Opalka H. Representations of Local Ni-Deixis in Swahili in Relation to Bühler’s “Origo des Zeigfelds”. In: Here and There. Weissenbord J., Klein W. (eds). Amsterdam: John Benjamins, 1982, P. 65–79.
Pan, Hamilton 2018 — Pan X., Hamilton A. F. C. Why and how to use virtual reality to study human social interaction: The challenges of exploring a new research landscape. British Journal of Psychology. 2018, 109 (3): 395–417. https://doi.org/10.1111/bjop.12290
Pastel et al. 2020 — Pastel S., Chen C. H., Bürger D., Naujoks M., Martin L. F., Petri K., Witte K. Spatial orientation in virtual environment compared to real-world. Journal of Motor Behavior. 2020, 53 (6): 693–706. https://doi.org/10.1080/00222895.2020.1843390
Peeters 2019 — Peeters D. Virtual reality: A game-changing method for the language sciences. Psychonomic Bulletin & Review. 2019, 26 (3): 894–900. https://doi.org/10.3758/s13423-019-01571-3
Pfeiffer 2012 — Pfeiffer T. Using virtual reality technology in linguistic research. In: Virtual Reality Workshops (VR), IEEE, Costa Mesa, CA, USA. Costa Mesa, 2012. P. 83–84. https://doi.org/10.1109/-vr.2012.6180893
Phillips et al. 2012 — Phillips L., Interrante V., Kaeding M., Ries B., Anderson L. Correlations Between Physiological Response, Gait, Personality, and Presence in Immersive Virtual Environments. Presence. 2012, 21 (2): 119–141. https://doi.org/10.1162/PRES_a_00100
Rostovtsev-Popel’ 2009 — Rostovtsev-Popel’ A. A. Typology of demonstrations: Average deictics. Voprosyiazykoznaniia. 2009, (2): 22–34. (In Russian)
Shelton, McNamara 1997 — Shelton A. L., McNamara T. P. Multiple views of spatial memory. In: Psychonomic Bulletin & Review. 1997, 4 (1): 102–106. https://doi.org/10.3758/BF03210780
Uspenskiy 2011 — Uspenskiy B. Deixis and secondary semiosis in language. Voprosyiazykoznaniia. 2011, (2): 3–30. (In Russian)
Wartenberg et al. 1998 — Wartenberg F., May M., Pґeruch P. Spatial orientation in virtual environments: Background considerations and experiments. In: Spatial cognition. Freksa C., Habel C., Wender K.(eds). New Jercy: Lawrence Elrbaum Associates, Inc., 1998. P. 469–489. https://doi.org/10.1007/3-540-69342-4_22
Wilson, Soranzo 2015 — Wilson C. J., Soranzo A. The Use of Virtual Reality in Psychology: A Case Study in Visual Perception. In: Computational and Mathematical Methods in Medicine. 2015, ID 151702. https://doi.org/10.1155/2015/151702
Wolbers, Hegarty 2010 — Wolbers T., Hegarty M. What determines our navigational abilities? Trends in Cognitive Sciences. 2010, 14 (3): 138–146. https://doi.org/10.1016/j.tics.-2010.01.001
Downloads
Published
How to Cite
Issue
Section
License
Articles of "Vestnik of Saint Petersburg University. Language and Literature" are open access distributed under the terms of the License Agreement with Saint Petersburg State University, which permits to the authors unrestricted distribution and self-archiving free of charge.
