Narrative Immersion
Narrative immersion research explores how technology can enhance engagement and presence within interactive narratives. Current efforts focus on leveraging large language models (LLMs) to generate dynamic, contextually relevant dialogue and character interactions, often within virtual or augmented reality environments, while addressing challenges like character consistency and hallucination. This work is significant for improving user experience in games, educational tools, and therapeutic applications, as well as for advancing our understanding of human-computer interaction and the cognitive processes underlying narrative engagement. Furthermore, research is exploring how to optimize visual and auditory elements, such as eye height adaptation and spatial audio, to further enhance the sense of presence and realism.
Papers
The Matrix: Infinite-Horizon World Generation with Real-Time Moving Control
Ruili Feng, Han Zhang, Zhantao Yang, Jie Xiao, Zhilei Shu, Zhiheng Liu, Andy Zheng, Yukun Huang, Yu Liu, Hongyang Zhang
Imagine360: Immersive 360 Video Generation from Perspective Anchor
Jing Tan, Shuai Yang, Tong Wu, Jingwen He, Yuwei Guo, Ziwei Liu, Dahua Lin