Restore VR II
for Dunhuang Murals /



Mar 2022- Sep 2022
Supported by the National Key Research and Development Program

Tongxin Sun,Tongtong Jin, Yuru Huang, Meng Li, Yun Wang, Zhe Jia, and Xinyi Fu

Role: project leader, UE developer, UI/UX designer, data analysis

Paper to appear: Restoring Dunhuang Murals: Crafting Cultural Heritage Preservation Knowledge into Immersive Virtual Reality Experience Design. International Journal of Human-Computer Interaction. 2023. [SSCI & SCIE]

demo presented at: CHCI 2022









With the development of digital technology, tourists have higher expectations of digital cultural heritage (CH) visiting experiences. However, there are very few generalized research and design guidelines on how to generate expert knowledge and transfer the value or connotations of digital CH to users in a virtual reality (VR) environment. In this article, we propose a virtual and immersive CH interactive system to generate embodied knowledge and deliver cultural value to the public, taking the virtual restoration experience of the Dunhuang murals as an example. We utilized immersive VR as an interactive medium to provide the public with learning, interactive, and entertaining experiences, to help them transform from tourists to learners while experiencing the digital CH. According to the results of a quantitative and qualitative evaluation study, our system could promote users' cognition of CH preservation and be applied in the domain of digital CH experiences.

Keywords: immersive virtual reality; cultural heritage; multimodal interaction; immersive experience; Dunhuang mural preservation





 Storyboard & main scenarios 
(a) Enter the desert and introduce the scenario. (b) Explore the caves and learn to repair them.
(c) Experience the restoration of murals.




 The video of the entire VR gaming process 



 The overall design of devices & experimental site settings 





 Comparison study 
between the multi-modal group and control group





 The design strategy for the user experience in the CH-based IVR system 


 System user flow