Hello everyone! This is Gao from the research group.

This time, I read the following paper to broadly examine research on the use of VR in science education.

Paper Title: Development of an immersive simulator for improving student chemistry learning efficiency

Authors: Shan Jin, Yuyang Wang, Lik-Hang Lee, Xinyi Luo, and Pan Hui

Journal: Proceedings of the 16th International Symposium on Visual Information Communication and Interaction (VINCI ’23)

Publisher: Association for Computing Machinery (ACM), New York, NY, USA

Year of Publication: 2023

DOI: https://doi.org/10.1145/3615522.3615535

1. Introduction

Traditional chemistry laboratory classes at universities face issues such as high safety risks, high equipment costs, and high barriers to operation. During the COVID-19 pandemic, practical training could not be conducted in online classes, leading to low learning effectiveness. Additionally, beginners often struggle with operations and are prone to making mistakes. At the same time, VR is increasingly being used in the field of education, particularly in scenarios like chemistry experiments that involve high operational risks and costs. The contribution of this research lies in the development of a comprehensive VR chemistry experiment simulator and the investigation of users’ learning efficiency regarding operational skills and their sense of security in a virtual environment.

2. Related Work

VR is already widely used in education across many disciplines, and numerous studies have demonstrated that it improves interest in learning and efficiency. Existing research on chemistry education also focuses on safety, learning efficiency, and engagement, but none have compared the effects of different VR environments on students’ learning efficiency, which served as the starting point for this study. The research question was whether a VR scenario with exam-induced pressure improves students’ learning efficiency and sense of security. The research hypothesis was that an environment with exam pressure increases psychological tension, thereby improving concentration, learning efficiency, and operational safety.

3. Research Methodology

The VLAB system developed by the authors consists of four parts: a VR device and video presentation center for teaching basic operations, a comprehensive learning center providing materials such as experiment safety and system introductions, a virtual lab that simulates a university chemistry laboratory, and other learning tools to check the acquisition of theoretical knowledge. The system simulates multiple hazardous experimental scenarios, aiming to enhance safety awareness by showing the consequences of danger in advance rather than through visual stimulation alone. The exam system has a 5-minute time limit; exceeding the time or damaging equipment results in point deductions, and the interface displays a countdown and real-time scores.

In the experimental design, 39 university students (26 male, 13 female, average age 22) were targeted. All participants had basic knowledge of chemistry experiments, while the majority had no VR experience. The experimental procedure involved random grouping after wearing the equipment, followed by the sequential execution of Scenario A (no exam: free operation, no time limit, no scoring) and Scenario B (with exam: time limit, with scoring). Participants answered the NASA-TLX questionnaire at the end of each scenario and evaluated 16 items in a custom user experience questionnaire after all experiments were completed. Data analysis used the chi-square test to analyze the significance of each indicator, measured effect sizes with the Phi coefficient, and compared indicators such as subjective learning efficiency, sense of security, task completion time, and heart rate changes.

4. Results

Regarding subjective feedback, the majority of students indicated that the VR exam environment enhances learning efficiency and sense of security, with 94.87% and 92.31% of students responding positively, respectively. In the user experience questionnaire, significantly positive evaluations were obtained for all design items, including attractiveness, clarity, efficiency, dependability, stimulation, novelty, and content quality.

Regarding objective data, no significant differences were found in average heart rate and task completion time based on the presence or absence of an exam. However, it was reported that the high heart rate group completed tasks faster in the exam scenario, while there was no significant difference in the non-exam scenario. In the NASA-TLX evaluation, the exam scenario significantly outperformed the non-exam scenario in all indicators: mental demand, physical demand, temporal demand, performance, effort, and frustration, indicating that while the exam causes more fatigue and stress for students, it also promotes greater effort.

5. Discussion and Limitations

Reasons why the exam scenario improves efficiency include the psychological arousal effect where tension from the exam increases concentration and immersion, behavioral regulation through the scoring system where awareness of point deductions encourages accurate and careful operation, and the warning effect of danger animations where visual impact reinforces risk perception. Reasons for the lack of significant difference in time include that VR beginners are unfamiliar with operations and may become slower and more cautious when nervous, some students explore freely in the non-exam scenario out of curiosity, increasing time, and there are large individual differences. Reasons why the exam scenario improves the sense of security include careful operation to avoid damaging equipment due to the scoring/deduction system, the ability to visually understand the consequences of mistakes through accident animations to build risk perception in advance, and the presence of clear operational and evaluation criteria.

Limitations include the lack of comparison with actual face-to-face experiments, the lack of quantification of theoretical knowledge acquisition, the possibility that fatigue or motion sickness from long-term VR use may affect data, the fact that a clear numerical model for heart rate and learning efficiency has not been established, and the small sample size of 39, all of whom were university students, limiting generalizability.

6. Conclusion

Key findings indicate that a VR environment with exam pressure increases students’ subjective learning efficiency and sense of security; there is no significant difference in average heart rate and completion time with or without an exam, but students with high heart rates tend to operate faster under exam conditions; the exam scenario showed significantly higher scores in all six NASA-TLX indicators, involving greater effort and load but also higher performance evaluation; the user experience survey received significantly positive evaluations for all system design items; and the exam scenario improves learning efficiency through psychological arousal, behavioral regulation, and danger warnings. Future tasks include comparison with actual face-to-face experiments, quantification of theoretical knowledge acquisition, verification with more diverse participants, evaluation of the effects of fatigue and motion sickness during long-term use, and modeling the relationship between heart rate and learning efficiency.

Reflections

Through this paper, I was able to gain a deep understanding of the potential for applying VR technology to chemistry experiment education. In particular, the finding that exam pressure positively affects learning efficiency and sense of security was interesting, and I felt that pressure does not necessarily have a negative impact. I also felt that the danger simulation in the VR environment is practical in contributing to improved safety awareness. However, I felt that the small sample size and the lack of comparison with actual experiments are issues for the future. I look forward to more large-scale research and comparative studies with learning in actual laboratories in the future.

Report by: Yuqi Gao