Research progress and prospect of metaverse teaching rounds

As an innovative teaching model, the Metaverse Teaching Rounds have realized the organic integration of advanced technologies such as virtual reality (VR), augmented reality (AR) and Medical Generative Pre-trained Transformer (MGPT), and built a highly immersive learning environment for students. This teaching mode can not only increase students’ interest in learning, but also help them better understand and master medical knowledge. The research progress of the metaverse empowering medical teaching rounds mainly includes the following fields: (1) The application of VR in teaching rounds. VR technology can improve students’ hands-on skills by providing them with a simulated medical environment and allowing them to practice in a virtual environment. (2) The application of AR in teaching ward rounds. AR technology can integrate virtual medical knowledge into the real medical environment, allowing students to learn virtual medical knowledge in the real medical environment, thereby improving their learning effect. (3) The application of MGPT in teaching ward rounds. MGPT is a natural language processing model based on deep learning technology, which can also be used for medical teaching rounds. At present, the world’s first digital human MGPT — BAIMGPT has been successfully developed and can be extended to teaching ward rounds. (4) By formulating scientific evaluation standards to evaluate the performance and harvest of teachers and students in the metaverse teaching rounds, improvements and optimizations can be made to improve and optimize the problems existing in the teaching process to improve the quality of teaching. In the future, the integration of VR, AR, and MGPT with advanced technologies such as mixed reality (MR) can build a more highly immersive learning environment for students, accelerate the integration of declarative knowledge and procedural knowledge, strengthen students’ theoretical foundation, improve their clinical thinking and practical ability, so as to better solve problems for patients.

Key Words: teaching rounds; virtual reality; augmented reality; mixed reality; artificial intelligence