Overview

AR technology has been applied in many fields. Here introduces the application of AR technology and LCOS display chip to the teaching of ophthalmic corneal transplantation simulation.

Introduction

（1）AR ophthalmic surgery simulation training system

The ophthalmic surgery simulation training system is mainly used in the simulation training of medical students or novice in ophthalmic surgery. The simulated surgical microscope and multiple sensors perform video capture and gesture capture while ophthalmic surgery training, and then standardize the student's surgical operations through image and gesture analysis to improve training efficiency. The system includes primary and secondary eyepieces, and the operator performs a surgical training operation under the primary eyepiece. The entire training process can be viewed and guided through the secondary eyepiece or through the medical surgical teaching system in the remote classroom.

（2）3D collaborative interactive system for ophthalmic keratoplasty simulation

By wearing AR glasses, the simulated 3D surgical animation is vivid and interesting. The system supports multi-person collaborative interaction, and can perform pause, zoom, rotate, move and other interactions through gestures. Other users can see the entire interaction process simultaneously, while other users can interact. Throughout the 3D operation, the TOF sensor can be used for spatial positioning and mapping with other AR glasses and cameras. Multi-channel communication can be performed via the Internet or a local area network, and the surgical process can be projected by a laser projector to allow other participants to watch the process.

The program can be applied to telemedicine, AR surgery simulation, distance education, teleconferencing and other fields.