Mixed Reality

We believe that mixed reality (XR) - a term to encompass augmented reality (AR) and virtual reality (VR) - will play a vital role in tomorrow's medicine. Among others, therapy preparation and support in the operating room as well as education and patient empowerment are important applications of mixed reality, which we are supporting with our technologies. To this end, we are employing cutting edge devices, like for instance the new Microsoft HoloLens 2, empowering both research and industry.


In the AHrEZ project, we will create an augmented-reality-based multi-user application that enhances and automates placement, interaction and realistic visualization in the context of pancreatic surgery.



The “VIVATOP” project, which is funded by the Federal Ministry of Education and Research, supports the planning and execution of surgeries as well as training and education scenarios using virtual reality, augmented reality and 3D printing.


Mobile Liver Explorer

Surgeons typically rely on their memory or use paper printouts for planning. We have changed this situation with a mobile app that allows interactive, full access to patient data. This further supports the surgeons and thus improves the safety of the operation.


In the MINIMAKI project, we and our partners are investigating how heart valve surgery can benefit from mixed reality techniques in planning and visualization, for example in heart team discussions, patient information, and for data fusion in the OR.


To develop navigation, visualization and registration tools for endovascular procedures, we use AR in the Nav EVAR project to present the current intervention status (i.e. the catheter position) with respect to planning data acquired before the intervention.