HoloMedicine® Robotics for Education

Robotic Surgery Training with HoloMedicine® & Vision Pro

Enhance the educational outcomes of robotic training in an immersive, engaging and mixed reality environment within the OR. HoloMedicine® Robotics – for education has been developed with the collaboration of the Mayo Clinic. The platform allows for real time streaming of stereoscopic 3D robotic feeds as well as other 2D video feeds into a mixed reality environment using the Apple Vision Pro. Training the next generation of robotic surgeons just got easier! 
 

Seamless connection with the Da Vinci Surgical Robot

Stream the surgeon’s 3D stereoscopic view directly into the Apple Vision Pro headset, enabling the learner to see exactly what the surgeon sees without the need for an additional training console. 

View additional medical content

Leverage the Apple Vision Pro applications to view patient specific medical data side by side the robotic 3D video stream. This includes pdfs, DICOM, and 3D models to enhance learning through deeper procedural and patient understanding. 

 

Mixed Reality Experience

 

The richest learning experiences happen within the OR. Take that to the next level by seeing the surgeons view overlayed into the real OR environment, enabling seamless two-way communication and physical interactions with the surgeon and OR team.

Leveraging Apple Vision Pro

The Apple Vision Pro features ensure optimal outcomes with the HoloMedicine® Robotics – for education application. These include:

  • Exceptional visualization and resolution with over 23 million pixels. 
  •  Advanced spatial audio and acoustic properties to ensure audio from within the headset and noise from your real environment are managed seamlessly. 
  •  A sophisticated sensor array transmitting over one billion pixels per second delivers precise head and hand tracking and real time 3D mapping to accurately understand your hand gestures. 

Leveraging HoloStreamer ®

The HoloStreamer® acts as a bridge between the Da Vinci surgical robot, and Apple Vision Pro to capture and wirelessly transmits high-quality 3D video feeds directly from the surgeon’s console.

Key features:

  • Plug and play quick-pairing functionality.
  • Captures and processes high-quality 4K and 1080p video feeds from medical devices, surgical cameras, and computers.
  • Users can switch between streams or view them simultaneously.
  • Enables real-time streaming with minimal latency for in-room and remote collaboration.
  • Supports both local network and remote streaming, allowing experts to participate from anywhere in the world.
  • Internal capture card supports native 4K input and output for superior video quality.
  • External capture cards provide additional HDMI inputs, though with resolution limitations.
  • Built on a medical-grade Ubuntu-based PC ensuring reliability, security, and stability.
  • Optimized for long-duration streaming without overheating or performance drops

The Future Vision of HoloMedicine® Robotics

Imagine inviting other learners to your session outside of the OR and engaging in rich 2-way communications. Imagine these learners can view your OR in 360 degree view, providing them with the experience that they are there in real life! 
 
All this and more will be available in future releases of HoloMedicine® Robotics.