Contact Us

HoloMedicine® Robotics for Education

Robotic Surgery Training with HoloMedicine® & Apple Vision Pro

Enhance the educational outcomes of robotic training in an immersive, engaging and mixed reality environment within the OR. HoloMedicine® Robotics – for education has been developed with the collaboration of the Mayo Clinic. The platform allows for real time streaming of stereoscopic 3D robotic feeds as well as other 2D video feeds into a mixed reality environment using the Apple Vision Pro. Training the next generation of robotic surgeons just got easier! 
 

Seamless connection with the Da Vinci Surgical Robot

Stream the surgeon’s 3D stereoscopic view directly into the Apple Vision Pro headset, enabling the learner to see exactly what the surgeon sees without the need for an additional training console. 

 

Scalable Training and Collaboration: Institutions can extend surgical training and foster interdisciplinary collaboration by connecting multiple teams across locations, making advanced medical education more accessible, inclusive and efficient.

Start Immersive Learning
HoloMedicine® Robotics
stereoscopic 3d

View additional medical content

Leverage the Apple Vision Pro applications to view patient specific medical data side by side the robotic 3D video stream. This includes pdfs, DICOM, and 3D models to enhance learning through deeper procedural and patient understanding.

 

Real-Time Expert Mentorship: Senior surgeons can provide real-time mentorship by offering live guidance, feedback and oversight to junior surgeons without requiring a secondary console in the operating room.

 

Mixed Reality Experience

 

The richest learning experiences happen within the OR. Take that to the next level by seeing the surgeons view overlayed into the real OR environment by wearing Apple Vision Pro, enabling seamless two-way communication and physical interactions with the surgeon and OR team

 

Immersive Observation: Unlike traditional observation methods, this immersive experience offers enhanced depth perception and contextual awareness, allowing learners to better understand spatial anatomy, instrument positioning, and procedural flow with greater clarity and confidence.

 

Start Immersive Learning
Collaboration with Mayo Clinic
apple vision pro

Leveraging Apple Vision Pro

The Apple Vision Pro features ensure optimal outcomes with the HoloMedicine® Robotics – for education application. These include:

  • Exceptional visualization and resolution with over 23 million pixels. 
  •  Advanced spatial audio and acoustic properties to ensure audio from within the headset and noise from your real environment are managed seamlessly. 
  •  A sophisticated sensor array transmitting over one billion pixels per second delivers precise head and hand tracking and real time 3D mapping to accurately understand your hand gestures. 

Leveraging HoloStreamer ®

The HoloStreamer® acts as a bridge between the Da Vinci surgical robot, and Apple Vision Pro to capture and wirelessly transmits high-quality 3D video feeds directly from the surgeon’s console.

 

Key features:

  • Plug and play quick-pairing functionality.
  • Captures and processes high-quality 4K and 1080p video feeds from medical devices, surgical cameras, and computers.
  • Users can switch between streams or view them simultaneously.
  • Enables real-time streaming with minimal latency for in-room and remote collaboration.
  • Supports both local network and remote streaming, allowing experts to participate from anywhere in the world.
  • Internal capture card supports native 4K input and output for superior video quality.
  • External capture cards provide additional HDMI inputs, though with resolution limitations.
  • Built on a medical-grade Ubuntu-based PC ensuring reliability, security, and stability.
  • Optimized for long-duration streaming without overheating or performance drops.
Start Immersive Learning

The Future Vision of HoloMedicine® Robotics

Imagine inviting other learners to your session outside of the OR and engaging in rich, two-way communications. Imagine these learners can view your OR in a full 360-degree view, providing them with the experience that they are there in real life, observing every detail closely.

 

All this and more will be available in future releases of HoloMedicine® Robotics.