Manual
1. Medicalholodeck
1.A Quick start
Licenses, navigation, connectivity
1.A.1 Activating license keys on standalone 1.A.2 Activating license keys on PC-VR systems 1.A.3 Hand navigation 1.A.4 Create screenshots and videos (standalone) 1.A.5 Create screenshots and videos (PC-VR) 1.A.6 Connect to Link 1.A.7 Export RXR files on PC-VR and standalone
1.1 Main control pad
1.1.1 Library 1.1.2 Jump 1.1.3 4D Record 1.1.4 TeamXR 1.1.5 Remote Render 1.1.6 Settings 1.1.7 Reset workspace 1.1.8 Undo 1.1.9 Redo 1.1.10 Exit 1.1.11 Capture a movie 1.1.12 Take a photo 1.1.13 Handle
1.2 Object pad
1.2.1 Cutter 1.2.2 Laser 1.2.3 Masking 1.2.4 Measure area 1.2.5 Measure distance 1.2.6 Delete 1.2.7 Scale 1.2.8 Move 1.2.9 Move backward 1.2.10 Frame rate 1.2.11 Remove dataset 1.2.12 Light on/off 1.2.13 Measure angle 1.2.14 Draw 1.2.15 Marker 1.2.16 Rotate horizontally 1.2.17 Rotate vertically 1.2.18 Handle
1.3 Library panel
1.3.1 Saved scenes 1.3.2 Medical Imaging 1.3.3 RecordXR 1.3.4 Dissection Master 1.3.5 Anatomy Master
1.4 Object marker
1.4.1 Center 1.4.2 Lock 1.4.3 Delete 1.4.4 Groups 1.4.5 Cuts visibility
1.5 Lighting
1.5.1 Light 1.5.2 Light marker
1.6 Controllers
1.6.1 Left controller 1.6.2 Right controller
1.7 Settings
1.7.1 Settings 1.7.2 Licenses 1.7.3 PACS 1.7.4 Services
1.8 Link
1.8.1 Device bar 1.8.2 License management 1.8.3 Datasets 1.8.4 RecordXR 1.8.5 Presets 1.8.6 Transfer functions 1.8.7 Upload
2. Medical Imaging
2.A Quick start
Data import, DICOM editing
2.A.1 Importing data on standalone devices 2.A.2 Importing data on PC-VR systems 2.A.3 Edit DICOM 2.A.4 Measure, mark and draw on DICOM
2.1 User interface
2.1.1 Import data 2.1.2 Save 2.1.3 Export 2.1.4 Load data 2.1.5 Delete data
2.2 Medical Imaging XR panel
2.2.1 Option preset 2.2.2 Transfer function 2.2.3 Tissue filter 2.2.4 Transfer function preset 2.2.5 AI segmentation 2.2.6 Mesh generator 2.2.7 Multiplanar 2.2.8 Edge filter 2.2.9 Quality settings 2.2.10 Handle
2.3 Quality settings
2.3.1 Medical imaging settings 2.3.2 Low framerate screen 2.3.3 About 3D DICOM files 2.3.4 Processing and texturing 2.3.5 Challenges with large datasets in VR 2.3.6 Adaptive detail rendering
2.4 PACS connection 2.5 DICOM push
3. Medicalholodeck AI
3.A Quick start
Data loading, AI segmentation
3.A.1 Importing data 3.A.2 Loading data to the workspace 3.A.3 AI Segmentation section 3.A.4 Choosing an AI model 3.A.5 Running segmentation 3.A.6 Visualization
3.1 Segmentation control panel
3.1.1 Structure 3.1.2 Options 3.1.3 Handle
3.2 Running AI segmentation locally
3.2.1 Installing Python 3.2.2 Installing PyTorch 3.2.3 Installing TotalSegmentator
4. Dissection Master
4.1 Changing layers 4.2 Scaling 4.3 Moving 4.4 Rotating 4.5 Annotations 4.6 Visibility controls
5. Anatomy Master
5.1 Scaling 5.2 Taking apart 5.3 Moving 5.4 Rotating 5.5 Cutting 5.6 Annotations 5.7 Visibility controls
6. RecordXR
6.1 User interface
6.1.1 Main control pad 6.1.2 RecordXR section 6.1.3 RecordXR panel
7. RecordXR Studio
7.A Quick start
Recording import, editing, export
7.A.1 Get records from Medicalholodeck 7.A.2 Open RecordXR Studio 7.A.3 Open a project 7.A.4 Add recordings 7.A.5 Zoom in/ zoom out 7.A.6 Change the order 7.A.7 Trim 7.A.8 Set the metadata 7.A.9 Add an avatar 7.A.1 Get records from Medicalholodeck 7.A.11 Export a .RXR file 7.A.12 Exit the platform 7.A.13 Open the recording
7.1 Editing tools
7.1.1 Preview window 7.1.2 Timeline toolbar 7.1.3 Timeline
7.2 Metadata section
7.2.1 Title 7.2.2 Avatar 7.2.3 Preview icons 7.2.4 Duration 7.2.5 Description
7.3 Project controls
7.3.1 Save project 7.3.2 Export RXR 7.3.3 Close
8. TeamXR
8.1 Creating a team 8.2 Joining a team 8.3 Adding data to a session
8.4 Session settings
8.4.1 Users in session 8.4.2 Session code 8.4.3 Disconnect 8.4.4 TeamXR settings 8.4.5 Open library
9. Remote Rendering
9.1 Accessing Remote Rendering 9.2 Using Remote Rendering

1.1 Main control pad

1.1.V1.9-01

The primary tool for navigating Medicalholodeck.

The Main Control Pad is the primary tool for navigating Medicalholodeck. By default, it appears below the Library window. The Library allows you to access datasets. Its visibility can be toggled by clicking the Library button.

The Jump button enables movement in the workspace. Select it using the trigger, then point to your desired location and press the trigger again to change your own position. Click the button again to disable the function.

The 4D Record button allows for creating VR recordings. Press it to start recording, and press it again to stop. Afterward, a control pad will appear above the panel, and the spatial recording will begin playing automatically. Your recordings are saved in the RecordXR section of the library.

In the TeamXR section, you can find VR session settings, such as starting, joining, and managing sessions.

The Remote Rendering function allows the application to run on an external server, offloading 3D graphics processing and improving visual quality. To launch the rendering environment, click the Remote Render button. This function requires a separate app installation and currently supports only standalone VR headsets.

Access the settings by clicking the cogwheel icon. Here you will also find Licenses, PACS and Services.

To remove all datasets from the workspace, click the Reset button. Press the Exit button if you wish to close the application.

To reverse or restore an action, interact with the appropriate arrow icon.

To make a video, press the Record button. It will turn red to indicate that recording has started. Click it again to stop. To capture an image click the Camera button. The images and videos will be saved to your desktop. These two buttons are available only in the PC-VR mode or the Remote Rendering app. On standalone, press the Oculus button and select 'Take Photo' or 'Record Video' option from the application panel.

To move the pad, aim at its handle and hold the trigger. Release the trigger to place the pad in the new position.

Main control pad

1.1.1

Library

1.1.1.V1.9-01

Select this button with the trigger to toggle the library's visibility.

1.1.2

Jump

1.1.2.V1.9-01

Enables movement in the workspace. Select it with the trigger, then point to your desired location. Select again to disable the function.

1.1.3

4D Record

1.1.3.V1.9-01

Creates immersive VR recordings. Select it with the trigger to start recording and again to stop. The recording will then appear in the RecordXR section of the library.

1.1.4

TeamXR

1.1.4.V1.9-01

Opens TeamXR settings. Select it with the trigger to start, join, or manage a VR session.

1.1.5

Remote Render

1.1.5.V1.9-01

Launches the rendering environment. Requires a separate app installation and currently supports only standalone VR headsets.

1.1.6

Settings

1.1.6.V1.9-01

Opens Medicalholodeck’s settings.

1.1.7

Reset workspace

1.1.7.V1.9-01

Clears all models and data from the workspace.

1.1.8

Undo

1.1.8.V1.9-01

Reverts your last action in the VR environment. Press it repeatedly with the trigger to undo multiple actions in order.

1.1.9

Redo

1.1.9.V1.9-01

Restores previously undone actions. Press it repeatedly with the trigger to redo multiple actions in order.

1.1.10

Exit

1.1.10.V1.9-01

Closes the application. Press it with the trigger to exit.

1.1.11

Capture a movie

1.1.11.V1.9-01

Records your VR experience. Press it with the trigger to start and again to stop. The video will be saved to your desktop (only PC-VR). On standalone, press the Oculus button and open the camera icon from the menu. Then select “Record Video.”

1.1.12

Take a photo

1.1.12.V1.9-01

Captures an image of your VR experience. Press it with the trigger to take a photo. The screenshot will be saved to your desktop (only PC-VR). On standalone, press the Oculus button and open the camera icon from the menu. Then select “Take Photo.”

1.1.13

Handle

1.1.13.V1.9-01

Repositions the panel. Select it with trigger and release to set it to a new position.