Manual
1. Medicalholodeck
1.A Quick start
Licenses, navigation, connectivity
1.A.1 Activating license keys on standalone 1.A.2 Activating license keys on PC-VR systems 1.A.3 Hand navigation 1.A.4 Create screenshots and videos (standalone) 1.A.5 Create screenshots and videos (PC-VR) 1.A.6 Connect to Link 1.A.7 Export RXR files on PC-VR and standalone
1.1 Main control pad
1.1.1 Library 1.1.2 Jump 1.1.3 4D Record 1.1.4 TeamXR 1.1.5 Remote Render 1.1.6 Settings 1.1.7 Reset workspace 1.1.8 Undo 1.1.9 Redo 1.1.10 Exit 1.1.11 Capture a movie 1.1.12 Take a photo 1.1.13 Handle
1.2 Object pad
1.2.1 Cutter 1.2.2 Laser 1.2.3 Masking 1.2.4 Measure area 1.2.5 Measure distance 1.2.6 Delete 1.2.7 Scale 1.2.8 Move 1.2.9 Move backward 1.2.10 Frame rate 1.2.11 Remove dataset 1.2.12 Light on/off 1.2.13 Measure angle 1.2.14 Draw 1.2.15 Marker 1.2.16 Rotate horizontally 1.2.17 Rotate vertically 1.2.18 Handle
1.3 Library panel
1.3.1 Saved scenes 1.3.2 Medical Imaging 1.3.3 RecordXR 1.3.4 Dissection Master 1.3.5 Anatomy Master
1.4 Object marker
1.4.1 Center 1.4.2 Lock 1.4.3 Delete 1.4.4 Groups 1.4.5 Cuts visibility
1.5 Lighting
1.5.1 Light 1.5.2 Light marker
1.6 Controllers
1.6.1 Left controller 1.6.2 Right controller
1.7 Settings
1.7.1 Settings 1.7.2 Licenses 1.7.3 PACS 1.7.4 Services
1.8 Link
1.8.1 Device bar 1.8.2 License management 1.8.3 Datasets 1.8.4 RecordXR 1.8.5 Presets 1.8.6 Transfer functions 1.8.7 Upload
2. Medical Imaging
2.A Quick start
Data import, DICOM editing
2.A.1 Importing data on standalone devices 2.A.2 Importing data on PC-VR systems 2.A.3 Edit DICOM 2.A.4 Measure, mark and draw on DICOM
2.1 User interface
2.1.1 Import data 2.1.2 Save 2.1.3 Export 2.1.4 Load data 2.1.5 Delete data
2.2 Medical Imaging XR panel
2.2.1 Option preset 2.2.2 Transfer function 2.2.3 Tissue filter 2.2.4 Transfer function preset 2.2.5 AI segmentation 2.2.6 Mesh generator 2.2.7 Multiplanar 2.2.8 Edge filter 2.2.9 Quality settings 2.2.10 Handle
2.3 Quality settings
2.3.1 Medical imaging settings 2.3.2 Low framerate screen 2.3.3 About 3D DICOM files 2.3.4 Processing and texturing 2.3.5 Challenges with large datasets in VR 2.3.6 Adaptive detail rendering
2.4 PACS connection 2.5 DICOM push
3. Medicalholodeck AI
3.A Quick start
Data loading, AI segmentation
3.A.1 Importing data 3.A.2 Loading data to the workspace 3.A.3 AI Segmentation section 3.A.4 Choosing an AI model 3.A.5 Running segmentation 3.A.6 Visualization
3.1 Segmentation control panel
3.1.1 Structure 3.1.2 Options 3.1.3 Handle
3.2 Running AI segmentation locally
3.2.1 Installing Python 3.2.2 Installing PyTorch 3.2.3 Installing TotalSegmentator
4. Dissection Master
4.1 Changing layers 4.2 Scaling 4.3 Moving 4.4 Rotating 4.5 Annotations 4.6 Visibility controls
5. Anatomy Master
5.1 Scaling 5.2 Taking apart 5.3 Moving 5.4 Rotating 5.5 Cutting 5.6 Annotations 5.7 Visibility controls
6. RecordXR
6.1 User interface
6.1.1 Main control pad 6.1.2 RecordXR section 6.1.3 RecordXR panel
7. RecordXR Studio
7.A Quick start
Recording import, editing, export
7.A.1 Get records from Medicalholodeck 7.A.2 Open RecordXR Studio 7.A.3 Open a project 7.A.4 Add recordings 7.A.5 Zoom in/ zoom out 7.A.6 Change the order 7.A.7 Trim 7.A.8 Set the metadata 7.A.9 Add an avatar 7.A.1 Get records from Medicalholodeck 7.A.11 Export a .RXR file 7.A.12 Exit the platform 7.A.13 Open the recording
7.1 Editing tools
7.1.1 Preview window 7.1.2 Timeline toolbar 7.1.3 Timeline
7.2 Metadata section
7.2.1 Title 7.2.2 Avatar 7.2.3 Preview icons 7.2.4 Duration 7.2.5 Description
7.3 Project controls
7.3.1 Save project 7.3.2 Export RXR 7.3.3 Close
8. TeamXR
8.1 Creating a team 8.2 Joining a team 8.3 Adding data to a session
8.4 Session settings
8.4.1 Users in session 8.4.2 Session code 8.4.3 Disconnect 8.4.4 TeamXR settings 8.4.5 Open library
9. Remote Rendering
9.1 Accessing Remote Rendering 9.2 Using Remote Rendering

1.2 Object pad

1.2.V1.9-01

Provides tools for manipulating, measuring, and annotating datasets. It appears when a dataset is loaded from the library.

The Object Pad is the main toolkit for interacting with datasets. It appears automatically when a dataset is loaded from the library.

The Cutter enables precise slicing through datasets. Select it from the pad using the right trigger. The cutting tool will activate on your left controller. Press the trigger again to switch it to the right. To preview a cut, move your hand into the dataset. Pull the trigger to finalize the slice. To remove a cut, click the red X icon.

Use the Laser tool to interact with user interface elements. Select it by clicking the corresponding button on the pad.

Masking is used to selectively control the visibility of specific regions within a dataset. When the tool is activated, a red ball appears at your controller's fingertip, allowing you to 'paint' in 3D space. Pressing the mask button opens an additional panel.

Use the slider to adjust the diameter of the red ball. Switch between three masking modes. Isolate keeps only the selected area visible, Hide makes it invisible, and Highlight visually emphasizes selected areas. To remove masking, select the Eraser tool. Point at the affected area and hold the trigger. Mask Channels allow you to control multiple masked areas within your dataset. Switch channels to apply and manage independent masking effects. At the bottom of the panel, the volume of the currently masked area is displayed.

To measure surface area, select the Area Measuring tool from the Object Pad. A black cone will appear at the controller’s fingertip. While in the Area Connecting mode, use the additional panel to switch between area types.

In the Circular mode use the trigger to place the centre point. Each new point will connect to both the centre and the previously placed point, forming a shape around the centre. Select one of the points to close the shape. The surface area will be displayed in square millimetres. The new shape can be adjusted. Aim at a point and hold the trigger to reposition it.

In the Continuous mode, there is no fixed anchor point. Each new point connects to the two most recently placed points.

To measure cylindrical shapes, switch to the Cylinder Connecting mode. First set the diameter of the base, then the height of the figure.

To measure linear distance, select the Distance Measuring tool. Set the start and end points with the trigger.

Select the Delete tool to remove objects such as measurements, shapes, or drawings from the workspace. A red X will appear at the controller’s tip. Aim at the object and press the trigger to delete it.

To resize a dataset, aim at the Scale button. Then, move your controller up or down while holding the trigger to adjust the size.

To reposition a dataset, aim at the Move button and hold the trigger. Move your hand to place the dataset in a desired location.

Aim at the Move Backward button, hold the trigger and move your controller up or down to change the dataset’s distance from you.

The number in the top-right corner of the pad shows the current frame rate, helping you monitor how smoothly the app is running.

To remove a dataset from the workspace, press the Delete button.

The Lighting button toggles the lighting on your dataset. In Medical Imaging XR, this function is only available in the PC-VR mode.

To measure an angle in 3D space, start by selecting the angle measuring tool from the pad. Then press the trigger to set the vertex and place the two arms of the angle by setting each endpoint. The angle will appear in degrees as soon as both lines are placed.

Choose the Drawing tool, hold the trigger and move your controller to draw in the workspace. Use the Stroke Width slider to adjust the thickness of your lines. Pick a colour from the extra panel and press the trigger to apply it to your drawing.

To place a visual marker, select the Marker tool. A coloured arrow will appear at your controller’s fingertip. Move it into place and press the trigger to drop the marker.

To rotate the dataset, aim at the Rotate Horizontally or Rotate Vertically button. Hold the trigger and move your controller left and right for horizontal rotation, or up and down for vertical.

Reposition the object pad by aiming at its handle, holding the trigger and dragging it to a desired location.

Object pad

1.2.1

Cutter

1.2.1.V1.9-01

Enables precise cuts through the datasets. Select it with the right trigger to activate the cutter on your left controller; press again to switch it to the right. Move your hand into the model to see a live cut. Pull the trigger to fix the cut. To remove it, point your laser at the red X. Use the marker’s cut visibility button to show/hide cuts.

1.2.2

Laser

1.2.2.V1.9-01

Turns on the laser on your right controller. Use the laser to point at interface elements, and press the trigger to select or activate them.

1.2.3

Masking

1.2.3.V1.9-01

Lets you focus on specific regions of a DICOM dataset by modifying their visibility. Use your controller like a brush to 'paint' areas in the 3D image - depending on the selected mode, the marked region will be hidden, isolated, or highlighted. Pressing the mask button with the trigger opens an additional panel and displays a red ball at your controller’s fingertip. Masking requires a lot of rendering power so it is recommended for PC-VR setup.

1.2.3.1

Mask size

Adjusts the red ball’s size. Use the slider to set the desired width.

1.2.3.2

Mask mode

Allows switching between different masking modes.

  • Allows switching between different masking modes.
  • Isolate: keeps only the selected area visible
  • Hide: hides the selected area

1.2.3.3

Erase

Restores masked areas. Point at the region, hold the trigger to unmask, then release.

1.2.3.4

Mask channel

Let you organize and separate different masked areas within your DICOM dataset. Switch channels to apply and manage varied masking effects.

1.2.3.5

Mask volume

Shows the volume of the masked area on the selected channel.

Masking

1.2.4

Measure area

1.2.4.V1.9-01

Enables area measurement. Press it with the trigger and a black cone will appear at your controller’s fingertip. Place the points to define the shape and when finished the surface area will be displayed in square millimeters (mm²). All shapes can be adjusted. Aim at a point and hold the trigger to replace it. You can choose between two connection modes: area and cylinder.

1.2.4.1

Area mode

This mode calculates the surface area based on your selected points. You can choose between two sub-modes.

Area mode

1.2.4.1.1

Circular mode

The first point you place defines the center of a circle. All points added after that define the circumference of the circle. These points are used to calculate the surface area. To close the shape, move the cone near any point and press the trigger when the “click to close the shape” prompt appears.

1.2.4.1.2

Continuous mode

After placing two first points, each new point you add connects with the previous two points to form a triangle. The total surface area is calculated by summing the areas of all the resulting triangles. To close the shape, move the cone near any point and press the trigger when the “click to close the shape” prompt appears.

1.2.4.2

Cylinder mode

In this mode the diameter and height of a cylinder are calculated based on three points. The first two points define the base circle of the cylinder, while the third point determines its height by measuring the distance from the base plane. After placing the third point, diameter and height will be calculated.

Measure area

1.2.5

Measure distance

1.2.5.V1.9-01

Allows distance measurement. Press it with the trigger and a black cone will appear at your controller’s fingertip. Press the trigger to set the start point, move to the endpoint, and press again to display the distance in millimeters.

1.2.6

Delete

1.2.6.V1.9-01

Removes objects like measurements, shapes, or drawings from the workspace. A red X will appear on your controller - aim at the object and press the trigger to delete it.

1.2.7

Scale

1.2.7.V1.9-01

Resizes the active dataset. Press it with the trigger to enter scaling mode. Move the controller up or down while holding the trigger to adjust the size, then release the trigger to set it.

1.2.8

Move

1.2.8.V1.9-01

Repositions the active dataset. Aim at the button, hold the trigger and use your hand movement to move the dataset. Release to place it.

1.2.9

Move backward

1.2.9.V1.9-01

Adjusts the dataset’s distance. Aim at the button, hold the trigger and move the controller up or down to bring it closer or farther while holding the trigger. Release to set the position.

1.2.10

Frame rate

1.2.10.V1.9-01

Displays performance in FPS, helping you monitor app smoothness.

1.2.11

Remove dataset

1.2.11.V1.9-01

Deletes the active dataset. Press this button with the trigger to remove the dataset from the workspace.

1.2.12

Light on/off

1.2.12.V1.9-01

Controls dataset lighting. Press the trigger to toggle the light on or off. In Medical Imaging XR, lighting is available only in PC-VR mode due to performance limitations.

1.2.13

Measure angle

1.2.13.V1.9-01

Measures angles in VR. Press the trigger to set the angle’s vertex, then define the two line endpoints. The angle in degrees appears instantly once both lines are placed.

1.2.14

Draw

1.2.14.V1.9-01

Enables drawing. Aim your laser at the button, press the trigger, and move your controller to draw lines. An additional panel will appear. Release the trigger to stop drawing.

1.2.14.1

Stroke width

Use the stroke width slider to adjust the line thickness. Aim your laser, pull the trigger, and adjust the size to your preference.

1.2.14.2

Color

Select your desired color and press the trigger to apply it.

Draw

1.2.15

Marker

1.2.15.V1.9-01

Places visual markers in the workspace. Aim your laser at the button, press the trigger, and a colored arrow will appear at your controller’s fingertip. Move it to the desired location and press the trigger to place the marker.

1.2.16

Rotate horizontally

1.2.16.V1.9-01

Rotates the active dataset horizontally. Hold the trigger while moving the controller left to right, then release to set the angle.

1.2.17

Rotate vertically

1.2.17.V1.9-01

Rotates the active dataset vertically. Hold the trigger and move the controller up and down, then release to set the angle.

1.2.18

Handle

1.2.18.V1.9-01

Repositions the panel. Select it with trigger and release to set it to a new position.