Manuals

1. Medicalholodeck
1.1 Main control pad
1.1.1 Library 1.1.2 Jump 1.1.3 4D Record 1.1.4 TeamXR 1.1.5 Remote Render 1.1.6 Settings 1.1.7 Reset workspace 1.1.8 Undo 1.1.9 Redo 1.1.10 Exit 1.1.11 Capture a movie 1.1.12 Take a photo 1.1.13 Handle
1.2 Object pad
1.2.1 Cutter 1.2.2 Laser 1.2.3 Masking 1.2.4 Measure area 1.2.5 Measure distance 1.2.6 Delete 1.2.7 Scale 1.2.8 Move 1.2.9 Move backward 1.2.10 Frame rate 1.2.11 Remove dataset 1.2.12 Light on/off 1.2.13 Measure angle 1.2.14 Draw 1.2.15 Marker 1.2.16 Rotate horizontally 1.2.17 Rotate vertically
1.3 Library panel
1.3.1 Saved scenes 1.3.2 Medical Imaging 1.3.3 RecordXR 1.3.4 Dissection Master 1.3.5 Anatomy Master
1.4 Object marker
1.4.1 Center 1.4.2 Lock 1.4.3 Delete 1.4.4 Groups 1.4.5 Cuts visibility
1.5 Lighting
1.5.1 Light 1.5.2 Light Marker
1.6 Controllers
1.6.1 Left controller 1.6.2 Right controller
1.7 Settings
1.7.1 Settings 1.7.2 Licenses 1.7.3 PACS 1.7.4 Services
1.8 Quality settings
1.8.1 Medical imaging settings 1.8.2 Low framerate screen 1.8.3 About 3D DICOM files 1.8.4 Processing and texturing 1.8.5 Challenges with large datasets in VR 1.8.6 Adaptive detail rendering
1.9 Tutorials
1.9.1 Activate licenses 1.9.2 Use Your Hands To Navigate in VR 1.9.3 Capture Screenshots and Videos
2. Medical Imaging
2.1 User interface
2.1.1 Import 2.1.2 Save 2.1.3 Export 2.1.4 Load data 2.1.5 Delete data
2.2 Medical Imaging panel
2.2.1 Option preset 2.2.2 Transfer function 2.2.3 Tissue filter 2.2.4 Transfer function preset 2.2.5 Mesh generator 2.2.6 Edge filter 2.2.7 Quality settings 2.2.8 Handle
2.3 Tutorials
2.3.1 Import and display data 2.3.2 Importing data on standalone devices 2.3.3 Edit DICOM 2.3.4 Measure, mark and draw on DICOM
3. Medicalholodeck AI
3.1 What is AI segmentation? 3.2 How to run AI segmentation in the cloud? 3.3 How to run AI segmentation on your device?
3.4 How to use the segmentation control panel?
3.4.1 Structure 3.4.2 Options
3.5 How to install TotalSegmentator?
3.5.1 Installing Python 3.5.2 Installing PyThorch 3.5.3 Installing TotalSegmentator
4. Dissection Master
4.1 Model
4.1.1 Changing layers 4.1.2 Scaling 4.1.3 Moving 4.1.4 Rotating 4.1.5 Annotations 4.1.6 Visibility Controls
5. Anatomy Master
5.1 Model
5.1.1 Scaling 5.1.2 Taking apart 5.1.3 Moving 5.1.4 Rotating 5.1.5 Cutting 5.1.6 Annotations 5.1.7 Visibility controls
6. RecordXR
6.1 User interface
6.1.1 Main control pad 6.1.2 RecordXR panel 6.1.3 Library panel
7. RecordXR Studio
7.1 Editing tools
7.1.1 Preview window 7.1.2 Timeline toolbar 7.1.3 Timeline
7.2 Metadata section
7.2.1 Title 7.2.2 Avatar 7.2.3 Preview icons 7.2.4 Duration 7.2.5 Description
7.3 Project controls
7.3.1 Save project 7.3.2 Export RXR 7.3.3 Close
7.4 Tutorials
7.4.1 Get records from Medicalholodeck 7.4.2 Open RecordXR Studio 7.4.3 Open a project 7.4.4 Add recordings 7.4.5 Zoom in/zoom out 7.4.6 Change the order 7.4.7 Trim 7.4.8 Set the metadata 7.4.9 Add an avatar 7.4.10 Saving the project 7.4.11 Export a .RXR file 7.4.12 Exit the platform 7.4.13 Open the recording
8. Link
8.1 Device dashboard
8.1.1 Device bar 8.1.2 License management 8.1.3 Datasets 8.1.4 RecordXR 8.1.5 Presets 8.1.6 Transfer Functions 8.1.7 Upload
8.2 Tutorials
8.2.1 How to add your device 8.2.2 Activating a license via Link 8.2.3 Uploading data from your computer to your headset 8.2.4 Accessing files via Link

3. Tutorials

3.1

Import and Display Data

To import a file, launch Medicalholodeck and click on the '+' button on the top left of the Library Panel. Use the file explorer to navigate to your data. Medicalholodeck supports multiple file formats, including DICOM, STL, OBJ, PDF, JPG, and MP4 files. Select the file or the whole folder by clicking on it, and then click the 'Select' button at the bottom.

Medicalholodeck will analyze the folder and display all the compatible data for review. You can select and import multiple files at once.

When you've made your selections, click the 'Import' button at the bottom of the screen. This will load your chosen data into the Library. Your selected data has been successfully imported and is ready for use.


Display DICOM

To display a DICOM dataset select it with the laser from the library. The data will load in front of you. Grab it with your hands or the laser. You can display several DICOM datasets side by side.

You can load a DICOM dataset several times and compare them side by side. The active dataset is marked with a blue circle on the floor. Changes will appear only on the activated dataset. To activate another dataset, grab it with your hands or trigger it with the laser.

3.2

Importing Data on Standalone Devices

To import a file, launch Medicalholodeck and click the '+' button on the top left of the Library Panel. Next, go to the 'Cloud' tab and note your 6-digit device ID from the bottom of the screen, you will need it for connecting your VR headset to your computer.

Open a web browser on your computer, navigate to www.medicalholodeck.com/link, and add your headset’s device ID from the previous step. Select 'Upload' from the menu. An upload box will appear, ready to receive the files to import. Medicalholodeck supports various file formats, including DICOM, STL, OBJ, PDF, JPG, and MP4. Drag and drop the files onto the upload box. Wait until upload is finished.

Then put on your VR headset. In Medicalholodeck, select the files you want to add to the Library and click the 'Import' button at the bottom. Your files will now be available in Medicalholodeck Library, ready for work.

3.3

Edit DICOM

Once you have loaded your DICOM dataset from the Library into VR, the Medical Imaging XR Panel will appear. This panel is your control center for customizing the display of DICOM data. The Color Section is located at the top. Adjust the transparency and assign colors to specific Hounsfield Units (HU) using Color Pins.

The transparency is adjustable from 0% to 100%. Modify these values by moving the Color Pins vertically. Hounsfield Units (HU) allow you to filter DICOM data based on radiodensity. Moving the Color Pins horizontally will assign specific colors to specific HU values. Use the Color and Hue Pickers located on the right side to change the color of each pin.

The Preset Section is located on the left side of the panel. Medicalholodeck provides several built-in color presets. To edit a preset, move the existing color pins or add new ones until the desired tissues are visible. To save the current settings, click the "+" button at the top of the Preset Section. This will create a new custom preset.

Next, there is the Tissue Filter Section. This section includes the Lower and Upper Hounsfield Unit (HU) buttons. Move these buttons to window DICOM data until the desired body tissue is visible. You also have the option to switch between Relative and Absolute Color Values.

In absolute mode, colors are fixed to specific Hounsfield Units (HU). This means that when you limit the HU range using the Lower and Upper HU buttons, you also limit the visibility of colors associated with those HU values.

On the other hand, in relative mode, colors are not directly tied to specific HU values. Instead, they are relative to the current HU window. This means that when you adjust the HU range, the full spectrum of colors will still be visible within the new window, regardless of how narrow it might be. This allows more flexibility in visualizing different tissue types within a specific HU range.

Below the Tissue Filter Section, you will find the Mesh Generator Section. This feature allows you to generate a 3D mesh from your DICOM data, which can be used to create 3D models for printing or further analysis. Find a tutorial for mesh generating here.

Next, we have the Edge Filter Section. This feature is used to enhance the visibility of transitions between different tissue densities in your DICOM data. Filtering based on tissue homogeneity allows clearer differentiation between structures. When the filter is adjusted towards the left, it focuses on more homogeneous tissue. As you move the filter towards the right, it increasingly highlights areas where there is a rapid change in tissue density, such as transitions from soft to dense tissue. This makes it easier to distinguish between different structures in your dataset.

In the Quality Section, you can adjust the displayed quality of the DICOM data. This tool allows you to fine-tune the balance between the visual quality of your DICOM data and the application's performance. By adjusting this setting, you can optimize the display of your data to match the capabilities of your computer. Whether you prioritize high-resolution imagery or smoother performance, this function allows you to customize your experience to your needs.

3.4

Measure, Mark and Draw on DICOM

Use tools for measuring, marking and drawing in virtual reality. The measurements, markers and drawings are connected to the active dataset and will move and scale with it. They can be removed with the delete tool on your Panel.



Measuring Distances in Virtual Reality: Precise Spatial Measurements in Medicalholodeck

To measure distances, select the measurement tool from the Control Panel. Move the black cone on your fingertip to the first position. Press the trigger to fix the first point, move the cone to the endpoint, and press the trigger again. The distance measure between the two points will be displayed in millimeters.

Select the delete function from the Control Panel to delete a measurement, move the delete icon on your fingertip to the measurement, and press the trigger.



Measuring Distances in Virtual Reality: Precise Spatial Measurements in Medicalholodeck

Highlight important areas in a DICOM with arrow-shaped markers. Select the marker function from the control panel, and an arrow will appear on your fingertip. Move it to the field of interest in your data set and press the trigger.

Select the delete function from the control panel to delete a marker, move the delete icon on your fingertip to the marker, and press the trigger. The marker will disappear.



Free Line Drawing in Virtual Environment

Use the drawing tool for free line drawing in VR. Select the tool from the Object Pad. Customize the thickness and color of lines. Use the provided Slider to increase or decrease the thickness, and select your favored Color on the Color Buttons.

After adjusting settings, hold the trigger on your right controller to initiate drawing. While holding the trigger, move your hand. You will notice lines drawn in 3D space. Experiment with different movements and angles to create your drawings.

To stop drawing, release the trigger button. This action will stop the creation of lines.

To delete a drawing, select the delete function from the Object Pad. A delete tool will appear on your fingertip. Move the delete tool over the drawing you want to remove and press the trigger button on your controller. This action will remove the selected drawing from the 3D environment.