Medicalholodeck logo

Medicalholodeck®
Medical Imaging XR Pro

User Manual

User Interface

The Medical Imaging XR User Interface consists of the Main Control Pad, the Object Pad, the Library Panel, Medical Imaging XR Panel and Object Marker.

Main Control Pad

The Main Control Pad in the Medicalholodeck interface houses various buttons with symbols, each representing a unique function.
Main Control Pad
A Pad Handle
Utilize the Pad Handle to reposition the UI element. Hover over the Pad Handle with your laser, then click and hold it by pressing the trigger button on your controller. Move it to your desired location, and then release the trigger button to set the new position. This flexibility allows you to place the control pad to suit your preferences.
B Library
Click the Library Button to toggle the Library Panel on or off. Simply point your laser at it and press the trigger to make the Library appear or disappear.
C Settings
Use the Settings Button to open settings. Point your laser at it, and press the trigger button to open the Settings Panel. The Settings Panel is divided into three sections. On the left, you'll find the General options. And on the right, you have the Recording options. Finally, you can change the tab to Licenses at the top. The licenses screen lets you activate the licenses and check the license expiration date. To close settings click the same button again.
D Reset
Resetting the environment is an essential feature that allows you to clear everything from the scene and return it to its original state. This function is particularly useful when you want to start a new project, troubleshoot issues, or simply clean up the workspace.
E Quit
To close the application use the Quit Button. Aim your laser at the Quit Button and click the trigger to exit the application.
F Undo
Utilize the Undo Button to reverse your actions within the environment. Direct your laser towards the button and activate it by clicking the trigger, effectively undoing your most recent action.
G Redo
Utilize the Redo Button to easily redo any actions. Simply direct the laser at the button and click the trigger to restore the action instantly.
H Capture Movie
Utilize the Capture Movie Button to record a video from your perspective. Simply direct your laser at the button and click the trigger to initiate recording. To stop recording, click the same button once more. Your movie will then be accessible as a video file on the Desktop.
I Screenshot
Use the Screenshot Button to capture an image of your perspective. Simply point your laser at the button and click the trigger to take a screenshot, and the image will be automatically saved to your Desktop.

Object Pad

The Object Pad is equipped with a suite of tools designed for dataset manipulation, measurement, and annotation. It becomes available when a dataset is loaded from the Library.
Object Pad
A Pad Handle
Utilize the Pad Handle to reposition the UI element. Hover over the Pad Handle with your laser, then click and hold it by pressing the trigger button on your controller. Move it to your desired location, and then release the trigger button to set the new position. This flexibility allows you to place the control pad to suit your preferences.
B Cutter On/Off
Use the Cutter On/Off Button to toggle the cutting tool, enabling you to make precise cuts through the DICOM data. To activate, point your laser at the button and press the trigger; the cutting tool will appear on your left controller. You can then move the cutting tool into the DICOM dataset to cut out specific portions by maneuvering your controller. To place a cut, position the cutting tool as desired and press the trigger button on the left controller. You can create multiple cuts on a single dataset. To remove a selected cut, aim your laser at the X Button located in the right top corner of a cut and press the trigger on your right controller. To deactivate the cutting tool, simply press the Cutter On/Off Button again.
C Laser On/Off
  • Turning on the Laser: To activate the Laser, press the Laser On/Off Button. The laser beam will be emitted from your right controller.
  • Navigating the User Interface: Point the laser beam directly at any button or item within the interface.
  • Making a Selection: To choose or activate a button/item, aim the laser at it and press the trigger on your controller.
D Remove Dataset
Utilize the Remove Dataset Button to delete the active dataset from the environment. Simply aim your laser at the button and press the trigger. This action will immediately remove the selected dataset from the scene, allowing you to maintain a clear and organized virtual workspace.
E Light On/Off
Navigate to the Object Pad, and locate the Light On/Off Button. Press the trigger button once to deactivate the light. To reignite the light, simply press the button again.
F Measure Area
  1. In the Object Pad on your interface, pinpoint the Measure Area Button.
  2. Aim your controller's laser directly at this button and press the trigger to activate. Upon activation, a black cone materializes on your controller's fingertip.
  3. Initiate your shape by pressing the trigger, defining the first point. As you navigate your controller, press the trigger to expand the shape with more points.
  4. To finalize your shape, guide the cone close to a nearby previously set point. When the CLICK TO CLOSE SHAPE prompt appears, click the trigger. The calculated surface area of the shape will be displayed in square millimeters (mm²) in the center of your shape.
Area Measurement Panel
A Circular Mode
Select Circular Mode to change the way the shape is constructed to always connect new points with the first point.
B Continuous Mode
Select Continuous Mode to append new points to the last point created, allowing for continuous shapes and bands.
G Measure Distance
Use the Measure Distance Button to engage the Measure Distance tool, enabling precise distance measurements within the environment. Aim your laser at the button and click the trigger to activate this feature; a black cone will appear on the fingertip of your controller. Press the trigger button to set the starting point, then move the cone to the endpoint, and press the trigger again. The distance between the two points will be clearly displayed in millimeters, providing you with an accurate and easy-to-read measurement.
H Measure Angle
Use the Measure Angle Button to activate the Measure Angle tool, facilitating the measurement of angles within the environment. Aim your laser at the button and click the trigger to initiate the tool; a black cone will appear on the fingertip of your controller. Press the trigger to establish the vertex (middle point) of the angle measurement, then move the cone to the endpoint of the first line segment and press the trigger to define it. Next, move the cone to the endpoint of the second line segment; the degrees value will appear instantly. Press the trigger once more to finalize the second line. The angle between the lines will be accurately displayed in degrees, giving you a precise understanding of the spatial relationships in your virtual workspace.
I Draw
Use the Draw Button to activate the Free Line Drawing tool, enabling you to sketch freely within the environment. Aim your laser at the button and click the trigger to engage the tool; a black dot will materialize at the fingertip of your controller, and the Free Line Drawing Panel will appear below the Object Pad. Press the trigger button and move your controller to initiate drawing lines in the virtual space. Once you release the trigger button, the line creation will cease, allowing you to control your drawings with precision and creativity. Free Line Drawing Panel
A Stroke Width
Use the Stroke Width Button to modify the thickness of the lines you draw. Aim your laser at the button, then pull the trigger and adjust the value to your preferred size. This action will correspondingly increase or decrease the size of the dot on your fingertip, providing you with precise control over the appearance of your lines in the virtual environment.
B Select Color
Target the color of your choice and press the trigger button. This action will update the color for the Free Line Drawing tool.
J Marker
Use the Marker Button to engage the Mark Tool within the virtual environment. Aim your laser at the button and press the trigger to activate the tool; a colored arrow will materialize at your controller's fingertip. Guide the controller to your area of interest within the dataset and press the trigger to set the marker. A colored arrow will appear at the chosen location, providing a visual reference point.
K Delete
Use the Delete Button to enable the Delete tool, designed to remove various objects such as measurements, shapes, drawings, markers, etc., within the environment. To activate it, aim your laser at the Delete Button and press the trigger; a red X icon will appear on the tip of your controller. Move the delete icon to the object you wish to remove, and press the trigger again. The targeted object will be promptly deleted from the virtual space.
L Scale
Use the Scale Button to adjust the scale of the active dataset in the environment. Target the Scale Button with your laser and pull the trigger on your controller to engage the scaling mode. While holding the trigger button, move the controller up or down to alter the model's scale until the preferred size is achieved. Release the trigger button to finalize the scaling of the dataset.
M Move
Use the Move Button to reposition the active dataset within the environment. Target the Move Button with your laser, and then pull the trigger on your controller to activate the movement mode. While maintaining pressure on the trigger button, guide the dataset to your desired location. Release the trigger button once you've positioned the dataset accurately, setting it in place.
N Move Backward
Use the Move Backward Button to manipulate the distance of the active dataset within the environment. Aim your laser at the button and pull the trigger on your controller to engage the feature. While holding the trigger button, move the controller up or down to shift the dataset either closer to or farther away from your viewpoint. Release the trigger button to lock the dataset's new position in place.
O Rotate Horizontally
Use the Rotate Horizontally Button to orchestrate a horizontal rotation of the active dataset within the environment. Aim your laser at the button and pull the trigger on your controller to initiate the rotation function. Keep the trigger button depressed, and move the controller left or right in a horizontal plane to rotate the dataset accordingly. Release the trigger button to lock the rotation at the desired angle.
P Rotate Vertically
Use the Rotate Vertically Button to initiate a vertical rotation of the active dataset within the environment. Aim your laser at the button and pull the trigger on your controller to engage the rotation function. While holding down the trigger button, move the controller upward or downward in a vertical plane to manipulate the dataset's orientation. Release the trigger button to finalize the rotation at the desired inclination.
Q Frame Rate
Check the Frame Rate Counter to monitor the performance of the application on your device. The performance is displayed in Frames Per Second (FPS).

Library Panel

The Library Panel is the central hub for accessing various datasets. Users can locate and load their desired datasets within this Panel for study or work.
Library Panel
A Medical Imaging XR Section
The Medical Imaging XR Section serves as the dedicated space for professional medical imaging data management. Here, users can seamlessly upload their data, activate datasets for visualization, and manage their content by deleting as needed. Medical Imaging XR Section
A Import Data
Locate and aim your laser at the Import Data Button, represented by a + Button. Press the trigger to access the Import Data Panel.
  • Local Disk Import
    1. Choose the Local Disk option at the top of Import Data Panel.
    2. Navigate and select the desired file or folder.
    3. Click the Select Button at the bottom. Medicalholodeck will showcase all compatible data.
    4. You can choose and import multiple files simultaneously.
  • PACS
    1. Choose the PACS option at the top of Import Data Panel.
    2. Search patients by entering the patient's name on your keyboard.
    3. Click any patient name in the list of found patients below the search input to load their corresponding studies.
    4. Choose one of the series on the right of the patient results list to display corresponding series.
    5. Click the Select Button at the bottom.
    6. You can choose and import multiple files simultaneously.
Your data will be immediately available in the Medical Imaging XR Section.
B Activate Data
Utilize the Activate Data Button to bring a specific dataset to life within the environment. Direct your laser towards the button corresponding to your desired dataset and press the trigger button to initiate the activation. Immediately upon activation, the dataset will be rendered and presented in the space, allowing for further interaction and examination.
C Delete Data
Click this button to remove a dataset from your Library.
B Save Scenes Section
Utilize the Save Scenes Section to preserve your immersive experience. Saving Scenes enables you to capture and store the current state of your work within the virtual environment. This functionality ensures that you can readily access and continue your work at a later time, maintaining the exact conditions and configurations of the saved scene. Save Scenes Section
A Save
Utilize the Save Button to preserve the current state of the Environment. Aim your laser at the + Button and press the trigger to save your work. The Saved Scene will be stored on the right side of the button, and will be identified with a unique Saved Scene ID, the date of creation, and a preview image, allowing for easy access and reference in the future.
B Load
Utilize the Load Button to access a previously Saved Scene within the environment. Aim your laser at the button corresponding to the chosen Saved Scene and press the trigger button. The scene, with all its preserved conditions and configurations, will be instantly displayed, allowing you to continue your work exactly where you left off.
C Delete
Utilize the Delete Button to remove a Saved Scene from the Library. To do so, direct your laser to the top right corner of the Saved Scene Button, where an X Button will appear. Aim your laser at this button and press the trigger. The Saved Scene will be immediately deleted, no longer appearing within the Save Scenes Section.
C Pad Handle
Utilize the Pad Handle to reposition the UI element. Hover over the Pad Handle with your laser, then click and hold it by pressing the trigger button on your controller. Move it to your desired location, and then release the trigger button to set the new position. This flexibility allows you to adjust the control pad to suit your preferences.

Medical Imaging XR Panel

Medical Imaging XR Panel is designed for setting tissue filtering and windowing for DICOMs. Additionally, it provides tools to generate 3D models suitable for 3D printing. Medical Imaging XR Panel
A Preset Section
Utilize the Preset Section, located on the left side of the Panel, to manage and store color presets for DICOM data. Medicalholodeck offers several built-in color presets, providing you with the flexibility to select, create, edit, or delete them. This feature enables full control over color customization, catering to specific needs and preferences. Preset Section
A Store
Use the Store Button to preserve your color modifications as a new preset. Direct your laser at the + Button located at the top of the Preset Section, then press the trigger. Your current color settings will be captured and saved as a new custom preset, which will then become visible at the top of the presets list.
B Preset
Utilize the Preset Button to load a previously saved preset from the presets list. Simply aim your laser at the desired preset and press the trigger button. The selected preset's settings will be instantly applied to the DICOM dataset, reflecting the stored color configurations.
C Edit
Use the Edit Button to modify the presets list. Aim your laser at the Edit Button and press the trigger to activate this mode. Delete preset Buttons will appear. If you wish to delete a preset, direct your laser at the X Button visible on the desired preset and press the trigger to remove it from the list. You can deactivate the edit presets mode by clicking on the Edit Button again.
B Color Section
Use the Color Section located at the top of the Panel to adjust the transparency and assign colors to specific values using Color Pins. It allows you to fully customize the display of DICOM data. If the dataset provides values in Hounsfield Units (HU), e.g. CT, a corresponding label is displayed below X-Axis. Color Section
A Color Pins
Use the Color Pins to change the transparency and colors for specific values. The transparency is adjustable from 0% to 100%. To modify this value aim your laser at the color pin of your interest, pull the trigger button to select it, and move the Color Pin vertically. After, release the trigger button to set the color pin in the position. Hounsfield Units (HU) allow you to filter DICOM data based on radiodensity. To assign specific colors to specific values, aim your laser at the color pin of your interest, pull the trigger button to select it, and move the Color Pin horizontally. After, release the trigger button to set the color pin in the position. Color Pin is immediately added and the changes are visible on the DICOM dataset.
B Delete Pin
Utilize the Delete Pin Button to remove a specific Color Pin from the Color Section. First, aim your laser at the Color Pin you wish to delete and press the trigger button to select it. Then, direct your laser to the Delete Pin Button, located on the right side of the Color Section within the Color Editor Section, and press the trigger to remove it. The Color Pin will be immediately deleted from the Color Section, and the changes will be visibly reflected in the DICOM dataset.
C Color Picker
Utilize the Color Picker to modify the color associated with the Color Pin. First, aim your laser at the specific color pin you wish to change, and press the trigger button to select it. Then, direct your laser to the desired color within the Color Picker, located on the right side of the Color Section in the Color Editor Section, and press the trigger to choose it. The newly selected color will be instantly applied to the color pin, and the corresponding update will be reflected in the DICOM dataset.
D Close Color Editor
Use the Close Color Editor Button to deactivate the Color Editor Section within the environment. Simply aim your laser at the button and press the trigger. The Color Editor Section, situated on the right side of the Color Section, will become instantly hidden.
E Hue Selector
Utilize the Hue Selector to alter the color hue assigned to the Color Pin. Aim your laser at the particular color pin you wish to modify and press the trigger button to select it. Then, direct your laser at the Hue Selector, located on the right side of the Color Section in the Color Editor Section, and press the trigger to choose the desired hue for the pin. The color will be instantly updated in the Color Picker, within the Color Pins Section for the selected pin, and the change will be applied to the DICOM dataset.
C Tissue Filter Section
Use the Tissue Filter Section to window DICOM data. This section includes the Lower and Upper Value Buttons which allow you to window DICOM data until the desired body tissue is visible. You also have the option to switch between Relative and Absolute Color Values. Units are in Hounsfield Unit (HU) for datasets that support Hounsfield Units (e.g. CT). Tissue Filter Section
A Decrease Lower Value
Use the Decrease Lower Value Button to decrease the lower value of the data range. Aim your laser at the button and press the trigger button. The Lower range value is decreased by 1. The DICOM dataset's display is immediately updated accordingly to the new range.
B Increase Lower Value)
Use the Increase Lower Value Button to increase the lower value of the data range. Aim your laser at the button and press the trigger button. The Lower range value is increased by 1. The DICOM dataset's display is immediately updated accordingly to the new range.
C Lower Value
Use the Lower Value Button to adjust the lower value of the data range. Aim your laser at the button, pull the trigger, and move the slider to the left or to the right. After, release the trigger to set the value. The lower value of the data range is adjusted and the DICOM dataset's display is immediately updated accordingly to the new range.
D Upper Value
Use the Upper Value Button to adjust the upper value of the data range. Aim your laser at the button, pull the trigger, and move the slider to the left or to the right. After, release the trigger to set the value. The upper value of the data range is adjusted and the DICOM dataset's display is immediately updated accordingly to the new range.
E Decrease Upper Value
Use the Decrease Upper Value Button to decrease the upper value of the data range. Aim your laser at the button and press the trigger button. The Upper value range value is decreased by 1. The DICOM dataset's display is immediately updated accordingly to the new range.
F Increase Upper Value
Use the Increase Upper Value Button to increase the upper value of the range. Aim your laser at the button and press the trigger button. The Upper value range value is increased by 1. The DICOM dataset's display is immediately updated accordingly to the new range.
G Relative/Absolute Color Values
Use the Relative/Absolute Color Values to switch between Relative and Absolute Color Values Mode. In absolute mode, colors are fixed to specific data values. This means that when you limit the data range using the Lower and Upper Value Buttons, you also limit the visibility of colors associated with those values. In relative mode, colors are not directly tied to specific values. Instead, they are relative to the current window. This means that when you adjust the range, the full spectrum of colors will still be visible within the new window, regardless of how narrow it might be. Aim your laser at the button and press the trigger to switch from Absolute to Relative Mode. To change the Color Values Mode again click the same button again. The DICOM dataset's display is immediately updated accordingly to the new Color Values mode.
D Mesh Generator Section
Navigate to the Mesh Generator Section to process your DICOM data into a 3D mesh. This mesh can be utilized to craft 3D models suitable for printing or further analytical exploration. Mesh Generator Section
A Open Mesh Generator
Activate the Open Mesh Generator to reveal a new set of Mesh Generator options, along with a generated preview of the mesh dataset juxtaposed with the original dataset. Aim your laser at the button and press the trigger, and the updated set of options and mesh datasets will be instantly displayed within the Environment.
B ISO Value
Utilize the ISO Value Button located on the tissue slider to customize the visibility of specific tissues in the mesh. Aim your laser at the button, pull the trigger, and slide it either to the left or right to make the desired adjustments. The generated preview of the mesh dataset will be immediately updated to reflect the chosen ISO Value. Once you release the trigger, the ISO Value will be set, altering the data value from which the mesh is generated.
For datasets that support Hounsfield Units (e.g. CT), the ISO values correspond to Hounsfield Units (HU).
C Mesh Quality
Utilize the Mesh Quality Button to optimize the generated mesh's quality, enabling a balance between detail level and the size of the resulting STL file. Aim your laser at the button, pull the trigger, and adjust the slider left or right as needed. The mesh dataset preview will instantly update to reflect the chosen quality. Once satisfied, release the trigger to finalize the Quality value.
D Save Mesh
Use the Save Mesh Button to finalize the mesh generation process. Aim the Done Button and press the trigger button. The generated mesh is automatically added to the Library Panel and can be loaded into the environment.
E Smooth Mesh
Use the Smooth Mesh Button to smooth out the mesh. Aim your laser at the button, and press the trigger button. The generated preview of the mesh dataset is immediately smoothed out.
F Export STL
Utilize the Export STL Button to save the results of the mesh generation process. Aim your laser at the button and press the trigger. The generated 3D mesh will be saved as an STL file, directly to your computer's desktop.
E Edge Filter Section
Use the Edge Filter Section to enhance the visibility of transitions between different tissue densities in your DICOM data. Filtering based on tissue homogeneity allows clearer differentiation between structures. When the filter is adjusted towards the left, it focuses on more homogeneous tissue. As you move the filter towards the right, it increasingly highlights areas where there is a rapid change in tissue density, such as transitions from soft to dense tissue. Edge Filter Section
A Decrease Lower Edge Filter
Click the Decrease Lower Edge Filter Button to reduce the lower value of the Edge Filter range by one unit. Aim your laser at the button and press the trigger. The Lower Edge Filter range value will decrease by one, and the DICOM dataset's display will be instantly updated to reflect the new Edge Filter range.
B Increase Lower Edge Filter
Press the Increase Lower Edge Filter Button to augment the lower value of the Edge Filter range by one unit. Aim your laser at the button and engage the trigger. The Lower Edge Filter range value will be increased by one, and the DICOM dataset's display will be instantly updated to align with the new Edge Filter range.
C Lower Edge Filter
Utilize the Lower Edge Filter Button to modify the lower value of the Edge Filter range. Aim your laser at the button and pull the trigger, then move the slider either to the left to decrease or to the right to increase the value. Release the trigger to set the new Edge Filter value. The adjustment is made to the lower value of the Edge Filter range, and the DICOM dataset's display is promptly updated to reflect the new range.
D Upper Edge Filter
To adjust the upper value of the Edge Filter range, use the Upper Edge Filter Button. Aim your laser at the button, pull the trigger, and slide it to the left or right to modify the value. Upon releasing the trigger, the Edge Filter value will be set. This adjustment to the upper value of the Edge Filter range will be instantly reflected in the DICOM dataset's display, updating it in accordance with the new range.
E Decrease Upper Edge Filter
Utilize the Decrease Upper Edge Filter Button to reduce the upper value of the Edge Filter range by one unit. Aim your laser at the button, then press the trigger. This action will decrease the Upper Edge Filter range value by one, and the DICOM dataset's display will be instantly updated to correspond with the new Edge Filter range.
F Increase Upper Edge Filter
Press the Increase Upper Edge Filter Button to raise the upper value of the Edge Filter range by one unit. Direct your laser at the button and activate the trigger. This will result in an increment of the Upper Edge Filter range value by one, and the DICOM dataset's display will be promptly revised to align with the newly adjusted Edge Filter range.
F Quality Section
Use the Quality Section to fine-tune the balance between the visual quality of your DICOM data and the application's performance. By adjusting this setting, you can optimize the display of your data to match the capabilities of your computer. Whether you prioritize high-resolution imagery or smoother performance, this function allows you to customize your experience to your needs. Quality Section
A DICOM Quality
Use the DICOM Quality Button to adjust the displayed quality of the DICOM data. Grab it with your laser, pull the trigger, and change the value to the desired quality value. This will increase or decrease the visual quality of active dataset in the Environment.
G Pad Handle
Utilize the Pad Handle to reposition the UI element. Hover over the Pad Handle with your laser, then click and hold it by pressing the trigger button on your controller. Move it to your desired location, and then release the trigger button to set the new position. This flexibility allows you to adjust the control pad to suit your preferences.

Object Marker

In the environment, every loaded dataset is shown with an Object Marker on the floor. This Object Marker serves as an identifier for the active dataset. A blue marker represents an active dataset, a grey marker an inactive dataset. To move datasets, users can interact with the Object Marker. Simply point the laser at the Object Marker, press the trigger, and move the controller to the desired location. Release the trigger once the dataset is positioned as needed.
Object Marker
A Lock
The Object Lock feature users to lock a dataset in its position. To lock a dataset point your laser at the padlock icon, which is situated within a small circle on the Object Marker then press the trigger. The padlock will turn red, signifying that the dataset is locked and cannot be moved. To unlock the dataset, click on the red padlock icon again.

Setup & Installation

Supported Hardware

Compatible XR Headsets

Medicalholodeck implements XR connectivity by using the widespreach OpenXR standard and is therefore compatible with a wide range of XR platforms to ensure accessibility and optimal performance. While any OpenXR compatible XR headset can be used with Medicalholodeck the following minimal specifications are recommended:
  • Headset: 6 DoF, 1832 × 1920 pixels per eye, 60 hertz refresh rate
  • Memory: 6 GB
  • Controllers: 2 controllers with trigger and 6 DoF
  • Connection: Wireless or Wired, with support for tethering/linking to PC
  • Software: OpenXR compatible backend

Compatible PC Hardware

The PC providing the rendering and processing for Medicalholodeck has to fulfill the following minimal specifications:
  • CPU: i7
  • GPU: NVIDIA GTX 1080ti
  • RAM: 16GB
  • Operating System: Windows 10 or 11 Pro 64bit

System Security

It is recommended to secure your computer system properly:
  • Activate Antivirus and Firewall software and keep it up-to-date
  • Install patches and security updates to your Operating System regularly or even automated
While Medicalholodeck Medical Imaging XR Pro does not store Personal/Protected Health Information or PII, consider enabling also disk encryption for all drives and password protect your computer with a strong password to avoid unauthorized access.

Installing Medical Imaging XR Pro

To obtain Medicalholodeck Medical Imaging XR Pro refer to the website for a download of the installer or refer to your sales contact at Medicalholodeck.
  • Once you have received the Medicalholodeck Medical Imaging XR Pro installer, execute the application the computer you would like to run Medicalholodeck Medical Imaging XR Pro on.
  • After installation has completed you will find a shortcut to Medicalholodeck Medical Imaging XR Pro on your Desktop as well as in Windows' Startmenu.
  • Launch the application by double-clicking either the shortcut on the Desktop or by single-clicking the entry in the Startmenu.
  • Medicalholodeck will automatically detect your connected XR headset and controlelrs if any and show a mirror view on a connected display on the computer.

License Activation

To activate your PC with your license key for Medicalholodeck Medical Imaging XR Pro
  1. Open Settings Screen
  2. Select Licenses on the top
  3. Select Offline Activation
  4. Insert your license key into the field where it says Enter your license key
  5. Generate an Offline Activation Request file by clicking Generate Request file and choose a location for the file
  6. Send the activation request file (.oar) to your sales contact at Medicalholodeck or directly to info@medicalholodeck.com
  7. After verification of your request, an activation file will be delivered to you via e-mail (.oaf)
  8. Open Medical Imaging XR Pro again and navigate to the License screen, click Offline Activation again
  9. Press Load Activation File and select the received activation file (.oaf)
  10. Medicalholodeck Medical Imaging XR Pro activates instantly

PACS Considerations

If you have configured a PACS system connection in Medicalholodeck Medical Imaging XR Pro's settings, please make sure that your connection is secure:
  • Place the computer and the PACS system in a secure network which is not accessible from the outside world (e.g. the internet)
  • If that is not possible for one of the two or both, consider setting up a secure VPN connection between the PACS and your computer
  • Configure your PACS to perform strict IP, Port and AE title checks
The level of network security and security policies for your PACS system and connections to it are subject to your institutions guidelines and local laws. Please consult with your IT and data security department for the definitive setup.

Functionality

General Usage

How To Navigate the User Interface

Main Control Pad

With your right controller, access the Main Control Pad situated at the center of your visual field. Point the laser towards the intended item, and a tooltip will emerge, indicating the name of the selected tool for your reference. The Main Control Pad serves multiple functions: it allows you to hide and show the Library Panel, initiate or join a TeamXR session, record movies, and RXR Files, open the Settings Section on the Library Panel, reset the scene, and quit Medicalholodeck. Aim your laser at the desired item and pull the trigger to select it.

Library Panel

Use your laser to access items in the Library Panel, which is centrally located within your field of view.
  • Medical Imaging XR Section
    • Contains medical imaging datasets. To activate one, aim your laser at it and press the trigger.
    • Use the 'Import Data' Button to bring in data from your local disk or via Medicalholodeck Cloud.
  • Saved Scenes Section
    • Save scenes by clicking the '+' Button. To revisit a saved scene, aim at one of the tiles storing a saved scene and press the trigger.

How To Use Settings

Aim your laser at the Cogwheel Button in the Main Control Pad to access the Settings Panel. Use the laser to navigate through the options. Select or adjust an option by aiming at it and pressing the trigger button.
  1. General Options
    • Show position markers: Toggle orientation markers for DICOM datasets.
    • Default quality for volumes: Set default quality for loaded DICOM datasets. Default is 50%.
  2. Recording Options
    • Offline recording: For videos without skipped frames, typically off.
    • 4K resolution: Ultra high definition recording. Requires a high-end PC.
    • 60 frames per second: Smooth video recording. Requires a high-end PC.
    • Record microphone: Toggle audio recording for movies.
    • Record microphone XR: Toggle audio recording for RXR files.
  3. Licenses Tab
    • View and activate licenses.
    • Check license expiration dates.

Data Import and Handling

Data Importing

Local Drive

Supported Data Formats
The following data formats are supported:
  • DICOM Formats:
    • 3D DICOM from CT
    • 3D DICOM from MRI
    • 3D DICOM from CBCT
    • 4D Animated DICOM from CT and MRI
    • 4D Animated Echocardiography DICOM
    • 2D Ultrasound DICOM
    • 2D Echocardiography DICOM
    • 2D Angiography DICOM
  • 3D Model Formats:
    • STL
    • OBJ
  • Media Formats:
    • Video: MP4, M4V, MPEG, AVI
    • Images: JPG, PNG
    • Document: PDF
How To Import Data
  1. In the Medical Imaging XR Section, point to the '+' Button on the top left of the Library Panel and press the trigger.
  2. Make sure the 'Local Disk' tab is selected at the top. Use the file explorer to locate your data.
  3. Point to your desired file or folder and press the trigger to select. For multiple selections, repeat this step or use the 'Select All' Button.
  4. Once you've chosen your files, click the 'Import' Button at the bottom. Your data will be added to the Library and is now ready for use.

PACS

Supported Data Formats
The following data formats are supported:
  • DICOM Formats:
    • 3D DICOM from CT
    • 3D DICOM from MRI
    • 3D DICOM from CBCT
    • 4D Animated DICOM from CT and MRI
    • 4D Animated Echocardiography DICOM
    • 2D Ultrasound DICOM
    • 2D Echocardiography DICOM
    • 2D Angiography DICOM
Configuration and Connectivity
How To Import Data
  1. In the Medical Imaging XR Section, point to the '+' Button on the top left of the Library Panel and press the trigger.
  2. Make sure the 'Local Disk' tab is selected at the top. Use the file explorer to locate your data.
  3. Point to your desired file or folder and press the trigger to select. For multiple selections, repeat this step or use the 'Select All' Button.
  4. Once you've chosen your files, click the 'Import' Button at the bottom. Your data will be added to the Library and is now ready for use.

Data Handling

Dataset

The Active Dataset
The active dataset is distinguished by the Object Marker located beneath it. If the circle appears grey, it indicates that the dataset is currently not active.
To activate a dataset:
  1. Point your laser at the desired dataset and press the trigger.
  2. Alternatively, you can click inside the grey circle beneath the dataset to activate it.
  3. You can also grab the dataset using your controllers; upon doing so, the dataset will automatically become active.
The Hand and Controller Interactions
  1. Select a dataset from the Library Panel by aiming your laser at its 'Activate Data' Button.
  2. Move Data: Insert your right hand into the dataset until it's framed in blue. Pull the right controller's trigger to grab, then drag to position. Release to set.
  3. Scale Data: Insert both hands into the dataset until highlighted in blue. Pull both triggers and move hands apart or together to adjust size.
  4. Rotate Data: With both hands highlighted in the dataset, pull both triggers and twist your hands to rotate.
How To Use the Laser
The Laser, by default, is on your right controller. Use the Laser to navigate through all windows, panels, sections, tools, and features in Medicalholodeck. To select an item, point the Laser at it and press the trigger. To switch the Laser to the left controller, aim at the 'Switch L/R' Button on the Main Control Pad and press the trigger.
How To Use Cutter
  1. Activate the Cutter tool from the Object Pad by pointing at it with the laser and pressing the trigger.
  2. By default, the Cutter is attached to your left hand. To switch hands, aim at the 'Switch L/R' Button on the Object Pad and press the trigger.
  3. Move the Cutter into the DICOM dataset. As you move the controller, you'll see how it cuts through the data.
  4. To make a cut, position the Cutter and press the trigger on the controller.
  5. Multiple cuts can be made on a single dataset.
  6. To remove a cut, point the laser at the 'x' Button on the top right corner of the cut and press the trigger.
  7. To turn off the Cutter, press the 'Cutter On/Off' Button again.
Measure Distances
  1. Activate the Measure Distance tool from the Object Pad. A black cone will appear on your controller's fingertip.
  2. Position the cone at the starting point and press the trigger to set it.
  3. Move the cone to the desired endpoint and press the trigger again. The distance between the two points will be displayed in millimeters.
  4. To delete a measurement, activate the "Delete" function from the Object Pad. Aim the laser at the measurement you want to remove, then press the trigger.
Measure Angles
  1. Activate the Measure Angle tool from the Object Pad. A black cone will appear on your controller's fingertip.
  2. Position the cone where you want the middle point of the angle to be and press the trigger to set it.
  3. Move the cone to define the endpoint of the first line segment and press the trigger.
  4. Next, move the cone to define the endpoint of the second line segment. The angle between the two segments will be displayed in degrees. Press the trigger to finalize the measurement.
  5. To delete a measurement, activate the "Delete" function from the Object Pad. Aim the laser at the angle measurement you want to remove and press the trigger.
Create and Measure a 3D Shape
  1. Activate the Measure Area tool from the Object Pad. A black cone will appear on your controller's fingertip.
  2. Position the cone where you want the first vertex of the shape to be and press the trigger to set it.
  3. Continue moving the controller to define additional vertices, pressing the trigger at each desired point.
  4. To close the shape, bring the cone close to one of the points. When the tooltip "CLICK TO CLOSE SHAPE" appears, press the trigger.
  5. The area of the shape will be displayed in mm².
How To Draw on Data
  1. Activate the Draw tool from the Object Pad. A black dot will appear on your controller's fingertip, and the Free Line Drawing Panel will open below the Object Pad.
  2. Customize your drawing:
    • Thickness: Adjust the line thickness using the 'Stroke Width' button. Grab it with your laser, press the trigger, and slide to your desired size. The dot on your fingertip will change in size accordingly.
    • Color: Choose a line color using the 'Select Color' buttons. Aim your laser at your preferred color and press the trigger.
  3. Begin drawing by pressing and holding the trigger on your controller. Move your hand to draw lines in 3D space. Release the trigger to stop drawing.
  4. To erase a drawing, activate the "Delete" function from the Object Pad. Aim the laser at the drawing you wish to remove, then press the trigger.
How To Use Arrow Markers
  1. Launch the Arrow Markers tool by aiming your laser at the 'Mark' function Button on the Object Pad.
  2. Once activated, an arrow will appear on your fingertip.
  3. Position the arrow over the area of interest in your dataset.
  4. Press the trigger to place the arrow marker, highlighting the chosen area.
  5. To remove a marker activate the 'Delete' function from the Object Pad. Aim your laser at the arrow marker you wish to remove then press the trigger.
How To Delete Objects
  1. Activate the Delete Objects tool from the Object Pad.
  2. A red 'x' icon will appear on your controller's fingertip.
  3. Hover this icon over the object you want to delete.
  4. Press the trigger button to remove the selected object from the space.
How To Move Active Dataset
You have three methods to reposition the Active Dataset within the environment.
  1. Using the Laser
    • Aim your laser directly at the dataset or at the Object Marker below it.
    • Press and hold the trigger button to grab the dataset.
    • Drag it to your preferred location.
    • Release the trigger to place the dataset.
  2. Using Hand Interaction
    • Approach the dataset with your right controller until it's framed in blue.
    • Press and hold the trigger button to grasp the dataset.
    • Move it to the desired spot.
    • Release the trigger to finalize its position.
  3. Using the Move Button
    • Direct your laser at the Move Button on the Object Pad.
    • Activate it by pressing the trigger button.
    • While holding the trigger, reposition the dataset.
    • Release the trigger to set the dataset in its new location.
How To Scale Active Dataset
You have two methods to adjust the Active Dataset size within the environment.
  1. Using Hand Interactions
    • Insert both hands into the dataset until highlighted in blue.
    • Press and hold the triggers on both controllers.
    • Move your hands apart or closer together to scale the dataset up or down, respectively.
    • Release the triggers to set the new scale.
  2. Using the Scale Button
    • Direct your laser at the Scale Button on the Object Pad.
    • Activate it by pressing the trigger button.
    • While holding the trigger, slide the controller upwards to enlarge or downwards to reduce the dataset's size.
    • Release the trigger to finalize the scale.
How To Move Active Dataset Backward
The Move Backward tool lets you fine-tune the position of the active dataset in relation to your perspective in the space:
  1. Direct your laser at the Move Backward Button in the Object Pad.
  2. Activate the tool by pressing the trigger button on your controller.
  3. With the trigger held down, slide the controller upwards to bring the dataset closer or downwards to push it away.
  4. Release the trigger to set the dataset at the chosen distance.
How To Rotate Active Dataset Horizontally
You can rotate the active dataset horizontally in two ways.
  1. Hand Interactions
    • Insert your hand into the dataset until it's highlighted in blue.
    • Press and hold the trigger button to grasp it.
    • Rotate the controller horizontally to rotate the dataset to your preferred orientation.
    • Release the trigger to set the rotation.
  2. Using the Rotate Horizontally Button
    • Aim your laser at the Rotate Horizontally Button in the Object Pad.
    • Activate the rotation mode by pressing the trigger button.
    • While pressing the trigger, slide the controller left or right to adjust the dataset's horizontal orientation.
    • Let go of the trigger to finalize the rotation.
How To Rotate Active Dataset Vertically
You can rotate the active dataset vertically in two ways.
  1. Hand Interactions
    • Insert your hand into the dataset until it's highlighted in blue.
    • Grasp the dataset by pressing and holding the trigger button.
    • Rotate the controller up or down to rotate the dataset vertically.
    • Release the trigger to lock in the rotation.
  2. Using the Rotate Vertically Button
    • Direct your laser towards the Rotate Vertically Button in the Object Pad.
    • Initiate the rotation mode by pressing the trigger button.
    • While pressing the trigger, slide the controller up or down to adjust the dataset's vertical orientation.
    • Let go of the trigger to set the rotation.
How To Lock/Unlock Dataset
Locking a dataset in the environment ensures it remains stationary, preventing unintentional adjustments. This is especially helpful when working with multiple datasets simultaneously.
  1. To Lock a Dataset
    • Select the desired dataset.
    • Point your laser at the padlock icon, located within a small blue circle beneath the dataset in the Object Marker.
    • Press the trigger button. The padlock will turn red, indicating the dataset is locked and immovable.
  2. To Unlock a Dataset
    • Choose the locked dataset.
    • Direct your laser to the red padlock icon.
    • Click the trigger button. The padlock will revert to blue, signifying the dataset is now unlocked and can be moved.
How To Remove Active Dataset
  1. Select the Dataset
    • Direct your laser towards the dataset you want to remove.
    • Press the trigger button to activate it.
  2. Remove the Dataset
    • Aim your laser at the 'Remove Dataset' Button located in the Object Pad.
    • Press the trigger button.
The dataset will be instantly removed from the environment.
How To Use the Light
  1. Toggle the Light
    • Aim your laser at the 'Light On/Off' Button in the Object Pad.
    • Press the trigger button to switch the Light on or off.
  2. Move the Light with Laser
    • Direct your laser toward the Light.
    • Press and hold the trigger button to grab it.
    • Drag the Light to your desired position.
    • Release the trigger to set the Light's position.
  3. Move the Light with Hand Interaction
    • Insert your controller into the Light until it's framed in blue.
    • Press and hold the trigger button to grasp the Light.
    • Reposition the Light as needed.
    • Release the trigger to finalize the Light's new location.
How To Use Medical Imaging XR Panel
  1. Introduction
    • Load your DICOM dataset from the Library.
    • The Medical Imaging XR Panel will automatically appear.
  2. Color Section
    • Located at the top of the Panel.
    • Adjust transparency levels ranging from 0% to 100%.
    • Assign colors to specific Hounsfield Units (HU) using Color Pins. Modify these values by moving the Color Pins vertically for transparency and horizontally for HU values.
    • Utilize the Color and Hue Pickers on the right side to alter the color of each pin.
  3. Preset Section
    • Found on the left side of the Panel.
    • Medicalholodeck offers various built-in color presets.
    • Customize a preset by adjusting or adding color pins.
    • Save your settings by clicking the '+' Button, creating a new custom preset.
  4. Tissue Filter Section
    • Includes the Lower and Upper Hounsfield Unit (HU) Buttons to window DICOM data and visualize specific body tissues.
    • Toggle Between Relative and Absolute Color Values:
      1. Absolute Mode: Colors are strictly tied to specific Hounsfield Units (HU). Each color corresponds to a defined HU value, ensuring consistent visualization across different datasets. Adjusting the HU range will display only the colors associated with the selected HU values.
      2. Relative Mode: Colors adapt dynamically based on the current HU window. The entire color spectrum adjusts and remains visible within the selected HU range, emphasizing variations without being constrained by fixed color assignments.
  5. Mesh Generator Section
    • Generate a 3D mesh from DICOM data for 3D printing or further analysis.
  6. Edge Filter Section
    • Enhance visibility of transitions between different tissue densities.
    • Adjust the filter to focus on homogeneous tissue or highlight rapid changes in tissue density:
      • Homogeneous Tissue Focus: By sliding the filter to the left, users can emphasize regions of uniform tissue.
      • Rapid Density Change Highlight: Shifting the filter to the right will spotlight areas showcasing swift transitions in tissue density, such as the interfaces between muscle and bone.
  7. Quality Section
    • Fine-tune the balance between visual quality and application performance.
    • Optimize data display based on your computer's capabilities.

Export

How To Make a Screenshot

To capture an image of your experience use the Screenshot Button located in the Main Control Pad. Point your laser at the button and click the trigger to take a screenshot, the image will be automatically saved to your Desktop.
Note: Before capturing a screenshot, ensure that you have sufficient free space on your hard drive. Insufficient storage may prevent the image from being saved successfully. Regularly check and manage your storage to avoid any disruptions.

How To Create a Video

To record a video of your experience, use the 'Record' Button located in the Main Control Pad. Point your laser at the button and click the trigger to start recording. To stop recording, click the same button again. The recorded video will be automatically saved to your Desktop.
Note: Before starting a video recording, ensure that you have sufficient free space on your hard drive. Videos can occupy a significant amount of storage, and insufficient space may prevent the video from being saved successfully. Regularly check and manage your storage to avoid any disruptions.

How To Create and Use Saved Scene

Saved Scenes allows you to save and store scenes for future use, providing a convenient way to arrange your data. You can load multiple datasets from each Medicalholodeck application: Medical Imaging XR, Dissection Master XR, and Anatomy Master XR. This allows you to combine and compare different datasets within the same scene. Once your datasets are loaded, you can manipulate them in various ways. You can cut DICOM datasets, draw on them, place markers, and adjust their size. When your scene is prepared, save it for future use by clicking on the 'Save Scene' Button on the right side of the Library Panel. A thumbnail with a scene number will appear, indicating that your scene has been saved successfully. The next time you open Medicalholodeck, you can load your saved scene by clicking its thumbnail in the Library Panel. All the datasets, objects, and modifications you’ve prepared will be loaded, allowing you to resume your work or start giving a lecture immediately.

How To Create STL File From the DICOM Dataset

  1. Load your desired DICOM dataset from the Library Panel into the environment.
  2. Once loaded, the Medical Imaging XR Panel will appear.
  3. Adjust the window levels using the Lower and Upper Hounsfield Unit (HU) Buttons to make the desired body tissue visible.
  4. Navigate to the Mesh Generator Section below the Tissue Filter Section.
  5. Click 'Generate Mesh'. A mesh dataset will appear alongside the original dataset, and additional options will be displayed.
  6. Use the ISO value Button on the tissue slider to set the Hounsfield Unit (HU) value from which the mesh is generated, adjusting the visibility of specific tissues.
  7. Opt for the 'Smooth' Button if you wish to refine the mesh's appearance.
  8. Balance detail and file size with the 'Mesh Quality' slider:
    • Move left for fewer vertices, resulting in a smaller, less detailed file.
    • Move right for more vertices, yielding a larger, more detailed file. The predicted file size is displayed for reference.
  9. Once content with the mesh preview, click 'Export STL' to save the 3D mesh as an STL file on your desktop.
  10. Click 'DONE' to add the generated mesh to the Library.
Note: Before generating and exporting an STL file, ensure you have sufficient free space on your hard drive. The creation and saving of the STL file require storage. Insufficient storage might prevent the file from being generated or saved correctly. It's recommended to regularly check and manage your storage to avoid any disruptions.
Publication Date: September 2023
navigation.footer.theapps.theapps
Medical Imaging XR Dissection Master XR Anatomy Master XR RecordXR TeamXR Remote Rendering
Store
navigation.footer.store.buy navigation.footer.store.lessons navigation.footer.store.download navigation.footer.store.functions
navigation.footer.support.support
navigation.footer.support.gethelp navigation.footer.support.tutorials navigation.footer.support.techspecs navigation.footer.support.faq navigation.footer.support.changelog
navigation.footer.news.news
navigation.footer.news.newsroom
navigation.footer.newsletter.newsletter