Imaris

• Getting started with Imaris
• Intensity-based thresholding
• Machine learning segmentation

Getting started with Imaris

To load an image in Imaris

1. Make sure you are in the Arena view (see above).
2. Click on Observe Folder, then select the folder with your images in the dialog box that pops up.
   
3. If you have not opened the file before, the file will likely have an ND2 extension. Double-click on the file to convert the image into the native Imaris format (IMS).
4. The Global Queues panel on the bottom right will show you the progress of the conversion.
   
   
   
   
5. Once the conversion is complete, double-click the file again to open it in the Surpass view.
   

Basic controls

To rotate or pan the image:
•    Left click + drag will rotate the view
•    Right click + drag will translate the image

To reset the view:
•    Click on the “Reset” button on the bottom right of the screen

To adjust the display:

• If the Display Adjustment box is hidden, select Edit > Show Display Adjustment.
• To adjust the intensity of the displayed image, click and drag the sliders.
• Check/uncheck the boxes next to each channel to show/hide channels.
• Click on the channel name to open the Image Properties dialog box. You can use this to change colors if desired.

 

Intensity-based thresholding

This page explains how to use intensity-based thresholding (the traditional method) to segment cells. For this example, we will segment some nuclei which have been labeled with DAPI.

1. In the Surpass view, click on the Surfaces icon in the left panel to create a new Surface.
   
   
   
2. A wizard dialog box on the bottom left of the screen.
   
   
   
3. On this page:
   • Unselect Classify Surfaces – classification is used to distinguish between different objects, e.g., different cell types, and we won’t need it here.
   • Unselect Object-Object Statistics – these statistics can be used, for example, to filter objects by distance to its nearest neighbors. Disabling these statistics will reduce the computational time and power needed for the segmentation. You can always re-enable this after segmentation.
   • Select Start creation with Slicer view.
   • Click the blue right arrow to move to the next page.
   
   
4.  The slicer view will display on the image on the right. This is a 2D view of individual slices of the image. The slicer control appears as a yellow ball and arrow at the center of the image. To control the slice:
   • Click and drag the ball to move up and down in depth
   • Click and drag the arrow to adjust angle
   • Right-clicking on arrow will set the angle to perpendicular to the plane of view – you can keep right-clicking to change between the different angles
   • Right-clicking anywhere on image will move the control to that position
   • To return to a 3D view, unselect the slicer icon on the left panel
     
     
     
     
5. Back to the wizard dialog:
   
   
   
   • Set Source Channel to Channel 1 – W1-DAPI.
   • Check the Smooth option – Smoothing is generally a good idea to avoid jagged surfaces. The default value for the Surfaces Detail is equivalent to a 2-pixel width, which we’ll use for this example.
   • Select Absolute Intensity Thresholding.
   • Click on the blue right arrow to move to the next screen.
     
     
6. The next panel will display an intensity histogram that you can use to adjust the global threshold:
   
   
   
   • Move threshold slider to change the segmentation result. 
   • It is a good idea to check different slices to ensure that the generated surface is accurate.
   • Select the Enable checkbox under Split touching objects.
   • Change the Seed Points Diameter to the estimate of the nuclei
   • Select the Morphological Split option – Imaris will attempt to split touching objects by shape.
   • Click on the blue right arrow to move to the next screen.
     
     
7. The next screen shows the proposed centers (white circles) for the object splitting function.

   
   

   
   
   • The panel on the bottom right allows you to change Quality, which affects the number of circles that appear. This metric is a measure of how confident Imaris is that this is an object – lowering the threshold will increase the number of circles, but potentially at the cost of oversegmentation.
   • When you are happy, click on the blue right arrow to continue.
     
     
     
8. After some computation, the next screen will show the segmented objects. This is the time to check the results, and if need be, go back to the previous steps to adjust.
   
   
   
   
   • The panel on the bottom left allows you to filter the final objects by size, e.g., to filter out small cell debris or large clumped cells that were unable to be separated.
   • Finally, click on the green double right arrows to complete the process.
      
     

Machine learning segmentation

This section explains how to use the ML segmentation tool in Imaris.

1.  In the Surpass view, click on the Surfaces icon in the left panel to create a new Surface.
   
   
   
   
2. A wizard dialog box will appear on the bottom left of the screen.
   
   
   
   
3. On this page:
   •  Unselect Classify Surfaces – classification is used to distinguish between different objects, e.g., different cell types, and we won’t need it here.
   • Unselect Object-Object Statistics – these statistics can be used, for example, to filter objects by distance to its nearest neighbors. Disabling these statistics will reduce the computational time and power needed for the segmentation. You can always re-enable this after segmentation.
   • Select Start creation with Slicer view
   • Click the blue right arrow to move to the next page.
     
     
4. Set the following options:
   
   
   • Set Source Channel to Channel 1 – W1-DAPI.
   • Check the Smooth option – Smoothing is generally a good idea to avoid jagged surfaces. The default value for the Surfaces Detail is equivalent to a 2-pixel width, which we’ll use for this example.
   • Select Machine Learning Segmentation. Leave the All Channels box unchecked.
   • Click on the blue right arrow to move to the next screen.
     
     
5. The next screen shows the machine learning training panel. You will spend most of the time on this screen as you teach the machine how to segment your images.
   
   
   
   • The Background class labels pixels that should be considered background.
   • The Foreground class labels pixels that are in your objects of interest (cell nuclei in this case).
   • To label the image:
     • Select the class for the pixels you want to label.
     • Shift + Left click to start labeling.
     • Ctrl + Mouse wheel can be used to change the size of the brush stroke. Alternatively, you can zoom in/out using the mouse wheel to draw more specific areas.
     • If you make a mistake, you can click on the Delete Last button to undo the last annotation. Note there is no way to select a specific annotation to delete – you can only undo one previous action at a time.
       
       
       
       
   • Under Settings, make sure Interpolate Display is checked. This option will cause the Slicer view to show an interpolated volume, rather than a single slice. Likewise, your annotations will be over a volume, rather than a single slice.
     • The volume used can be changed by the value in the Slicer Extended Section.
       
       
6. Annotating the image is where the art of using this tool comes in. Here is some general advice:
   
   • Rather than labeling every single pixel, it is better to iterate the results over several rounds of training.
   • In the first round, use some rough strokes to select pixels within a few cells and the background. You don’t need to color in a whole cell.
   • If there are touching cells, it is generally a good idea to select a few background pixels that are between the cells.
   • When you have a few annotations, click on Train and Predict to allow the machine to learn from your annotations.
     
     
     
     
     
7. It is likely that the algorithm will get some areas wrong, so continue to refine and repeat the training process. Don’t forget to change the viewed slice to check other planes as well.
   
   

   

   
   
   
8. When you are happy with the results (or you get tired of refining the mask), click on the blue right arrow to move to the next screen.
   
   

   Important: If the results do not seem to be improving, or they seem to be getting worse, it is likely that the model is becoming overtrained. In this case, it can be helpful to delete a few annotations or even to Delete All and start again.

   
   
9. You can select the option to Split Touching Objects, but let’s leave this for now and click on the green double right arrow to complete the segmentation. 

Reusing your models

Training a model is hard work and you will likely want to save this model to reuse on other images. Note that the model will likely only work on images from the same dataset (i.e., collected on the same microscope, with the same settings, likely on the same batch of cells).

To save the model:

1. After exiting the wizard, click on the Wizard tab in the left panel.
2. Click on the Store Parameters for Batch… button.
3. In the resulting dialog box, you can name your model. It is recommended that you select the boxes to save the model both as a Favorite Creation Parameter and in the Arena.
   
   

To reuse the model:

1. As before, open your image and create a new Surface.
2. On the first page of the wizard, select the saved model under Favorite Creation Parameters.
3. You can then click through the wizard until you reach the Machine Learning Training panel (usually the third screen of the wizard). Imaris will use your previously trained model as a starting point to label the images.
4. You can then refine as needed on the new image.