Display Screen Will Enable Doctors to Feel Organs

Future radiologists may be able to feel images with the assistance of computerized image analysis and the use of a three-dimensional mouse. The University press release says that with the aid of computerized image analysis, it may be possible in the future for radiologists to feel images with the help of a three-dimensional mouse. Erik Vidholm at Uppsala University has been working to develop the new technology, which makes it easier to diagnose and plan the treatment of cancer, for instance. The size of organs like the liver can be determined by computerized image analysis when surgery or radiation is being planned. Computerized image analysis can also be used to construct three-dimensional models of organs. The quality of these images often varies, however and humans can actually look very different from each other inside. This makes it difficult for the computer to find the information that is relevant fully automatically. Common practice is to use interactive methods in which doctors, themselves, mark the areas of interest in the image and then let the computer do the rest of the work based on this information. Vidholm working at the Center for Image Analysis at Uppsala University has taken part in the development of such interactive methods where the mouse and keyboard are replaced by a pen-like three-dimensional mouse that enables the user to feel the virtual organs. This is called haptics. Computer models are adapted to the images of organs and can then be used to measure the volume of the organ, for example, or to calculate changes in shape and migrations. “To get a greater sense of depth in the image we use stereo graphics. When the models are to be adapted to the images, this is done partly automatically on the basis of the content of the image and partly with the input of the user wielding the haptic pen,” he explains. Vidholm has also developed a method for rapidly visualizing complex image volumes with the aid of modern graphics cards. This technology has been used as a component in the development of a method for more readily discovering breast cancer. Most of these methods have been assembled in a software package that can be freely downloaded via the Internet so that other researchers in medical image analysis can benefit from them. The package is available here.