A team of computer scientists, physicists, and physicians at Harvard has developed a simple yet powerful method of visualizing human arteries that may result in more accurate diagnoses of atherosclerosis and heart disease.
The prototype tool, called HemoVis, creates a two-dimensional diagram of arteries that performs better than the traditional 3-D, rainbow-colored model. In a clinical setting, the tool has been shown to increase diagnostic accuracy from 39 percent to 91 percent.
Presented this week at the IEEE Information Visualization Conference, the new visualization method offers insight to clinicians, imaging specialists, engineers, and others in a wide range of fields who need to explore and evaluate complex structures.
“Our goal was to design a visual representation of the data that was as accurate and efficient for patient diagnosis as possible,” said lead author Michelle Borkin, a doctoral candidate at the Harvard School of Engineering and Applied Sciences (SEAS). “What we found is that the prettiest, most popular visualization is not always the most effective.”
Using data from patient-specific blood flow simulations, HemoVis displays a tree diagram of the arteries with areas of disease highlighted to assist in diagnosis.
Tools for artery visualization in both clinical and research settings commonly use 3-D models that portray the shape and spatial arrangement of vessels of interest. These complex tools require users to rotate the models to get a complete perspective of spatial orientation.
By contrast, the new visualization requires no such rotation or interaction. The tool utilizes 2-D, circumference-adjusted cylindrical cross sections arranged in tree diagrams.
Though this method may seem less high-tech, the team demonstrated through quantitative evaluation with medical experts that the 2-D model is actually more accurate and efficient for patient diagnosis.
“In the 3-D case, the more complex and branched the arteries were, the longer it took to complete the patient diagnosis, and the lower the accuracy was,” Borkin said. “In the 2-D representation, it didn’t matter how many branches we had or how complex they were — we got consistently fast, accurate results. We weren’t expecting that.”
Tree diagrams are hardly new, as evolutionary biologists will attest, but scientists in many fields are using them to solve a range of modern and complex problems. In fact, Borkin applied her own experience in astronomy and physics to transform the concept of visualization for SEAS’ Multiscale Hemodynamics research group. In prior work, she used a similar type of tree diagram to determine the structure of nebulae in space.
“With the consultation and cooperation of clinicians, we were able to draw on fairly well-known visualization techniques and principles from computer science to solve a practical clinical problem,” says Hanspeter Pfister, Gordon McKay Professor of the Practice of Computer Science at SEAS.
Borkin, Pfister, and their colleagues relied on the input of physicians and others with clinical or laboratory imaging experience throughout the process. Through extensive surveys and interviews, they identified the most popular options for display, accurate layout, and coloring of these arterial projections.
Doctors initially showed some resistance when asked about the benefits of an alternative color scheme, citing familiarity, chromatic vibrancy, and aesthetic appeal in support of the rainbow scheme, which is most common in scientific visual representations.
However, Borkin drew on well-supported research that is less well-known outside the visualization community:
“For years, visualization, computer science, and psychology researchers have identified that color is critical for conveying the value of data, but that the rainbow coloring is not well-attuned to the human visual system.”
Accordingly, HemoVis departs from the traditional practice of rainbow color-coding in favor of a graded single-color scheme (red to black) that can represent placement along a continuum.
In tests, diagnostic accuracy, as measured by the proportion of diseased areas identified, increased dramatically with the new color scheme.
Widespread adoption of visual representations like those in HemoVis could have the effect of not only optimizing tasks that are critical for doctors, but also changing long-entrenched mindsets and making scientists think twice about their assumptions in data visualization, Borkin says.
“This approach to visualization design and validation is broadly applicable in medicine, engineering, and science,” said Pfister. “We hope that people will use this process as a template for transforming their own visualizations.”
Borkin and Pfister said that while HemoVis represents an important step forward, the traditional 3-D artery mode still plays an important role, particularly as a spatially intuitive tool for surgical planning.
With this in mind, the next steps for research include further development and optimization of the 2-D tool and investigation into how it might complement, rather than replace, its 3-D counterpart.
A paper about the work will be published later this year in the journal IEEE Transactions on Visualization and Computer Graphics.
Borkin and Pfister’s collaborators were Krzysztof Gajos, assistant professor of computer science at SEAS; Amanda Peters, a doctoral candidate in applied physics at SEAS; research scientist Simone Melchionna; and Dimitrios Mitsouras, Frank Rybicki, and Charles Feldman of Harvard Medical School and Brigham and Women’s Hospital.
The project was supported by the Toshiba Medical Systems Corp., the CyberInfrastructure Lab at SEAS, the U.S. Department of Defense’s National Defense Science and Engineering Graduate Fellowship Program, and the U.S. Department of Energy’s Computational Science Graduate Fellowship Program.