Curing cancer with data visualization

The following is a guest blog by Jesse Paquette.

Everyone thought that The Netherlands Cancer Institute’s 12 year old dataset on breast cancer was old news. That was until a researcher with Merck & Co, Pek Lum, analyzed and visualized the dataset with the use of topological data analysis (TDA) and advanced machine learning technology. Her analysis landed her a featured story in the Wall Street Journal and, more importantly, allowed her to identify a previously unknown subgroup of cancer survivors that exhibited particular traits, a step forward in finding a cure.

Topological data analysis


Pek’s experience led her to become the Chief Data Scientist for Ayasdi, the company that created the software that was critical to her discovery. The Ayasdi Platform allowed Pek to leverage TDA to automatically construct a topological network of the cancer dataset. TDA is based on a branch of mathematics known as topology, the study of shape. Being able to use automation to find similarities within extremely complex datasets allows experts to discover new insights from analysis of the shape the data takes.

Let the data speak for itself

Instead of using more traditional methods of asking a question about a particular part of the data, Pek was able to look at the dataset in its entirety allowing the data to speak for itself. Pek was able to upload the breast cancer dataset into the Ayasdi Platform to create nodes of similar patients based on genetic make up. These nodes were then connected by edges between two or more nodes that shared a common patient. This created a complex venn diagram of relationships within the data. Further analysis of the topological network uncovered the subgroup of survivors and determine what traits made this group unique.

Driving breakthrough insights

TDA is changing the way domain experts around the world are looking at their data, and is offering a new framework in which many different algorithms can be cohesively used to automatically examine extremely complex datasets. More importantly, it allows mechanical engineers, financial service analysts, marketers, and oncologists to visualize their data in a new ways to drive breakthroughs insights.


Jesse Paquette (Lead, Translational Engineer):
Jesse leads the development of new features and pipelines that enhance user experience, particularly in the life science domain. Prior to Ayasdi, Jesse was a computation biologist at UCSF. He maintains an impressive collection of scar tissue, perpetuated be weekly overdoses of pick-up soccer.


Editor’s note: If you want to learn more about data visualization and the Big Data ecosystem, join us in New York for Interop.


Tags: , , , ,

Categories: Data Analytics / Big Data

Author:Chris Taylor

Reimagining the way work is done through big data, analytics, and event processing. There's no end to what we can change and improve. I wear myself out...

Subscribe to the blog

Subscribe and receive an email when new articles are published


  1. Can Big Data Visualizations be Actionable? | Data Model Prototype - September 1, 2013

    […] Curing cancer with data visualization ( […]

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: