Innovating Against the Odds: How Generative AI is Tackling Data Scarcity in Rare Disease Research

Updated on July 1, 2024

Have you ever faced the challenge of completing a complex puzzle without having all the pieces? Or maybe you have tried to put together a puzzle without having the picture as a reference? It can be frustrating and seemingly impossible. But imagine if, instead of a puzzle, it was a rare medical condition, and instead of missing puzzle pieces, there was a scarcity of available data. This is the reality for people researching rare diseases – conditions that affect 10% of people in the United States or about 30 million people. With limited data and resources, finding effective treatments for rare diseases can be like trying to solve a puzzle with missing pieces.

The Challenge of Data Scarcity

Rare diseases are often called “orphan diseases” because they affect a small portion of the population and receive little attention from the medical community. This lack of attention also translates into a scarcity of data and resources for research and treatment development. In fact, it is estimated that 95% of rare diseases do not have an FDA-approved treatment available. With limited data, traditional methods of drug discovery and development have become more difficult, time-consuming, and expensive.

But why is there such a scarcity of data? One reason is that rare diseases are inherently difficult to study due to the small number of affected individuals. This makes it challenging to conduct large-scale clinical trials and gather enough data for meaningful analysis. Additionally, many rare diseases have a complex genetic basis, making it even more difficult to pinpoint the underlying cause and develop effective treatments.

The Promise of Generative AI

Despite the challenges, there is hope for rare disease research – and it comes in the form of Generative Artificial Intelligence (AI). Generative AI is like a puzzle piece generator for researchers. It has the capability to learn from the few puzzle pieces (the real data that scientists have), and then it gets creative and makes realistic copies that could actually fit into the puzzle that scientists are trying to solve and gives them a huge pile of puzzle pieces for them to start working with.

An additional benefit of this technology is that it allows researchers to generate synthetic data, which can help fill in the gaps where real data is lacking. This data can then be used to train AI models and identify new potential drug targets, making the drug discovery process more efficient and cost-effective. By analyzing large amounts of data, Generative AI can uncover patterns and connections that may have been missed by traditional methods, leading to new insights and breakthroughs in rare disease research.

Children’s Hospital of Philadelphia (CHOP) is using generative AI to create synthetic brain MRI’s of patients with rare neurological diseases. It allows the hospital to train diagnostic algorithms that would have been difficult to develop without a large dataset of real patient MRI’s. This technology enables CHOP to make more accurate diagnoses and improve patient care.

Ethical Considerations and Challenges

While generative AI shows great promise in rare disease research, there are ethical considerations and challenges that need to be addressed. One concern is the potential for bias in the generated data, which could lead to incorrect assumptions and hinder progress in research. The saying I like to use is ‘garbage in, garbage out.’ AI is only as good as the data it learns from. If the training data is biased, then the AI will also be biased. Another challenge is that rare diseases are often highly complex and have multiple contributing factors, making it difficult for AI to accurately capture the full picture. There is no one-size-fits-all solution in rare disease research, and generative AI should be used in conjunction with other methods to ensure accurate and comprehensive results. Along with data bias, concerns about data privacy and ownership when using large datasets of patient information should also be considered.

To address these challenges, it is crucial for researchers to carefully select and curate their training data to minimize bias. Transparency in the AI development process is also essential so that potential biases can be identified and addressed. It is important for researchers to clearly disclose when they are using synthetic data and ensure that it is transparent, unbiased, rigorously tested, and validated before being used in any research or clinical applications.

A Collaborative Future

I remain both excited and optimistic about the trajectory of rare disease research, particularly with the integration of generative AI and synthetic data. The potential to bridge gaps in data, improve diagnosis, and develop targeted treatments gives hope to patients and families affected by rare diseases. But beyond the technology itself, I am most excited about the doors it opens for global collaboration. Sharing data and insights across borders can act as a great equalizer, enabling countries and researchers around the world to contribute to and benefit from collective knowledge.

Yet, as we continue building towards this future, it is essential to prioritize transparency, accountability, and inclusivity. This means involving patient communities in the development and implementation of AI technology, promoting diverse representation in data sets, and holding ourselves to high ethical standards. Integrating technology with human knowledge must be approached with empathy and compassion at the forefront. It’s not just about advancing research; it’s about understanding individuals’ experiences with rare diseases and striving to improve their quality of life. By weaving together the strength of global collaboration, the power of AI, and the depth of human insight, empathy, and compassion, we are just scratching the surface of a new era in rare disease research—one that holds the promise of groundbreaking discoveries and the hope for millions around the world who have no treatment options.

Shweta Maniar Headshot
Shweta Maniar
Global Client Lead, Cloud Healthcare & Life Sciences at Google Cloud

Shweta Maniar is global client lead, Cloud Healthcare & Life Sciences for Google Cloud.