Will Bad Data Undermine Good Tech?
[ad_1]
May 18, 2022 – Imagine walking into the Library of Congress, with its millions of books, and having the goal of reading them all. Impossible, right? Even if you could read every word of every work, you wouldn’t be able to remember or understand everything, even if you spent a lifetime trying.
Now let’s say you somehow had a super-powered brain capable of reading and understanding all that information. You would still have a problem: You wouldn’t know what wasn’t covered in those books – what questions they’d failed to answer, whose experiences they’d left out.
Similarly, today’s researchers have a staggering amount of data to sift through. All the world’s peer-reviewed studies contain more than 34 million citations. Millions more data sets explore how things like bloodwork, medical and family history, genetics, and social and economic traits impact patient outcomes.
Artificial intelligence lets us use more of this material than ever. Emerging models can quickly and accurately organize huge amounts of data, predicting potential patient outcomes and helping doctors make calls about treatments or preventive care.
Advanced mathematics holds great promise. Some algorithms – instructions for solving problems – can diagnose breast cancer with more accuracy than pathologists. Other AI tools are already in use in medical settings, allowing doctors to more quickly look up a patient’s medical history or improve their ability to analyze radiology images.
But some experts in the field of artificial intelligence in medicine suggest that while the benefits seem obvious, lesser noticed biases can undermine these technologies. In fact, they warn that biases can lead to ineffective or even harmful decision-making in patient care.
New Tools, Same Biases?
While many people associate “bias” with personal, ethnic, or racial prejudice, broadly defined, bias is a tendency to lean in a certain direction, either in favor of or against a particular thing.
In a statistical sense, bias occurs when data does not fully or accurately represent the population it is intended to model. This can happen from having poor data at the start, or it can occur when data from one population is applied to another by mistake.
Both types of bias – statistical and racial/ethnic – exist within medical literature. Some populations have been studied more, while others are under-represented. This raises the question: If we build AI models from the existing information, are we just passing old problems on to new technology?
“Well, that is definitely a concern,” says David M. Kent, MD, director of the Predictive Analytics and Comparative Effectiveness Center at Tufts Medical Center.
In a new study, Kent and a team of researchers examined 104 models that predict heart disease – models designed to help doctors decide how to prevent the condition. The researchers wanted to know whether the models, which had performed accurately before, would do as well when tested on a new set of patients.
Their findings?
The models “did worse than people would expect,” Kent says.
They were not always able to tell high-risk from low-risk patients. At times, the tools over- or underestimated the patient’s risk of disease. Alarmingly, most models had the potential to cause harm if used in a real clinical setting.
Why was there such a difference in the models’ performance from their original tests, compared to now? Statistical bias.
“Predictive models don’t generalize as well as people think they generalize,” Kent says.
When you move a model from one database to another, or when things change over time (from one decade to another) or space (one city to another), the model fails to capture those differences.
That creates statistical bias. As a result, the model no longer represents the new population of patients, and it may not work as well.
That doesn’t mean AI shouldn’t be used in health care, Kent says. But it does show why human oversight is so important.
“The study does not show that these models are especially bad,” he says. “It highlights a general vulnerability of models trying to predict absolute risk. It shows that better auditing and updating of models is needed.”
But even human supervision has its limits, as researchers caution in a new paper arguing in favor of a standardized process. Without such a framework, we can only find the bias we think to look for, the they note. Again, we don’t know what we don’t know.
Bias in the ‘Black Box’
Race is a mixture of physical, behavioral, and cultural attributes. It is an essential variable in health care. But race is a complicated concept, and problems can arise when using race in predictive algorithms. While there are health differences among racial groups, it cannot be assumed that all people in a group will have the same health outcome.
David S. Jones, MD, PhD, a professor of culture and medicine at Harvard University, and co-author of Hidden in Plain Sight – Reconsidering the Use of Race Correction in Algorithms, says that “a lot of these tools [analog algorithms] seem to be directing health care resources toward white people.”
Around the same time, similar biases in AI tools were being identified by researchers Ziad Obermeyer, MD, and Eric Topol, MD.
The lack of diversity in clinical studies that influence patient care has long been a concern. A concern now, Jones says, is that using these studies to build predictive models not only passes on those biases, but also makes them more obscure and harder to detect.
Before the dawn of AI, analog algorithms were the only clinical option. These types of predictive models are hand-calculated instead of automatic.
“When using an analog model,” Jones says, “a person can easily look at the information and know exactly what patient information, like race, has been included or not included.”
Now, with machine learning tools, the algorithm may be proprietary – meaning the data is hidden from the user and can’t be changed. It’s a “black box.” That’s a problem because the user, a care provider, might not know what patient information was included, or how that information might affect the AI’s recommendations.
“If we are using race in medicine, it needs to be totally transparent so we can understand and make reasoned judgments about whether the use is appropriate,” Jones says. “The questions that need to be answered are: How, and where, to use race labels so they do good without doing harm.”
Should You Be Concerned About AI in Clinical Care?
Despite the flood of AI research, most clinical models have yet to be adopted in real-life care. But if you are concerned about your provider’s use of technology or race, Jones suggests being proactive. You can ask the provider: “Are there ways in which your treatment of me is based on your understanding of my race or ethnicity?” This can open up dialogue about the provider makes decisions.
Meanwhile, the consensus among experts is that problems related to statistical and racial bias within artificial intelligence in medicine do exist and need to be addressed before the tools are put to widespread use.
“The real danger is having tons of money being poured into new companies that are creating prediction models who are under pressure for a good [return on investment],” Kent says. “That could create conflicts to disseminate models that may not be ready or sufficiently tested, which may make the quality of care worse instead of better.”
[ad_2]
Source link
best online pharmacies in mexico https://mexicanpharmacy.life/# – mexico pharmacies prescription drugs
reputable indian pharmacies https://indiapharmacy.world/# – online pharmacy india
generic ivermectin for humans https://ivermectin.today/# ivermectin lotion
Greetings! Very helpful advice in this particular post!
It’s the little changes that will make the
greatest changes. Thanks a lot for sharing!
Very good information. Lucky me I recently found your blog by accident (stumbleupon).
I’ve book marked it for later!
I was recommended this blog by means of my cousin. I’m
no longer sure whether this submit is written by way of him
as nobody else recognize such special about my problem. You’re wonderful!
Thanks!
Ahaa, its nice conversation on the topic of this
article here at this blog, I have read all that, so at this
time me also commenting at this place.
When someone writes an piece of writing he/she maintains the idea of a user in his/her brain that how a user can be
aware of it. Thus that’s why this paragraph is great.
Thanks!
I do believe all the ideas you’ve offered in your post.
They’re really convincing and can definitely work. Nonetheless,
the posts are very short for beginners. May you please lengthen them a bit
from next time? Thank you for the post.
Hello, this weekend is fastidious designed for me, because this point in time i am reading this enormous informative paragraph here at my home.
After I originally commented I appear to have clicked on the -Notify me when new comments are
added- checkbox and from now on whenever a comment is added I receive four emails with the exact same
comment. There has to be a way you can remove me from that service?
Thanks a lot!
Heya just wanted to give you a brief heads up and let you know a few of the pictures
aren’t loading properly. I’m not sure why but I think its a
linking issue. I’ve tried it in two different web browsers and both show the same results.
Good way of describing, and fastidious paragraph to obtain data regarding my presentation subject, which i am
going to convey in institution of higher education.
Excellent, what a weblog it is! This weblog provides helpful facts to us,
keep it up.
Incredibly informative post! I learned a lot and look forward to more.
This blog is a treasure trove of knowledge. Thank you for your contributions!
You have a unique perspective that I find incredibly valuable. Thank you for sharing.
I appreciate the unique viewpoints you bring to your writing. Very insightful!
This article was a joy to enjoy reading. Your enthusiasm is contagious!
I’m amazed by the depth and b enjoy readingth of your knowledge. Thanks for sharing!
I’m so grateful for the information you’ve shared. It’s been incredibly enlightening!
You have a gift for explaining things in an understandable way. Thank you!
Your insights have added a lot of value to my understanding. Thanks for sharing.
Thank you for making complex topics accessible and engaging.
Your post has been incredibly helpful. Thank you for the guidance!
This article is a perfect blend of informative and entertaining. Well done!
Such a well-researched piece! It’s evident how much effort you’ve put in.
Your work is truly inspirational. I appreciate the depth you bring to your topics.
Your attention to detail is remarkable. I appreciate the thoroughness of your post.
The consistency and high quality of The content are something I really appreciate. Thank you for The dedication.
Thoughtful analysis that made me think, which is quite the feat these days.
The grace and authority with which you handle topics are awe-inspiring. I always come away with new knowledge.
The elegance of The prose is like a fine dance, each word stepping gracefully to the next.
This article is a perfect blend of informative and entertaining. Well done!
Your insights have added a lot of value to my understanding. Thanks for sharing.
I appreciate the unique viewpoints you bring to your writing. Very insightful!
Thank you for the hard work you put into this post. It’s much appreciated!
This was a great enjoy reading—thought-provoking and informative. Thank you!
Incredibly informative post! I learned a lot and look forward to more.
I’m bookmarking this for future reference. Your advice is spot on!
Your passion for this subject shines through your words. Inspiring!
Incredibly informative post! I learned a lot and look forward to more.
Your insights have added a lot of value to my understanding. Thanks for sharing.
I’m always excited to see your posts in my feed. Another excellent article!
This post was a breath of fresh air. Thank you for your unique insights!
Stumbling upon The article was a highlight of my day. It was just what I needed to read.
I loved The fresh take on this topic. The points resonated with me deeply.
You tackle topics with such finesse, it’s like watching a skilled chef at work. Serving up knowledge with flair!
Truly inspirational work, or so I tell myself as I avoid my own projects.
The post has broadened my perspective in ways I didn’t expect. Thank you for that.
You have a knack for presenting hard to understand topics in an engaging way. Kudos to you!
A go-to resource, like a library but without the late fees.
This article was a joy to read. The enthusiasm is contagious!
You’ve got a way with words that’s as enchanting as a full moon. I’m bewitched.
This piece was beautifully written and incredibly informative. Thank you for sharing!
The finesse with which you articulated The points has me captivated. It’s as if you’re speaking my language.
This is the most thorough piece I’ve read on the topic. The dedication to research is admirable.
A perfect blend of informative and entertaining, like the ideal date night conversation.
Joy to read and contagious enthusiasm? I thought I was immune, but you proved me wrong.
I appreciate the balance and fairness in The writing. Great job!
The blend of informative and entertaining content is perfect. I enjoyed every word.
Testament to The expertise and hard work, or The ability to make me feel utterly unaccomplished.
This is one of the most comprehensive articles I’ve read on this topic. Kudos!
The creativity and insight left a big impression on me. Fantastic job!
The passion you pour into The posts is like a flame, igniting curiosity and warming the soul.
The passion you pour into The posts is like a flame, igniting curiosity and warming the soul.
The insights light up my intellect like fireworks. Thanks for the show!
Thank you for making hard to understand topics accessible and engaging.