Will Bad Data Undermine Good Tech?
[ad_1]
May 18, 2022 – Imagine walking into the Library of Congress, with its millions of books, and having the goal of reading them all. Impossible, right? Even if you could read every word of every work, you wouldn’t be able to remember or understand everything, even if you spent a lifetime trying.
Now let’s say you somehow had a super-powered brain capable of reading and understanding all that information. You would still have a problem: You wouldn’t know what wasn’t covered in those books – what questions they’d failed to answer, whose experiences they’d left out.
Similarly, today’s researchers have a staggering amount of data to sift through. All the world’s peer-reviewed studies contain more than 34 million citations. Millions more data sets explore how things like bloodwork, medical and family history, genetics, and social and economic traits impact patient outcomes.
Artificial intelligence lets us use more of this material than ever. Emerging models can quickly and accurately organize huge amounts of data, predicting potential patient outcomes and helping doctors make calls about treatments or preventive care.
Advanced mathematics holds great promise. Some algorithms – instructions for solving problems – can diagnose breast cancer with more accuracy than pathologists. Other AI tools are already in use in medical settings, allowing doctors to more quickly look up a patient’s medical history or improve their ability to analyze radiology images.
But some experts in the field of artificial intelligence in medicine suggest that while the benefits seem obvious, lesser noticed biases can undermine these technologies. In fact, they warn that biases can lead to ineffective or even harmful decision-making in patient care.
New Tools, Same Biases?
While many people associate “bias” with personal, ethnic, or racial prejudice, broadly defined, bias is a tendency to lean in a certain direction, either in favor of or against a particular thing.
In a statistical sense, bias occurs when data does not fully or accurately represent the population it is intended to model. This can happen from having poor data at the start, or it can occur when data from one population is applied to another by mistake.
Both types of bias – statistical and racial/ethnic – exist within medical literature. Some populations have been studied more, while others are under-represented. This raises the question: If we build AI models from the existing information, are we just passing old problems on to new technology?
“Well, that is definitely a concern,” says David M. Kent, MD, director of the Predictive Analytics and Comparative Effectiveness Center at Tufts Medical Center.
In a new study, Kent and a team of researchers examined 104 models that predict heart disease – models designed to help doctors decide how to prevent the condition. The researchers wanted to know whether the models, which had performed accurately before, would do as well when tested on a new set of patients.
Their findings?
The models “did worse than people would expect,” Kent says.
They were not always able to tell high-risk from low-risk patients. At times, the tools over- or underestimated the patient’s risk of disease. Alarmingly, most models had the potential to cause harm if used in a real clinical setting.
Why was there such a difference in the models’ performance from their original tests, compared to now? Statistical bias.
“Predictive models don’t generalize as well as people think they generalize,” Kent says.
When you move a model from one database to another, or when things change over time (from one decade to another) or space (one city to another), the model fails to capture those differences.
That creates statistical bias. As a result, the model no longer represents the new population of patients, and it may not work as well.
That doesn’t mean AI shouldn’t be used in health care, Kent says. But it does show why human oversight is so important.
“The study does not show that these models are especially bad,” he says. “It highlights a general vulnerability of models trying to predict absolute risk. It shows that better auditing and updating of models is needed.”
But even human supervision has its limits, as researchers caution in a new paper arguing in favor of a standardized process. Without such a framework, we can only find the bias we think to look for, the they note. Again, we don’t know what we don’t know.
Bias in the ‘Black Box’
Race is a mixture of physical, behavioral, and cultural attributes. It is an essential variable in health care. But race is a complicated concept, and problems can arise when using race in predictive algorithms. While there are health differences among racial groups, it cannot be assumed that all people in a group will have the same health outcome.
David S. Jones, MD, PhD, a professor of culture and medicine at Harvard University, and co-author of Hidden in Plain Sight – Reconsidering the Use of Race Correction in Algorithms, says that “a lot of these tools [analog algorithms] seem to be directing health care resources toward white people.”
Around the same time, similar biases in AI tools were being identified by researchers Ziad Obermeyer, MD, and Eric Topol, MD.
The lack of diversity in clinical studies that influence patient care has long been a concern. A concern now, Jones says, is that using these studies to build predictive models not only passes on those biases, but also makes them more obscure and harder to detect.
Before the dawn of AI, analog algorithms were the only clinical option. These types of predictive models are hand-calculated instead of automatic.
“When using an analog model,” Jones says, “a person can easily look at the information and know exactly what patient information, like race, has been included or not included.”
Now, with machine learning tools, the algorithm may be proprietary – meaning the data is hidden from the user and can’t be changed. It’s a “black box.” That’s a problem because the user, a care provider, might not know what patient information was included, or how that information might affect the AI’s recommendations.
“If we are using race in medicine, it needs to be totally transparent so we can understand and make reasoned judgments about whether the use is appropriate,” Jones says. “The questions that need to be answered are: How, and where, to use race labels so they do good without doing harm.”
Should You Be Concerned About AI in Clinical Care?
Despite the flood of AI research, most clinical models have yet to be adopted in real-life care. But if you are concerned about your provider’s use of technology or race, Jones suggests being proactive. You can ask the provider: “Are there ways in which your treatment of me is based on your understanding of my race or ethnicity?” This can open up dialogue about the provider makes decisions.
Meanwhile, the consensus among experts is that problems related to statistical and racial bias within artificial intelligence in medicine do exist and need to be addressed before the tools are put to widespread use.
“The real danger is having tons of money being poured into new companies that are creating prediction models who are under pressure for a good [return on investment],” Kent says. “That could create conflicts to disseminate models that may not be ready or sufficiently tested, which may make the quality of care worse instead of better.”
[ad_2]
Source link
best online pharmacies in mexico https://mexicanpharmacy.life/# – mexico pharmacies prescription drugs
reputable indian pharmacies https://indiapharmacy.world/# – online pharmacy india
generic ivermectin for humans https://ivermectin.today/# ivermectin lotion
Greetings! Very helpful advice in this particular post!
It’s the little changes that will make the
greatest changes. Thanks a lot for sharing!
Very good information. Lucky me I recently found your blog by accident (stumbleupon).
I’ve book marked it for later!
I was recommended this blog by means of my cousin. I’m
no longer sure whether this submit is written by way of him
as nobody else recognize such special about my problem. You’re wonderful!
Thanks!
Ahaa, its nice conversation on the topic of this
article here at this blog, I have read all that, so at this
time me also commenting at this place.
When someone writes an piece of writing he/she maintains the idea of a user in his/her brain that how a user can be
aware of it. Thus that’s why this paragraph is great.
Thanks!
I do believe all the ideas you’ve offered in your post.
They’re really convincing and can definitely work. Nonetheless,
the posts are very short for beginners. May you please lengthen them a bit
from next time? Thank you for the post.
Hello, this weekend is fastidious designed for me, because this point in time i am reading this enormous informative paragraph here at my home.
After I originally commented I appear to have clicked on the -Notify me when new comments are
added- checkbox and from now on whenever a comment is added I receive four emails with the exact same
comment. There has to be a way you can remove me from that service?
Thanks a lot!
Heya just wanted to give you a brief heads up and let you know a few of the pictures
aren’t loading properly. I’m not sure why but I think its a
linking issue. I’ve tried it in two different web browsers and both show the same results.
Good way of describing, and fastidious paragraph to obtain data regarding my presentation subject, which i am
going to convey in institution of higher education.
Excellent, what a weblog it is! This weblog provides helpful facts to us,
keep it up.
Incredibly informative post! I learned a lot and look forward to more.
This blog is a treasure trove of knowledge. Thank you for your contributions!
You have a unique perspective that I find incredibly valuable. Thank you for sharing.
I appreciate the unique viewpoints you bring to your writing. Very insightful!
This article was a joy to enjoy reading. Your enthusiasm is contagious!
I’m amazed by the depth and b enjoy readingth of your knowledge. Thanks for sharing!
I’m so grateful for the information you’ve shared. It’s been incredibly enlightening!
You have a gift for explaining things in an understandable way. Thank you!
Your insights have added a lot of value to my understanding. Thanks for sharing.
Thank you for making complex topics accessible and engaging.
Your post has been incredibly helpful. Thank you for the guidance!
This article is a perfect blend of informative and entertaining. Well done!
Such a well-researched piece! It’s evident how much effort you’ve put in.
Your work is truly inspirational. I appreciate the depth you bring to your topics.
Your attention to detail is remarkable. I appreciate the thoroughness of your post.
The consistency and high quality of The content are something I really appreciate. Thank you for The dedication.
Thoughtful analysis that made me think, which is quite the feat these days.
The grace and authority with which you handle topics are awe-inspiring. I always come away with new knowledge.
The elegance of The prose is like a fine dance, each word stepping gracefully to the next.
This article is a perfect blend of informative and entertaining. Well done!
Your insights have added a lot of value to my understanding. Thanks for sharing.
I appreciate the unique viewpoints you bring to your writing. Very insightful!
Thank you for the hard work you put into this post. It’s much appreciated!
This was a great enjoy reading—thought-provoking and informative. Thank you!
Incredibly informative post! I learned a lot and look forward to more.
I’m bookmarking this for future reference. Your advice is spot on!
Your passion for this subject shines through your words. Inspiring!
Incredibly informative post! I learned a lot and look forward to more.
Your insights have added a lot of value to my understanding. Thanks for sharing.
I’m always excited to see your posts in my feed. Another excellent article!
This post was a breath of fresh air. Thank you for your unique insights!
Stumbling upon The article was a highlight of my day. It was just what I needed to read.
I loved The fresh take on this topic. The points resonated with me deeply.
You tackle topics with such finesse, it’s like watching a skilled chef at work. Serving up knowledge with flair!
Truly inspirational work, or so I tell myself as I avoid my own projects.
The post has broadened my perspective in ways I didn’t expect. Thank you for that.
You have a knack for presenting hard to understand topics in an engaging way. Kudos to you!
A go-to resource, like a library but without the late fees.
This article was a joy to read. The enthusiasm is contagious!
You’ve got a way with words that’s as enchanting as a full moon. I’m bewitched.
This piece was beautifully written and incredibly informative. Thank you for sharing!
The finesse with which you articulated The points has me captivated. It’s as if you’re speaking my language.
This is the most thorough piece I’ve read on the topic. The dedication to research is admirable.
A perfect blend of informative and entertaining, like the ideal date night conversation.
Joy to read and contagious enthusiasm? I thought I was immune, but you proved me wrong.
I appreciate the balance and fairness in The writing. Great job!
The blend of informative and entertaining content is perfect. I enjoyed every word.
Testament to The expertise and hard work, or The ability to make me feel utterly unaccomplished.
This is one of the most comprehensive articles I’ve read on this topic. Kudos!
The creativity and insight left a big impression on me. Fantastic job!
The passion you pour into The posts is like a flame, igniting curiosity and warming the soul.
The passion you pour into The posts is like a flame, igniting curiosity and warming the soul.
The insights light up my intellect like fireworks. Thanks for the show!
Thank you for making hard to understand topics accessible and engaging.
The Writing is like a secret garden, each post a path leading to new discoveries and delights.
Always excited for The posts, because who else is going to make me feel this inadequately informed?
Brilliant writing! You’ve captured the essence perfectly, much like a photographer captures a stunning landscape.
Truly inspirational work, or so I tell myself as I avoid my own projects.
You’ve presented a hard to understand topic in a clear and engaging way. Bravo!
Stumbling upon The article was a highlight of my day. It was just what I needed to read.
I’m always excited to see The posts in my feed. Another excellent article!
“What a fantastic read! Your ability to convey complex ideas in such a clear and engaging manner is truly impressive. I appreciate the thorough research and thoughtfulness that went into this post. It’s evident you care deeply about your readers’ understanding and growth. Thank you!”
Each post is a journey, and The words are the map. Thanks for leading the way.
The posts are like a cozy nook, inviting and comfortable, where I can immerse myself in thoughts.
I’m so grateful for the information you’ve shared. It’s been incredibly enlightening!
I’m always excited to see The posts in my feed. Another excellent article!
The posts inspire me regularly. The depth you bring to The topics is truly exceptional.
The piece was both informative and thought-provoking. Thanks for the great work!
The fresh insights were a breath of fresh air. Thank you for sharing The unique perspective.
The analysis is like a well-crafted movie—engaging, enlightening, and leaving me thinking long after it’s over.
This Writing is a treasure trove of knowledge. Thank you for The contributions!
The arguments were as compelling as The online persona. I’m totally sold—and not just on The ideas.
Bookmarking this! The practical advice is something I’ll definitely be coming back to.
The writing style is captivating. Finally, something that can keep my attention longer than a TikTok video.
The attention to detail is as attractive as it is thorough. I appreciate a person who notices the little things.
A beacon of knowledge, or so I thought until I realized it’s just The shining confidence.
The attention to detail is remarkable. I appreciate the thoroughness of The post.
https://www.google.dm/url?q=https://jsfiddle.net/sackturkey95/gm2odhx7/
https://linkagogo.trade/story.php?title=through-the-looking-glass-a-guide-to-auto-glass-replacement#discuss
http://skiindustry.org/forum/member.php?action=profile&uid=1176899
http://www.neworleansbbs.com/home.php?mod=space&uid=278857
https://firsturl.de/F0b10O0
This piece was beautifully written and incredibly informative. Thank you for sharing!
https://gpsites.stream/story.php?title=shattered-no-more-a-guide-to-auto-glass-replacement#discuss
http://wnt1688.cn/home.php?mod=space&uid=8819944
The writing has the warmth and familiarity of a favorite sweater, providing comfort and insight in equal measure.
https://maps.google.nr/url?q=https://kelley-cortez-4.blogbright.net/shattered-no-more-the-ultimate-guide-to-auto-glass-replacement-1717294262
http://bbs.sdhuifa.com/home.php?mod=space&uid=554095
https://anzforum.com/home.php?mod=space&uid=1886286
http://mozillabd.science/index.php?title=fiskerfitzsimmons2470
https://menwiki.men/wiki/Seeing_Clearly_The_Ultimate_Guide_to_Auto_Glass_Replacement
The depth of The understanding is as mesmerizing as the ocean. I’m ready to dive in.
The unique perspective is as intriguing as a mystery novel. Can’t wait to read the next chapter.
The work is both informative and thought-provoking. I’m really impressed by the high quality of The content.
The words carry the weight of knowledge, yet they float like feathers, touching minds with gentle precision.
The perspective is incredibly valuable to me. Thanks for opening my eyes to new ideas.
Each post you share is like a gift, wrapped in the finest paper of eloquence and insight.
Brilliant piece of writing. It’s like you’re showing off, but I’m not even mad.
I’m in awe of the way you handle topics with both grace and authority.
The insights are like a sunrise, bringing light and warmth to new ideas.
Compelling read with well-presented arguments. I almost felt persuaded. Almost.
The writing style is captivating. Finally, something that can keep my attention longer than a TikTok video.
Thoughtful analysis that made me think, which is quite the feat these days.
This piece was beautifully written and incredibly informative. Thank you for sharing!
The insights dazzled me more than a candlelit dinner. Thanks for lighting up my intellect.
The thought-provoking post has me looking forward to more. It’s like the intellectual equivalent of a second date.
The article was a delightful read. It’s clear you’re passionate about what you do, and it shows.
This is the most thorough piece I’ve read on the topic. The dedication to research is admirable.
The Writing is like a secret garden, each post a path leading to new discoveries and delights.
Bookmarking this for future reference, because who knows when I’ll need a reminder of The wisdom?
The Writing is like a trusted compass, always pointing me in the direction of enlightenment.
You’ve opened my eyes to new perspectives. Thank you for the enlightenment!
This article was a joy to read. The enthusiasm is contagious!
The article was a joy to read, and The enthusiasm is as infectious as The charm.
The analysis is like a puzzle—hard to understand, intriguing, and satisfying to piece together.
The dedication to high quality content is evident and incredibly appealing. It’s hard not to admire someone who cares so much.
Both informative and thought-provoking, as if my brain needed the extra workout.
The knack for making hard to understand concepts readable is something I greatly admire.
The finesse with which you articulated The points made The post a true pleasure to read.
The insights light up my intellect like fireworks. Thanks for the show!
The creativity and insight left a big impression on me. Fantastic job!
Each article you write is like a step in a dance, moving us gracefully through The thoughts.
This post has been incredibly helpful to me. The guidance is something I’m truly grateful for.
Discovering The Writing felt like finding the perfect match. The intellect and charm are a rare combo.
I’m impressed by The ability to convey such nuanced ideas with clarity.
The Writing is like a warm fireplace on a cold day, inviting me to settle in and stay awhile.
Both informative and thought-provoking, as if my brain needed the extra workout.
Each post is a window into The thoughts, and I must say, the view is stunning.
The depth of The research really stands out. It’s clear you’ve put a lot of thought into this.
Bookmarking this! The practical advice is something I’ll definitely be coming back to.
The Writing is a constant source of inspiration and knowledge. Thank you!
The elegance of The prose is like a fine dance, each word stepping gracefully to the next.
You’ve done a fantastic job of breaking down this topic. Thanks for the clarity!
This was a great read—thought-provoking and informative. Thank you!
Testament to The expertise and hard work, or The ability to make me feel utterly unaccomplished.
Shedding light on this subject like you’re the only star in my night sky. The brilliance is refreshing.
Stumbling upon this article was the highlight of my day, much like catching a glimpse of a smile across the room.
Brilliant piece of writing. It’s like you’re showing off, but I’m not even mad.
You present hard to understand topics in a clear and engaging way, as if inviting me on an adventure of the mind.
The consistency and high quality of The content are something I really appreciate. Thank you for The dedication.
The insights add so much value to the conversation. I always learn something new from you.
Making hard to understand concepts readable is no small feat. It’s like you know exactly how to tickle my brain.
Reading The work is like catching up with an old friend; comfortable, enlightening, and always welcome.
The Writing is a treasure trove of knowledge, like finding an untouched library book. A rare gem!
Consistently producing high-high quality content, like sending flowers just because. Thank you for The dedication.
A masterpiece of writing—you’ve covered all bases with such finesse, I’m left wanting an encore.
The work is truly inspirational. I appreciate the depth you bring to The topics.
The Writing is like a trusted compass, always pointing me in the direction of enlightenment.
The elegance of The arguments is as captivating as a sunset. I could admire it all day.
The posts are like a secret garden of knowledge. I’m always excited to see what’s blooming.
Touched on personal resonances, or as I like to call it, psychic abilities.
This article was a delightful read. The passion is clearly visible!
The writing is a masterpiece. You managed to cover every aspect with such finesse.
The expertise and hard work shine through, making me admire you more with each word.
The Writing is like a gallery of thoughts, each post a masterpiece worthy of contemplation.