Duke Health AI Evaluation & Governance Program
@dukeaievalgov.bsky.social
📤 143
📥 7
📝 44
Evaluating and overseeing algorithms integrated into healthcare practices
A new study in
@jamacardiology.com
by Duke researchers Chuan Hong, Nicoleta Economou, and colleagues looks at how the PREVENT score, a tool used to estimate a person’s risk of developing heart disease, performs in everyday clinical care using
#EHR
data.
jamanetwork.com/journals/jam...
loading . . .
Performance of PREVENT Cardiovascular Risk in EHR-Based Clinical Practice
This cohort study evaluates the discrimination and calibration of the Predicting Risk of Cardiovascular Disease Events (PREVENT) equations using 2 cohorts of data collected from electronic health reco...
https://jamanetwork.com/journals/jamanetworkopen/fullarticle/2847750
20 days ago
1
2
0
👇
@dukeaievalgov.bsky.social
&
@dukemargolis.bsky.social
show how health systems can build
#AI
safety into daily practice through clear oversight, ongoing monitoring, & stronger ways to identify & address issues, so AI supports safe, effective patient care.
healthpolicy.duke.edu/publications...
loading . . .
AI Safety in Health Systems: Building Infrastructure and Strengthening Risk Management Practices
https://healthpolicy.duke.edu/publications/ai-safety-health-systems-building-infrastructure-and-strengthening-risk-management
about 2 months ago
0
2
1
Duke Health AI E&G Program director, Nicoleta Economou, served on the Steering Committee that developed the latest 'AI at Duke' report on advancing
#AI
across research, education, and institutional operations. Learn more below.
provost.duke.edu/news/new-rep...
loading . . .
New report recommends path forward for Duke and artificial intelligence | Office of the Provost
The AI at Duke Steering Committee report provides a strategic framework to guide future investments and initiatives in artificial intelligence while enhancing the univers
https://provost.duke.edu/news/new-report-recommends-path-forward-duke-and-artificial-intelligence/
about 2 months ago
0
0
1
Duke Health AI Evaluation & Governance Program Director Nicoleta Economou, PhD, will deliver the keynote at the upcoming SAS Health Care Community Connection virtual event, which is open to the global health care community. Register here:
sas.com/en_us/events/2
2 months ago
0
0
0
Happening March 24:
@dukeaihealth.bsky.social
and
@dukemargolis.bsky.social
are hosting a webinar titled, 'From Deployment to Oversight: Strengthening AI Risk Management and Patient Safety in Health Care,' that will explore strategies to protect patients in the age of AI! To register:
duke.is/5/cg7u
2 months ago
0
3
2
Duke's Dr. Eric Poon, will represent
@dukeaievalgov.bsky.social
's work at the upcoming
#HIMSS2026
. The E&G Program has collaborated with Avanade to develop SAIGE (Smart AI Governance Engine), an important step toward advancing responsible health AI.
healthaigovernance.duke.edu/abcds-oversi...
2 months ago
0
0
0
A new perspective in JAMIA by Duke's Michael Cary, Nicoleta Economou, and colleagues examines the National Academy of Medicine’s AI Code of Conduct. The paper highlights a key gap in health AI governance: the lack of explicit nursing representation.
academic.oup.com/jamia/advance-
2 months ago
0
3
2
Our article, “...Consensus-Based Considerations for AI Usefulness in Healthcare,” is now published in The American Journal of Bioethics.
@dukeaievalgov.bsky.social
is excited to collaborate with colleagues across CHAI's Usefulness Workgroup for this publication:
tandfonline.com/doi/full/10.10
2 months ago
0
0
0
ABCDS Oversight Assistant Director Sophia Bessias recently joined Dr. Clay Musser and Dr. Misha Tran at the Duke Department of Medicine AI Symposium for a panel discussion of clinical AI and evaluation, moderated by Dr. Juliessa Pavon. Learn more here:
healthaigovernance.duke.edu/news/duke-he...
loading . . .
Duke Health AI E&G at the Duke Department of Medicine AI Symposium
Duke Department of Medicine AI Symposium (January 30, 2026): In January, ABCDS Oversight Assistant Director Sophia Bessias joined Dr. Clay Musser and Dr. Misha Tran at the Department of Medicine AI Sy...
https://healthaigovernance.duke.edu/news/duke-health-ai-eg-duke-department-medicine-ai-symposium
2 months ago
0
0
0
We congratulate Erasmus MC's Michel van Genderen, MD, PhD, on his appointment as Adjunct Associate Professor at Duke. Dr. van Genderen will partner with
@dukeaievalgov.bsky.social
to expand opportunities for joint research and to develop frameworks for trustworthy, evidence-based
#healthAI
.
2 months ago
0
0
0
New research published in the Journal of Biomedical Informatics by Duke researchers shows how hospitals can use
#AI
to learn collaboratively which treatments work best while keeping patient data private.
www.sciencedirect.com/science/arti...
loading . . .
A federated learning framework for ethical dynamic treatment allocation across heterogeneous hospitals
In this paper, we propose an adaptive federated learning framework to learn optimal treatments for individual hospitals that possibly serve different …
https://www.sciencedirect.com/science/article/pii/S1532046426000110
4 months ago
1
0
0
As 2025 comes to a close, we remain focused on what matters most: our patients. By advancing safe, fair, and high-quality algorithmic solutions, we’re working to improve and responsibly transform healthcare. Thank you for being part of this progress. Wishing you Happy Holidays! 🥳
5 months ago
0
0
0
Today at 2:00 PM EST:
@dukeaievalgov.bsky.social
Director, Nicoleta Economou, PhD, will join Avanade's David Galich and David Gormley for the final installment of their Smart AI Masterclass series, where the speakers will discuss
#AgenticAI
. Register now.
events.teams.microsoft.com/event/ebdde5...
5 months ago
0
0
0
👇
@dukeaievalgov.bsky.social
welcomes Elijah Richardson, MPH, who is the new Evaluation & Governance Lead for our flagship ABCDS Oversight initiative. Learn more about his new role and his professional background here:
healthaigovernance.duke.edu/personnel/el...
6 months ago
0
1
0
Nicoleta Economou, PhD, director of
@dukeaievalgov.bsky.social
has been appointed to the AI at Duke Steering Committee and will also serve as liaison for the Trustworthy & Responsible AI Advisory Committee. Provost Alec Gallimore launched the AI at Duke initiative in May 2025.
duke.is/g/newp
loading . . .
AI at Duke Initiative Strengthens Leadership and Expands Faculty Engagement - AI at Duke
The AI at Duke steering committee continues to gain momentum as it enters a critical phase of strategic planning and university-wide engagement. Launched by Provost Alec Gallimore in May, the initiati...
https://duke.is/g/newp
7 months ago
1
0
0
The
@dukeaievalgov.bsky.social
team was excited to present our work at the Duke Summit on AI for Health Innovation. Throughout the event, we observed meaningful engagement and genuine curiosity from attendees regarding our program, the ABCDS Oversight Initiative, and our published research.
7 months ago
1
0
0
@dukeaievalgov.bsky.social
Director Nicoleta Economou, PhD, recently joined leading experts in
#AI
, data science, public health, and healthcare emergency management for an AI Panel Series hosted by the Academic Healthcare Emergency Management (AHEM) Consortium.
ahemconsortium.org/from-chaos-t...
loading . . .
From Chaos to Coordination: Reimagining Healthcare Emergency Management with AI
This event is a part of the AHEM Expert Panel Series Join us for the fifth session in the Academic Healthcare Emergency Management (AHEM) Expert Panel Series, where leading voices in AI, healthcare…
https://ahemconsortium.org/from-chaos-to-coordination-reimagining-healthcare-emergency-management-with-ai/
7 months ago
0
1
0
👇
@dukeaievalgov.bsky.social
Director Nicoleta Economou, PhD, recently delivered a keynote at the National Evaluation Center of Quality and Technology in Health Conference in Athens, which highlighted
@dukehealth.bsky.social
’s leadership in advancing trustworthy and responsible
#AI
for healthcare.
8 months ago
0
2
0
👇
@dukeaievalgov.bsky.social
Director Nicoleta Economou, PhD, joined other AI leaders on a @sassoftware.bsky.social-hosted webinar exploring how agentic AI, generative AI, and AI governance are reshaping health and life sciences. Watch the webinar on demand here:
www.sas.com/en_us/webina...
loading . . .
Agentic AI, Generative AI and AI Governance
Explore how agentic AI, generative AI and AI governance are driving transformation across health and life sciences.
https://www.sas.com/en_us/webinars/agentic-ai-generative-ai-governance.html
8 months ago
0
0
0
🤔Typo or something more? The Verge's Hayden Field spoke with
@dukehealth.bsky.social
's Chief Data Scientist Michael Pencina, PhD, about the risks of "hallucinations" in medical
#LLMs
like Google's Med-Gemini, which mistakenly cited an anatomical structure that doesn’t exist, in a recent preprint.
loading . . .
Google’s healthcare AI made up a body part — what happens when doctors don’t notice?
The basilar ganglia does not exist.
https://www.theverge.com/health/718049/google-med-gemini-basilar-ganglia-paper-typo-hallucination
8 months ago
0
1
0
Looking to add some academic heat to your fall reading list, the
@dukeaievalgov.bsky.social
is spotlighting our latest research on algorithm oversight,
#LLM
evaluation, fairness, and safety in
#healthAI
.
healthaigovernance.duke.edu/news/fall-re...
loading . . .
Fall Reading on AI Governance
Looking to add some academic heat to your fall reading list? The Duke Health AI Evaluation & Governance Program is spotlighting our latest research on algorithm oversight, LLM evaluation, fairness, an...
https://healthaigovernance.duke.edu/news/fall-reading-ai-governance
8 months ago
1
2
0
North Carolina Public Radio (
@wunc.org
) reports on
@dukehealth.bsky.social
's national leadership in health
#AI
governance, spotlighting two new evaluation frameworks developed by Duke researchers to assess the safety, reliability, and clinical performance of
#LLMs
.
www.wunc.org/health/2025-...
loading . . .
Duke innovates on implementing and assessing AI in health spaces
Researchers are creating evaluation frameworks to ensure the safe usage of LLMs, like ChatGPT, at Duke Health
https://www.wunc.org/health/2025-06-26/duke-innovate-implementing-assessing-ai-health
11 months ago
0
0
0
👇@axios.com reports on how a team of Duke researchers led by Chief Data Scientist Michael Pencina has developed two important evaluation frameworks to assess the safety, accuracy, and reliability of large language models (LLMs) in clinical care.
axios.com/local/raleig...
@dukehealth.bsky.social
loading . . .
Duke researchers want to ensure AI is safe in a health care setting
Health systems across the country are investing heavily in AI as a way to reduce burnout for providers and potentially improve care
https://axios.com/local/raleigh/2025/06/24/duke-researchers-artificial-intelligence-health-care-ai?utm_source=chatgpt.com
11 months ago
0
2
0
Duke researchers, led by Dr. Michael Pencina and Dr. Chuan Hong, have developed two pioneering frameworks designed to evaluate the performance, safety, and reliability of large language models (LLMs) in healthcare.
corporate.dukehealth.org/news/duke-un...
1/2
loading . . .
Duke University Sets New National Standard for Safe, Scalable AI in Health Care
DURHAM, N.C. — Duke University School of Medicine researchers have developed two pioneering frameworks designed to evaluate the performance, safety, and reliability of large-language models in health ...
https://corporate.dukehealth.org/news/duke-university-sets-new-national-standard-safe-scalable-ai-health-care
11 months ago
1
2
1
New in
@jamahealthforum.bsky.social
: Duke’s Michael Pencina and colleagues make a case for third-party enablers, smarter local governance, and shared evidence networks to make health
#AI
safe, scalable, and truly impactful.
jamanetwork.com/journals/jam...
@dukehealth.bsky.social
loading . . .
Bridging the Gap Between Developers and Implementers in Health AI
This Viewpoint describes opportunities for health care organizations to close gaps between the development and implementation of artificial intelligence using third-party enablers for training, adhere...
https://jamanetwork.com/journals/jama-health-forum/fullarticle/2835280
11 months ago
0
3
2
ATTN: Duke faculty, staff, and students: Join
@dukeaievalgov.bsky.social
for a special webinar: 'Shaping the Future of Responsible Health
#AI
'. Learn how Duke is advancing the deployment of trustworthy and responsible AI across the institution. Register:
qrcc.me/swb9tiwh8cw6...
(Duke login required)
loading . . .
Welcome! You are invited to join a meeting: Shaping the Future of Responsible Health AI: Introducing the Duke Health AI Evaluation & Governance Program. After registering, you will receive a confirmat...
Speakers: Michael J. Pencina, PhD, Chief Data Scientist, Duke Health Nicoleta J. Economou-Zavlanos, PhD, Director, Duke Health AI Evaluation & Governance (E&G) Program Sophia Bessias, MPH, MSA, Assist...
https://qrcc.me/swb9tiwh8cw6?s=url
11 months ago
0
1
1
Exciting News!
@dukeaievalgov.bsky.social
Program proudly launches its new website. The Program promotes the safe, fair, and effective use of
#AI
in healthcare, ensuring AI innovations improve patient care ethically. Visit & explore here:
healthaigovernance.duke.edu
1/2
12 months ago
1
1
2
Passionate about making clinical
#AI
safer, fairer, and more effective? The
@dukeaievalgov.bsky.social
Program is looking for an Evaluation Lead to support our flagship ABCDS Oversight initiative. Apply now or share with someone who should:
careers.duke.edu/job-invite/2...
1/2
12 months ago
1
1
0
Thank you to all who joined
@dukeaievalgov.bsky.social
for a compelling seminar with Dr. Michel van Genderen, Associate Professor at Erasmus Medical Center and a thought leader in operationalizing responsible
#AI
, who shared insights from his work in
#trustworthyAI
development across Europe.
12 months ago
2
1
1
reposted by
Duke Health AI Evaluation & Governance Program
Duke Health
about 1 year ago
Duke Health has partnered with Avanade to design, build and implement a Smart AI Governance Engine (SAIGE), a-first-of-its-kind, healthcare-specific AI governance platform that uses Microsoft Azure and Microsoft Fabric applications. 1/6
@dukeaievalgov.bsky.social
1
1
1
Hot off the press 👇
@dukeaievalgov.bsky.social
's Matthew Elmore, Nicoleta Economou, and Michael Pencina have developed a practical heuristic to ensure patients are informed about
#AI
tools in their care. Read here:
www.tandfonline.com/eprint/GWJTP...
loading . . .
A Heuristic for Notifying Patients About AI: From Institutional Declarations to Informed Consent
Published in The American Journal of Bioethics (Vol. 25, No. 3, 2025)
https://www.tandfonline.com/eprint/GWJTPYFU67SYDS82HU3E/full?target=10.1080/15265161.2025.2458422
about 1 year ago
1
1
0
We are hiring! Join the Duke Health AI Evaluation & Governance Program as an Operations Leader and drive the future of
#healthAI
. Lead transformative projects, manage operations, and shape ethical, impactful AI in healthcare. Ready to innovate? Apply now:
careers.duke.edu/job-invite/2...
over 1 year ago
0
1
0
As the year ends, we reflect on our commitment to advancing trustworthy AI for better healthcare. Thank you for supporting safe, fair, and high-quality solutions that prioritize patients. Wishing you a joyful season and a new year filled with health, hope, and progress. — The Duke Health AI E&G Team
over 1 year ago
0
0
0
Congratulations to Nicoleta Economou on being named the Director of
@dukeaievalgov.bsky.social
! In this pivotal role, Dr. Economou will lead efforts to ensure the trustworthy, responsible, and equitable integration of
#AI
in healthcare. Learn more about her impactful work here:
lnkd.in/d2_Tt3gj
over 1 year ago
0
1
0
you reached the end!!
feeds!
log in