When you enroll in this course, you'll also be enrolled in this Specialization.
Learn new concepts from industry experts
Gain a foundational understanding of a subject or tool
Develop job-relevant skills with hands-on projects
Earn a shareable career certificate
There are 4 modules in this course
Machine learning systems used in Clinical Decision Support Systems (CDSS) require further external validation, calibration analysis, assessment of bias and fairness. In this course, the main concepts of machine learning evaluation adopted in CDSS will be explained. Furthermore, decision curve analysis along with human-centred CDSS that need to be explainable will be discussed. Finally, privacy concerns of deep learning models and potential adversarial attacks will be presented along with the vision for a new generation of explainable and privacy-preserved CDSS.
Adopting a machine learning model in a Clinical Decision Support System (CDSS) requires several steps that involve external validation, bias assessment and calibration, 'fairness' assessment, clinical usefulness, ability to explain the model's decision and privacy-aware machine learning models. In this module, we are going to discuss these concepts and provide several examples from state-of-the-art research in the area. External validation and bias assessment have become the norm in clinical prediction models. Further work is required to assess and adopt deep learning models under these conditions. On the other hand, research in 'fairness', human-centred CDSS and privacy concerns of machine learning models are areas of active research. The first week is going to cover the ground around the difference between reproducibility and generalisability. Furthermore, calibration assessment in clinical prediction models will be explored while how different deep learning architectures affect calibration will be discussed.
What's included
4 videos3 readings1 assignment1 discussion prompt
Show info about module content
4 videos•Total 52 minutes
Welcome: From machine learning models to clinical decision support systems•1 minute
From Reproducibility to Generalisability•18 minutes
A Guide to Model Validation in Clinical Decision Support Systems•18 minutes
Calibration of Deep Learning Models•15 minutes
3 readings•Total 30 minutes
An ABCD guide for prediction model validation in clinical settings•10 minutes
Calibration: the Achilles heel of predictive analytics•10 minutes
Bias assessment in Deep Learning Models•10 minutes
1 assignment•Total 30 minutes
End of week 1 Quiz•30 minutes
1 discussion prompt•Total 10 minutes
Week 1 - Your experience•10 minutes
'Fairness' in Machine Learning Models
Module 2•2 hours to complete
Module details
Naively, machine learning can be thought as a way to come to decisions that are free from prejudice and social biases. However, recent evidence show how machine learning models learn from biases in historic data and reproduce unfair decisions in similar ways. Detecting biases against subgroups in machine learning models is challenging also due to the fact that these models have not been designed or trained to discriminate deliberately. Defining 'fairness' metrics and investigating ways in ensuring that minority groups are not disadvantaged from machine learning models' decisions is an active research area.
What's included
3 videos3 readings1 assignment1 discussion prompt
Show info about module content
3 videos•Total 48 minutes
Assessment of the Risk of Bias in EHR•15 minutes
Fairness in Machine Learning for Healthcare Applications (Part 1)•17 minutes
Fairness in Machine Learning for Healthcare Applications (Part 2)•16 minutes
3 readings•Total 30 minutes
PROBAST: A Tool to Assess the Risk of Bias•10 minutes
Big Data's Disparate Impact•10 minutes
Ensuring Fairness in Machine Learning to Advance Health Equity•10 minutes
1 assignment•Total 30 minutes
End of week 2 Quiz•30 minutes
1 discussion prompt•Total 10 minutes
Week 2 - Your experience•10 minutes
Decision Curve Analysis and Human-Centered CDSS
Module 3•2 hours to complete
Module details
Decision curve analysis is used to assess clinical usefulness of a prediction model by estimating the net benefit with is a trade-off of the precision and accuracy of the model. Based on this approach the strategy of ‘intervention for all’ and ‘intervention for none’ is compared to the model’s net benefit. Decision curve analysis is a human-centred approach of assessing clinical usefulness, since it requires experts’ opinion. Ethical Artificial Intelligence initiative indicate that a human-centred approach in clinical decision support systems is required to enable accountability, safety and oversight while the ensure ‘fairness’ and transparency.
What's included
3 videos3 readings1 assignment1 discussion prompt
Show info about module content
3 videos•Total 39 minutes
Decision Curve Analysis•17 minutes
Human-Centered Clinical Decision Support Systems•15 minutes
Evaluation of Explainability Models•7 minutes
3 readings•Total 30 minutes
A Guide to Interpreting Decision Curve Analysis•10 minutes
A Roadmap Toward Transparent Expert Companions•10 minutes
The role of explainability in creating trustworthy artificial intelligence for health care•10 minutes
1 assignment•Total 30 minutes
End of week 3 Quiz•30 minutes
1 discussion prompt•Total 10 minutes
Week 3 - Your experience•10 minutes
Privacy Concerns in CDSS
Module 4•2 hours to complete
Module details
Deep learning models have remarkable ability to memorise data even when they do not overfit. In other words, the models themselves can expose information about the patients that compromise their privacy. This can results in unintentional data leakage in inference and also provide opportunities for malicious attacks. We will overview common privacy attacks and defences against them. Finally, we will discuss adversarial attacks against deep learning explanations.
The University of Glasgow has been changing the world since 1451. It is a world top 100 university (THE, QS) with one of the largest research bases in the UK.
We are a member of the prestigious Russell Group of leading UK Universities with annual research income of more than £179m.
The University’s #TeamUofG community is truly international with over 8000 staff and 28,0000 students from more than 140 countries.
A 2019 Time Out survey placed Glasgow in the top ten cities in the world. Ranked between Berlin and Paris, Glasgow was voted number one for both friendliness and affordability.
Right now our dedicated community of staff, students and alumni is working to address the challenges of Covid-19 and understand how we can make life safer for everyone.
When will I have access to the lectures and assignments?
To access the course materials, assignments and to earn a Certificate, you will need to purchase the Certificate experience when you enroll in a course. You can try a Free Trial instead, or apply for Financial Aid. The course may offer 'Full Course, No Certificate' instead. This option lets you see all course materials, submit required assessments, and get a final grade. This also means that you will not be able to purchase a Certificate experience.
What will I get if I subscribe to this Specialization?
When you enroll in the course, you get access to all of the courses in the Specialization, and you earn a certificate when you complete the work. Your electronic Certificate will be added to your Accomplishments page - from there, you can print your Certificate or add it to your LinkedIn profile.
Is financial aid available?
Yes. In select learning programs, you can apply for financial aid or a scholarship if you can’t afford the enrollment fee. If fin aid or scholarship is available for your learning program selection, you’ll find a link to apply on the description page.