What can aptitude tests such as the UK Clinical Aptitude Test ...

What can aptitude tests such as the UK Clinical Aptitude Test ...

What can aptitude tests such as the UK Clinical Aptitude Test (UKCAT) offer undergraduate medical selection? Issues and solutions Dr Sandra Nicholson Issues A Level inflation causing problems with discrimination Image from http://news.bbcimg.co.uk /media/images/48697000/ gif/_48697...

Issues Underrepresentation of some groups in medicine because ?A-level grades reflect educational background and social class Can aptitude tests widen participation? Stringer Principle what applicants might have achieved had similar educational resources been available, without losing sight of what each one has actually achieved Stringer N. Aptitude tests versus school exams as selection tools for higher education and the case for assessing educational achievement in context. Res Papers Educ 2008;23 (1):5368. Issues A systematic review of all the factors of the selection process associated with success at

medical school showed that personal statements and teacher references form a significant component of many medical schools current selection processes have a low predictive value of success contain insufficient detail to be a useful selection tool Ferguson E, James D, Madeley L: Factors associated with success in medical school: systematic review of the literature. BMJ 2002, 324:952-957. Issues Desire to select on non-cognitive or personal attributes (blueprinting) Consensus statement, MSC/GMC highlighted: Decision making, leadership

And if you dont one UK medical school identified10 15% of each intake (over 5 years) as strugglers (Yates & James, BMJ332 (2006) 1009-1013) Doctor distress Willcock et al.,MJA, 181, 2004, 357 -360 Solutions There is an urgent need to reduce the number of candidates by initial screening that is appropriate, fair and transparent but also gives added value to the process Intellectual ability or aptitude rather than achievement may be a valuable means to widen participation Some aptitude tests aim to assess more than intellectual ability assessing some of the

desirable non cognitive characteristics in potential medical students. So, whats the evidence? Fernando N, Prescott G, Cleland J, Greaves K, McKenzie H: A comparison of the United Kingdom Clinical Aptitude Test (UK-CAT) with a traditional admission selection process. Med Teach 2009 Turner and Nicholson, 2011, Can the UK Clinical Aptitude Test (UKCAT) select suitable candidates for interview? Medical Education 2011: 45: 10411047 So, whats the evidence? McManus, I., et al., Intellectual aptitude tests

and A levels for selecting UK school leaver entrants for medical school. BMJ, 2005. 331: p. 555-559. McManus, I., et al., A levels and intelligence as predictors of medical careers in UK doctors: 20 year prospective study. BMJ, 2003. 327: p. 139142. Outcome of students in relation to A level grades in all subjects are based on best three. A=10, B=8, C=6, D=4, and E=2 points Performance of third year UCL medical students in MCQ and OSCE assessments by top three A level points.

However is the field the same? Significance of A level inflation? Characteristics of newer aptitude tests? McManus I, Woolf K, Dacre J: Even one star at A level could be "too little, too late" for medical student selection. BMC Medical Education 2008, 8:16. So, whats the evidence? BMAT has shown predictive validity between test scores and medical school progression Emery JL, Bell JF. 2009. The predictive validity of the BioMedical Admissions Test

for pre-clinical examination performance. Med Educ 43:557654 For GAMSAT a significant correlation with Year 2 examination results only for the biological and physical sciences section assessing achievement, and not for the sections assessing more general skills in problem solving, critical thinking and writing Groves MA, Gordon J, Ryan G. Entry tests for graduate medical programs: is it time to rethink? Med J Aust 2007; 186: 120-123 UKCAT initially disappointing but small scale studies measuring possibly incomplete outcomes

Lynch B, MacKenzie R, Dowell J, Cleland J, Prescott G: Does the UKCAT predict year 1 performance in medical school? Med Educ 2009, 43:1203-1209 Janet Yates and David James (2010) The value of the UK Clinical Aptitude Test in predicting pre-clinical performance: a prospective cohort study at Nottingham Medical School. BMC Medical Education 2010 So, whats the evidence? Wright and Bradley, 2010, Has the UK Clinical Aptitude Test improved medical student selection? Med Education, Nov;44(11) Preliminary results from an additional medical school confirm that UKCAT scores can predict

performance in 1st and 2nd year exams. Abstract Reasoning is the single best predictor of Year 1 examination Decision Analysis is the single best predictor of Year 2 examination performance Verbal Reasoning also being a useful predictor (Adam et al, submitted for publication). James D, Yates J, Nicholson S: Comparison of A level and UKCAT performance in students applying to UK medical and dental schools in 2006: cohort study. BMJ 2010

that previous school type did not predict the UKCAT scores of their accepted students at their university. UKCAT scores were predictive of Year 1 and 2 examination performance including significant predictors of knowledge examination performance Concerns over no benefit in increasing participation although also showed that UKCAT scores were less subject to bias than A level results alone Non-cognitive qualities have been shown to predict professional behaviour in medical students and medical school assessment outcomes (if appropriately structured) (Adam et al., submitted for publication) Non-cognitive test have satisfactory reliability and scores have been shown to be unaffected by social class, gender and ethnicity (Wu, 2009). Selection encapsulates most of the important questions that medical education faces. The

problems are not insoluble, and the intellectual tools mostly exist. The problem is in finding the collaborative will to solve them, and to confront negative answers if and when they arise Testing medical school selection tests Chris McManus and David Powis MJA 2007; 186 (3): 118119

Recently Viewed Presentations

  • Humble ISD District Testing Coordinator

    Humble ISD District Testing Coordinator

    STAAR, STAAR-M, STAAR-L. This PowerPoint does not eliminate your requirement to read and understand the Test Administrator Manuals. READ THE MANUALS!! ... The testing materials should then be returned so that the student may record his or her answers.
  • couts complets - Weebly

    couts complets - Weebly

    * Solution * Évaluation des en-cours Évaluation détaillée : dans l'atelier, faire l'inventaire de ce qu'ont coûté effectivement les en-cours Processus long et fastidieux Évaluation forfaitaire : raisonner en équivalent produits terminés: Pour les matières 1ère : un en-cours consomme...
  • MATS Report on CCLV Activities

    MATS Report on CCLV Activities

    CCLV Conference for teachers of homiletics . June 24-25, 2013. at Notre Dame. no cost for registration. ... Glossary: Definition of Terms. Handbook on Seminary Admissions. First chapter on the use of psychology in the admissions process under review.
  • Sunsetting Lamar - Colorado State University

    Sunsetting Lamar - Colorado State University

    Email Scenario 2: Lamar email user. ACNS will migrate email to Office 365. ACNSmail address book will not be migrated. Will publish instructions for users to manually export and import contacts
  • EE-214/2011 Neurnio -1 .25 x1 .5 x2 x3

    EE-214/2011 Neurnio -1 .25 x1 .5 x2 x3

    A V W TAC MOT J,B BAT I mot W,t EE-214/2011 Agrupamento e Classificação A tarefa de classificação de padrões é atribuir a das classes pré-especificadas um objeto ou dado (como forma de onda vocal ou símbolo manuscrito) representado por...
  • US declares war on Japan Isolationism Lend-lease Act

    US declares war on Japan Isolationism Lend-lease Act

    5. Germany invades Poland (1939) 6. Germany Conquers France (1940) Battle of Britain(1940) Tripartite Pact (1940)- Germany/Italy/Japan will defend each other if attacked 1. Isolationism Japan Invades Manchuria (1931) 3. Japan Invades China (1937) 7. Japan Invades SE Asia -...
  • Land Pollution - University of Maryland College of Computer ...

    Land Pollution - University of Maryland College of Computer ...

    Land pollution indirectly affects the respiratory system of human beings Can incur breathing problems and a number of diseases, which may affect the health of babies as well. Breathing in polluted dust or particle can result in a number of...
  • MinecraftEdu Program: Train Stations Setup Explore Your World

    MinecraftEdu Program: Train Stations Setup Explore Your World

    Minecraft is a popular world building video game that enables its user to build, collaborate and innovate using virtual building blocks. MinecraftEdu is a version of Minecraft that allows educators and library staff to easily set up local Minecraft games...