this was a retrospective , non - randomized cohort study evaluating the scores of the ipc skills domain of medical interns recruited with an mmi - based selection process and subsequent osces done within their first 4 months of internship . in total 619 internship candidates were interviewed by the internal medicine residency program of the reading health system , a single , independent academic medical center , between september 2011 and february 2014 . during this period , 52 interns matched into the program . as part of an in - training evaluation of all interns , each participated in an ocse 34 months after the start of the program . the study was exempted by the reading hospital institutional review board as a component of an ongoing quality improvement project with review of existing data . the details of the rationale , design , and process of the mmi at our institution have been published in detail elsewhere ( 12 ) . to summarize , the mmi was adapted to consist of five mmi stations to last 10 min each , allowing 2 min for candidates to read the scenarios and 8 min to review their thinking regarding the scenario with an mmi trained interviewer . a traditional 20-min interview with the program director was also conducted to ensure that program- and candidate - specific information could be exchanged . at the end of each mmi station , candidates were rated on two characteristics : 1 ) aggregated ipc skills and 2 ) overall performance . interviewers were also allowed to note any  red flag issues in a free - text commentary field . summative scoring in the mmi process was determined by averaging the scores in each of the five stations to create a final score in each of the two characteristics . the osce in this study was a 10-station standardized clinical experience constructed by faculty of the department of medicine at sidney kimmel medical college at thomas jefferson university to assess interpersonal , communication , and clinical skills . standardized patients were trained to simulate medical histories for purposes of assessing medical interviewing and instructed to record physical examination maneuvers related to their particular simulated complaint . time allotted at each station was 10 min with 5 min between stations . during these 5 min , examinees left the patient stations to record their responses to three general items : 1 ) history of present illness , 2 ) evaluation of the problem , including diagnosis and risk factors , and 3 ) plan for treatment . during this time , the simulated patients completed their performance checklists of 3040 items in each evaluated domain . the faculty case content committee provided a scoring protocol with points allocated for complete and for partially correct answers . scoring of each examination was based on a maximum of 100% in each of four general scoring areas : 1 ) counseling and patient education , 2 ) history - taking , 3 ) physical examination , and 4 ) communication skills . a total score on the whole osce was an average of the four component scores , with a maximum of 100% . the osce communication skills subdomains included clarity of questions , listening skills , professional manner , organization of data collection , giving information , body language , affect , empathy and support , and closing the visit . the osce was given to one quarter of the intern class on four separate occasions , at a centralized testing center . one was done to assess the relationship between the average mmi interpersonal score and the communication score on the osce . the second was done to assess the average mmi overall score and the communication score on the osce . the osce score was used as the independent variable on the x - axis to test the relationship ( association ) , if any , with both the y - axis variables ( mmi interpersonal score and overall ) . the statistical analyses were performed using spss v22.0 ( ibm , armonk , new york , usa ) . the figures were generated by the same software ( figs . 1 and 2 ) . in total 619 internship candidates were interviewed by the internal medicine residency program of the reading health system , a single , independent academic medical center , between september 2011 and february 2014 . during this period , as part of an in - training evaluation of all interns , each participated in an ocse 34 months after the start of the program . the study was exempted by the reading hospital institutional review board as a component of an ongoing quality improvement project with review of existing data . the details of the rationale , design , and process of the mmi at our institution have been published in detail elsewhere ( 12 ) . to summarize , the mmi was adapted to consist of five mmi stations to last 10 min each , allowing 2 min for candidates to read the scenarios and 8 min to review their thinking regarding the scenario with an mmi trained interviewer . a traditional 20-min interview with the program director was also conducted to ensure that program- and candidate - specific information could be exchanged . at the end of each mmi station , candidates were rated on two characteristics : 1 ) aggregated ipc skills and 2 ) overall performance . interviewers were also allowed to note any  red flag issues in a free - text commentary field . summative scoring in the mmi process was determined by averaging the scores in each of the five stations to create a final score in each of the two characteristics . the osce in this study was a 10-station standardized clinical experience constructed by faculty of the department of medicine at sidney kimmel medical college at thomas jefferson university to assess interpersonal , communication , and clinical skills . standardized patients were trained to simulate medical histories for purposes of assessing medical interviewing and instructed to record physical examination maneuvers related to their particular simulated complaint . time allotted at each station was 10 min with 5 min between stations . during these 5 min , examinees left the patient stations to record their responses to three general items : 1 ) history of present illness , 2 ) evaluation of the problem , including diagnosis and risk factors , and 3 ) plan for treatment . during this time , the simulated patients completed their performance checklists of 3040 items in each evaluated domain . the faculty case content committee provided a scoring protocol with points allocated for complete and for partially correct answers . scoring of each examination was based on a maximum of 100% in each of four general scoring areas : 1 ) counseling and patient education , 2 ) history - taking , 3 ) physical examination , and 4 ) communication skills . a total score on the whole osce was an average of the four component scores , with a maximum of 100% . the osce communication skills subdomains included clarity of questions , listening skills , professional manner , organization of data collection , giving information , body language , affect , empathy and support , and closing the visit . the osce was given to one quarter of the intern class on four separate occasions , at a centralized testing center . one was done to assess the relationship between the average mmi interpersonal score and the communication score on the osce . the second was done to assess the average mmi overall score and the communication score on the osce . the osce score was used as the independent variable on the x - axis to test the relationship ( association ) , if any , with both the y - axis variables ( mmi interpersonal score and overall ) . the statistical analyses were performed using spss v22.0 ( ibm , armonk , new york , usa ) . the figures were generated by the same software ( figs . 1 and 2 ) . there was a moderate positive correlation between the average mmi interpersonal score and the communication score on the osce , r=0.384 , n=52 , p=0.005 , and a negligible relationship between the average mmi overall score and the communication score on the osce , r=0.175 , n=52 , p=0.214 . the strong relationship between effective ipc skills and healthcare outcomes has been well established ( 16 , 22 ) . physician communication scores have also been reported to be statistically significant predictors of future complaints to medical regulatory authorities ( 23 ) . health care institutions are being challenged to develop innovative ways of teaching and assessing these critical skills at all levels of medical education ( 2426 ) . the osce has been found to be a reliable tool in assessing communication skills in graduate medical education ( 21 , 27 , 28 ) . the mmi as a recruiting tool was implemented to enhance our assessment of communication and interpersonal skills during interviews . both tests evaluate similar verbal and non - verbal domains of communication that are essential to the practice of medicine . although the correlation we obtained was moderate , the results support the validity of the mmi in assessing the ipc skills of trainees at the time of recruitment for residency training . medical schools and residency programs aim to recruit the most competitive candidates in both domains ( 2931 ) . the united states medical licensing examination step 2 clinical skills investigates similar domains for ipc but provides only a pass or fail score to residency programs ( 32 ) . the mmi provides a numeric score , which allows for more dispersion in evaluating the strength of the interviewees communication skills . the performance of applicants on the mmi factors directly into their position on our national residency matching program rank list and has led to a considerable progression of our recruitment class characteristics . subjective feedback from volunteer faculty has revealed trends toward improved professionalism , observed bedside manner , and communication skills demonstrated by resident physicians since implementing this selection process . one limitation of our study was the lack of access to osce results of trainees recruited prior to implementing the mmi for comparison . this restriction was due to changes in the osce center protocols and station content in the years preceding the implementation . as such , our results can only confirm a positive correlation but can not determine the effect of the mmi on improving performance on the osce between pre - intervention and postintervention cohorts . although evidence for the reliability , validity , and acceptability of the mmi for postgraduate recruitment is growing , data on the predictive validity of the mmi in graduate medical education are sparse ( 1 , 12 ) . however , further research is needed to investigate the predictive validity of the mmi at the postgraduate level . the mmi is a useful tool for residency programs to assess ipc skills prior to matriculation into residency training . the authors have not received any funding or benefits from industry or elsewhere to conduct this study .
objectivethe multiple mini - interview ( mmi ) has been shown to have a positive correlation with early medical school performance , clerkship evaluations , and national licensing examinations . 
 there is limited data on its predictive validity at the postgraduate level.methodssix hundred and nineteen internship candidates were interviewed using the mmi format by the internal medicine residency program of the reading health system , between september 2011 and february 2014 . 
 fifty - two interns were recruited . 
 each intern participated in an objective structured clinical examination ( osce ) 34 months after the start of the program . 
 the osce score of each intern was used as the independent variable to test the relationship with both the mmi interpersonal score and the mmi overall score.resultsthere was a moderate positive correlation between the average mmi interpersonal score and the communication score on the osce , r=0.384 , n=52 , p=0.005 , and a negligible relationship between the average mmi overall score and the communication score on the osce , r=0.175 , n=52 , p=0.214.conclusionthe mmi is a useful tool for residency programs to assess interpersonal and communication skills prior to matriculation into residency training . 
 this study provides evidence for its validity in assessing these competencies .