this study aimed to explore the effect of the international organization for standardization ( iso ) iso 9001 standard and the european foundation for quality management ( efqm ) model on improving hospital performance . in addition , elsevier and springer were searched as main publishers in the field of health sciences . we included empirical studies with any design that had used iso 9001 or the efqm model to improve the quality of healthcare . data were collected and tabulated into a data extraction sheet that was specifically designed for this study . the collected data included authors names , country , year of publication , intervention , improvement aims , setting , length of program , study design , and outcomes . use of the efqm model increased the degree of patient satisfaction and the number of hospital admissions and reduced the average length of stay , the delay on the surgical waiting list , and the number of emergency re - admissions . iso 9001 also increased the degree of patient satisfaction and patient safety , increased cost - effectiveness , improved the hospital admissions process , and reduced the percentage of unscheduled returns to the hospital . generally , there is a lack of robust and high quality empirical evidence regarding the effects of iso 9001 and the efqm model on the quality care provided by and the performance of hospitals . however , the limited evidence shows that iso 9001 and the efqm model might improve hospital performance . many hospital departments have applied a quality management system to improve the efficiency and quality of healthcare services ( 4 , 5 ) . one widespread approach that is used is the framework defined by the international organization for standardization ( iso ) , the iso 9001 standard . iso was founded in 1947 to provide standardization for technical specifications for products traded in the international marketplace . the iso 9001 family of quality management system standards can be applied to any type of organization seeking to improve the quality of the production of its goods or services . this standard represents an international agreement on goods management performance , which helps ensure that employees constantly deliver the product or service that meets the quality requirements of the organization s clients , continuously enhance the organization s performance , and improve client satisfaction ( 6 - 8 ) . another international model that is used to conduct quality improvement processes is the european foundation for quality management ( efqm ) excellence model . this model has been well accepted in the public sector in europe in recent years . five of the criteria refer to  enablers ( leadership , people , policy and strategy , partnership and resources , and processes ) and four of the criteria refer to ' results ( people results , customer results , society results , and key performance results ) ( 10 ) . the efqm excellence model is a valuable tool to help organizations recognize quality management gaps and monitor their improvement . it emphasizes the idea of self - assessment and the detection of strengths and weaknesses using the criteria s guiding principles . this framework is widely used in the industry , as well as in the healthcare sector ( 11 , 12 ) . some of the published studies in those systematic literature reviews have studied the effectiveness of six sigma and lean six sigma ( 13 - 15 ) . other reviews have looked at broader system - wide quality improvement ( qi ) models or collaborations ( 16 ) and have highlighted their context - dependent nature , the degree of overlap between models , and the need for an effective organization - specific implementation method and infrastructures for success ( 17 , 18 ) . others have examined the literature concerning the effectiveness of qi methodologies , such as plan - do - check - act ( pdca ) cycles , statistical process control ( spc ) or statistical quality improvement ( cqi ) , total quality management ( tqm ) , six sigma , and lean six sigma , in improving the quality of care for surgical patients ( 19 ) . we did not find any systematic review about the effect of the iso 9001 standard and the efqm model , which is the subject of this review . the aim of this systematic review was to examine the literature concerning the effects of iso 9001 and the efqm model on improving hospital performance . the pubmed ( 1994 to september 2013 ) , embase through scopus ( 1997 to september 2013 ) , and cochrane library ( issue 3 , 2013 ) databases were searched . in addition , elsevier ( 1996 to september 2013 ) and springer ( 1835 to september 2013 ) were searched as the main publishers in the field of health sciences . the search terms were devised to cover hospital performance improvement as well as the names of and synonyms for iso 9001 or international organization for standardization , efqm or european foundation for quality management . these terms included :   hospital ,   hospital performance ,   quality improvement ,   quality management , and with each of the following terms :   iso 9001 ,   international organization for standardization , we included empirical studies with any design that had used iso 9001 or the efqm model to improve hospital performance . studies that had addressed the use of an intervention , such as iso 9001 or the efqm model , and that had assessed the effect of that intervention on hospital performance over a specific period of time , were included . theoretical studies , editorials , letters , opinions , audits , and reviews were excluded . studies that assessed healthcare professionals perceptions about iso 9001 or the efqm model were excluded from this present study . all the papers that were retrieved from the search strategy were imported into an endnote database . their titles , abstracts and , if necessary , the full texts were then scanned by a reviewer and checked by a second reviewer against the inclusion criteria . the statistical method used for data were collected and tabulated into a data extraction sheet that was specifically designed for this study . the collected data included : authors names , country , year of publication , intervention , improvement aims , setting , length of program , study design , and study outcomes . the quality assessment for non - experimental studies therefore , a combination of available checklists was used to design a list of criteria that was applied to appraise the quality of the included studies ( 20 , 21 ) . the following criteria were used to appraise the quality of the included studies : the adequacy of the description of methods , the appropriateness of the research methods to the study question , the quality of the data collection , the quality of the data analysis , and the quality of the data presentation . a descriptive synthesis of the results was performed giving consideration to the risk of bias and the quality of the studies . the full texts of the 25 studies were checked and seven of them met the inclusion criteria ( figure 1 ) . three studies described the efqm model and four were concerned with iso 9001 ( table 1 ) . moreover , three studies were undertaken in spain , one in the united kingdom ( uk ) , one in germany , one in the netherlands , and one in israel . five studies had a quasi - experimental design ; one study had a survey design and one was an observational study . four articles reported a follow up period greater than two years , and all of the included studies were performed in hospitals ( 22 - 26 ) . sanchez et al . ( 22 ) reported that the patient satisfaction rate increased to 96.2% and 93.1% , respectively , in outpatient clinics and the emergency department with a four - year follow up ; however , the satisfaction rate decreased in inpatients after applying the efqm model . rodriguez - cerrillo et al . ( 25 ) also reported that patient satisfaction increased from 92% in 2008 to 98.8% in 2010 after applying the iso 9001 standard . vitner and colleagues ( 26 ) also reported a service satisfaction improvement ranging between 4.8 and 5 ( based on a scale of 1 to 5 ) in 66% of the items in the patients survey after implementing the iso 9001 standard . sanchez et al . ( 22 ) showed that implementing the efqm guidelines resulted in a reduction in the mean length of hospital stays from 6.1 days in 2000 to 5.9 days in 2003 in acute care hospitals with a four - year follow - up . vallejo and colleagues ( 24 ) also observed a reduction in the mean length of hospital stays from 14.8 in 2003 to 13.8 in 2005 , with a three - year follow up after implementing efqm measures . rodriguez - cerrillo et al . ( 25 ) reported no change in the mean length of hospital stays in a three - year follow up after implementing iso 9001 . sanchez et al . ( 22 ) reported a reduction in the amount of time a patient has to remain on the surgical waiting list ( 22 ) . the average delay decreased from 57.1 days in 2000 to 53.8 days in 2003 after using the efqm model . vallejo and colleagues ( 24 ) found a decrease in the number of medical records that had a delay in reporting from 1 in 2003 to 0 in 2005 after implementing the efqm model . vallejo and colleagues ( 24 ) found that emergency re - admission was reduced from 20 in 2003 to 12 in 2005 , with a three - year follow up , after implementing the efqm model . rodriguez - cerrillo et al . ( 25 ) reported that the percentage of unscheduled returns to the hospital decreased from 7% to 3% after using iso 9001 . vallejo and colleagues ( 24 ) showed that the number of admissions increased from 282 in 2003 to 297 in 2005 , with a three - year follow up , after using the efqm model . vitner and colleagues ( 26 ) stated that the number of admission improved to 78% , 19 months after using iso 9001 . regarding the remaining outcomes , only one study was found for each of those outcomes , and the results of these studies are presented below . rodriguez - cerrillo et al . ( 25 ) reported no medical equipment failures and an improvement in the external suppliers ' performance . they found that , after implementing iso 9001 , 100% of the patients that required oxygen or aerosol therapy had access to the required equipment in their homes by the time they returned from the hospital , while this was not possible two years before . they also showed that , after implementing iso 9001 , in 97% of the cases protocols were followed , six medication - related incidents were detected , and all patient problems requiring an urgent consultation were satisfactorily resolved . ( 23 ) observed that confidence , competence , and retention of newly qualified nurses improved and the number of newly qualified nurses leaving in the first 18 months of their employment was reduced after implementing the efqm model . sanchez et al . ( 22 ) reported that the duration of primary care medical consultations increased from 7.4 min in 2000 to 8.5 min in 2003 , with a four - year follow up . moreover , after using the efqm model , the percentage of patients waiting less than one month for specialized care decreased from 63.1% in 2000 to 61.1% in 2003 , the prevalence of patients admitted with an infection episode declined from 6.7% in 2000 to 6.6% in 2003 , and the percentage of minimally invasive tumors detected in the early detection breast cancer program decreased from 43.3% in 2000 to 40.9% in 2003 . ( 28 ) reported that patient safety increased from 38% in 1998 to 63% in 2001 , and the rate of improvement in the policy and management category was 58% in 2001 . ( 27 ) reported that costs for medical goods decreased by  187.36 from 2001 to 2003 , representing a 6.1% drop ; and , from 2001 to 2002 the total absolute savings in laboratory costs was 35.2% . the 32-day mortality rate for all operations showed a slight increase in 2001 , reaching 4.2% . in 2002 and 2003 , , returns of the questionnaire - based evaluation of satisfaction of cooperating cardiologists continuously increased from 57.1% in 2001 to 65.4% in 2002 and 70.6% in 2003 . the efqm model and the iso 9001 standard are becoming the most recommended methods and guidelines for creating and continuing good quality clinical services ; however , there has been a debate about the advantages and disadvantages of these models ( 29 , 30 ) . this review included studies that assessed the iso 9001 standard and the efqm model in order to consider the evidence from the literature to determine how these quality management guidelines might apply to this field . we searched the main databases and publishers in the field of health sciences and tried to include articles covering the major outcomes in order to test the effectiveness of these models from first principles rather than from simple observations . the result showed that using the efqm model and iso 9001 in hospitals was associated with an improvement in the satisfaction rate of outpatient clinics and emergency departments , a reduction in the mean length of stay in acute care hospitals , reduced delays on the waiting list , a decrease in emergency re - admissions , a reduction in the percentage of unscheduled returns , improvement in confidence , competence , and retention of newly qualified nurses , and a reduction in the number of newly qualified nurses leaving in the first 18 months of their employment . furthermore , the use of these models was also associated with a decrease in the prevalence of patients admitted with an infection episode , a decrease in the occurrence of medical equipment failures ( zero failures ) , an improvement in the external suppliers performance , adherence to protocols in 97% of the cases , the detection of six medication - related incidents , an improvement in admission processes , an increase in patient safety and an improvement in the policy and management rate , a reduction in costs for medical goods and laboratory services , a decrease in 32-day mortality for all operations , and a continuous increase in the return of the questionnaire - based evaluation of satisfaction of cooperating cardiologists . there are a number of limitations when looking for the results of using iso 9001 and the efqm model to assess hospital performance . only a few of the studies met all of the inclusion criteria for each model . most of the studies included hospitals that had utilized these models and reported that they can be effectively used without assessing their results , or they presented a self - assessment instead of specifically setting up and designing studies to test the effectiveness of these models from first principles . many of the quality improvement models require noticeable data collection and staff must be trained in how to implement the model ; most models also require a degree of statistical analysis . obviously , if using these models can result in significant cost savings , there is a good reason to invest in staff training and technology to help support this process . however , without investing in these projects , sufficient evidence is unavailable to suggest sector - wide implementations . five studies had a quasi - experimental design and indicated outcomes before and after applying iso 9001 and the efqm model , so their results are more reliable than the results of studies with a survey design or an observational design . in the observational studies , we could not correlate the progress of the outcomes to use of the quality improvement models . on the other hand , in the survey design studies with a rigorous , low - risk methodology or design are necessary when it comes to reporting results related to the use of these models . randomized controlled trials ( rcts ) are needed or , at least , studies with a non - randomized time series design , in order to truly indicate the important outcomes and potential harms of using these models . we searched the main databases and publishers in the field of health sciences , although this might not guarantee that we have found all the pertinent papers in this field ; this is a limitation of any systematic review . these studies showed that the evidence underlying quality improvement is positive , but limited , and the effects can not be predicted with great certainty , so the results should be interpreted and used with caution . generally , there is a lack of robust and high quality empirical evidence regarding the effect of iso 9001 and the efqm model on the quality and performance of hospitals . however , the limited evidence shows that , to some extent , iso 9001 and the efqm model might improve hospital performance . in addition , no negative evidence was found about the effect of iso 9001 and the efqm model on hospital performance .
context : this study aimed to explore the effect of the international organization for standardization ( iso ) iso 9001 standard and the european foundation for quality management ( efqm ) model on improving hospital performance.evidence acquisition : pubmed , embase and the cochrane library databases were searched . 
 in addition , elsevier and springer were searched as main publishers in the field of health sciences . 
 we included empirical studies with any design that had used iso 9001 or the efqm model to improve the quality of healthcare . 
 data were collected and tabulated into a data extraction sheet that was specifically designed for this study . 
 the collected data included authors names , country , year of publication , intervention , improvement aims , setting , length of program , study design , and outcomes.results:seven out of the 121 studies that were retrieved met the inclusion criteria . 
 three studies assessed the efqm model and four studies assessed the iso 9001 standard . 
 use of the efqm model increased the degree of patient satisfaction and the number of hospital admissions and reduced the average length of stay , the delay on the surgical waiting list , and the number of emergency re - admissions . 
 iso 9001 also increased the degree of patient satisfaction and patient safety , increased cost - effectiveness , improved the hospital admissions process , and reduced the percentage of unscheduled returns to the hospital.conclusions:generally , there is a lack of robust and high quality empirical evidence regarding the effects of iso 9001 and the efqm model on the quality care provided by and the performance of hospitals . 
 however , the limited evidence shows that iso 9001 and the efqm model might improve hospital performance .