the use of information systems in healthcare - with applications like medical records , order entry , guidelines and other types of decision support , medical knowledge provision and imaging - is steadily increasing . these information systems are usually implemented and maintained by technically orientated personnel ( with a computer science background ) having limited insight in the problems of medical practice . health informaticians are not only educated to carry out research in health informatics , because of their education they are also able to function as intermediaries between the technical personnel on the one side and physicians and nurses on the other . in addition they can be support the medical staff in defining the requirements for new applications and can also be involved in the design and development of systems . also musen distinguishes between computer science and health informatics : ' ( health ) informatics is not the application of computer science , image processing , and statistics to a particular domain . rather , ( health ) informatics is a primary field of study that may be targeted toward a wide variety of disciplines ( health care and the life sciences being particularly important ) . what sets informatics apart from computer science and from other potentially confluent fields is a matter of priorities : ours is the discipline that cares about the content ' . there is an increasing need for health informaticians   and an increasing number of health informatics programs deliver graduates with different kinds of expertise . the recommendations on education in biomedical and health informatics   of the international medical informatics association ( imia ) define the knowledge and skills necessary for creating different types of health informaticians . educational institutions use these recommendations when defining the contents of their health informatics curricula . in doing so , they also have to take the needs of the labor market into account in order to endow students with employable skill sets . because of the growing internationalization of education - as is apparent from the increasing cross - border student and professional mobility , especially in europe , but also elsewhere - the quality of a higher education institution affects its international status and therefore its attractiveness for students . quality has become so important that the ranking of educational institutions has become a huge business . universities , for example , are assessed and ranked in the times higher education world university rankings , powered by thomson reuter . it is stated that 13 carefully calibrated performance indicators are used to compare the universities . most countries now have a national quality assurance system , but these systems are still diverse and of uneven quality . current practices regarding quality assurance in tertiary education in the organisation for economic co - operation and development ( oecd ) countries have been discussed by kis . for the educational sector quality can among others be defined in terms of fitness for purpose . fitness for purpose relates the output of the program to its purpose as defined by a provider . however , only in some countries the national framework for quality assurance takes the level of international higher education into account when evaluating programs . this may affect the status of an institution negatively . in the united states , private educational associations - recognized by the united states government - determine and regulate the educational standards of american universities . the commission on accreditation for health informatics and information management education ( cahiim ) is such an accrediting organization whose mission is to serve the public interest by establishing and enforcing quality accreditation standards for health informatics and health information management educational programs . initially they focussed on accrediting health information management programs but in 2010 they also defined accreditation standards for health informatics master programs . there are now discussions going on between the american medical informatics association ( amia ) and cahiim about amia 's participation in accrediting health informatics master degree programs . therefore institutions may invite international experts to evaluate their programs in order to establish a positive international status . this can become a costly business since usually not only the travel and accommodation costs for the experts have to be paid but also they have to be remunerated . if more institutions are interested in an international evaluation of their health informatics programs , imia can serve as accreditation agency . the accreditation process can be less costly when experts from member countries of imia agree to carry out the peer review for free ( expecting only remuneration of travelling expenses and accommodation ) . to the knowledge of the authors there are no other existing accreditation agencies focussing on health informatics higher education than the imia international accreditation and the national accreditation by cahiim and amia . on the basis of the assumption that more institutions are interested in an assessment of their programs at an international level , a proposal to start with imia accreditation the imia general assembly accepted a proposal to test out the accreditation procedure in a trial phase in which about five institutions , spread over the imia regions , would volunteer to participate . the imia accreditation is an addition to national accreditation and does not replace it . in this contribution we first explain the general pattern of how accreditation is carried out in various countries . quality review can be carried out by an institution itself or via an external quality assurance agency . but also in the latter case quality assurance should be a continuous and ongoing process in educational institutions . the advantage of external quality review is that it assures external stakeholders such as employers , professional bodies , students and the general public of the quality of an educational program or educational institution . the focus is on the way the institution has organized the internal quality assurance system . there are several approaches to external quality review : accreditation , assessment , and audit . all aspects of a program such as whether the curriculum is an adequate realization of the intended end qualifications , the quality and quantity of the staff , available facilities , study load , student satisfaction , the student drop - out rate , and the average time of study are assessed . usually accreditation is either conferred or denied . whereas accreditation evaluates the quality against a minimum standard , assessment evaluates the output of an institution or program , resulting in a more graded judgment of the quality of a program . audit focuses on the quality procedures adopted by an institution and not so much directly on the quality of teaching and learning . the accreditation procedures of different countries show a lot of commonalities . the quality assurance agency must indicate which topics will be assessed and which criteria will be used . every institution therefore knows what aspects of the program will be reviewed and how they are evaluated . the peer reviewers usually are experts in the field that is covered by the program . the self - assessment report provides the basic information needed by the peer review team to evaluate the assessment criteria . the peer review usually comprises a site visit that may take from one to four days . during the site visit the peer review team ( called site visit committee in the imia accreditation documentation ) consults with the various stakeholders , ranging from the rector and dean to staff , student and alumni representatives , to employers of the graduates of the reviewed programme or institution . the site visit committee may during the site visit ask for more information when needed . after the site visit the committee prepares a report containing an evaluation of the program ( using the earlier mentioned topics and corresponding criteria ) and the final judgment . the judgment concerning each facet has to be motivated and references have to be made to the self - assessment report . the institution or program can correct factual errors if they are present in the report . in the proposal for initiating imia accreditation a number of decisions with respect to the accreditation procedure were laid down . in the first place it was decided to define quality as fitness for purpose . since the programs to be accredited can focus on different topics at various levels and can have different orientations ( academic programs , vocational programs , phd programs ) , the quality of such diverse programs can only be adequately assessed by comparing the described goals of the program ( purpose ) with how these goals are implemented in the curriculum ( fitness for purpose ) . of course also the goals themselves should be assessed : is there a need for graduates with the qualifications expressed in the goals ? this means that a review team will check whether the program meets a certain minimum international standard . this minimum standard can be partly derived from the imia recommendations on education in biomedical and health informatics . a third decision made was that the program 's reviewers should be peers : experts having experience in biomedical and health informatics education and research . the accreditation procedure used in the netherlands and belgium for academic programs was taken as a template for designing the imia accreditation procedure . institutions interested in accreditation have to write a self - assessment report that in addition to a site visit will provide the members of the site visit committee enough information to assess the program . in the self - assessment report in the first place it is asked what the goals of the program are for which the institute asks accreditation and how the goals are implemented in a curriculum . the next questions focus on the resources : what is the size and quality of the staff and which facilities for teaching are available ? a fifth question is about quality assurance : how does the institute guarantee the quality of the program ? each of the above six questions concerns a specific subject : goals of the program , contents of the educational program , staff , facilities , quality assurance , and results . the subjects are subdivided in a varying number of so - called facets . in total 16 facets the members of the site visit committee receive a checklist starting with a summary page for copying the judgements of the facets and subjects that the members record in the following pages ( table 1 ) . the checklist is filled in by each reviewer independently during the visit . in table 1 , the names of the subjects and their facets are presented . in the third column the score of each facet is entered ( e means excellent , g means good , s sufficient , and is insufficient ) . the last column contains the score of each subject ( s is sufficient and is insufficient ) . there is also an explanation what these scores mean ( not shown in the table ) . excellent for example means : " best practice " , can serve as an example for other programs . for each facet it is also indicated which topics the reviewers have to take into account when assessing that facet ( figure 1 ) . figure 1 shows the first part of the checklist located after the summary page . in figure 1 , the name of the first ( and only ) facet ( domain specific requirements ) of the first subject ( goals of the program ) is shown . there is space for specifying the judgement of the facet and the score of the first subject ( since the first subject only has one facet ) , the judgement of the first subject is easily deduced from the judgment of the facet . for a full discussion of the subjects and facets the reader is referred to mantas . each subject is given the score sufficient or insufficient , based on a weighted judgement of the related facets . subsequently the quality of the entire program is determined : the quality is positive if all subjects are judged sufficient , else the quality is negative . only positively evaluated programs will be conferred imia accreditation . to ease the work of the site visit committee , the program management delivers a document ( called the self - assessment report ) , containing a critical reflection about the program . the six subjects mentioned above should be described in sufficient detail so that it is possible for the site visit committee members to evaluate the 16 facets of the accreditation review framework . the report should present the program in such a way that teachers and students recognize and agree with its content . the critical reflection is pre - eminently a means to let teachers , students and the members of the site visit committee discuss the quality of the program . supporting evidence ( like books and other study material ) has to be available during the site visit for possible inspection . the program has to provide - in addition to the self - assessment report - a limited number of additional documents . it is assumed that the information for these documents is readily available within the program . how the self - assessment report should be structured , which additional documents should be added to the self - assessment report and which documents should be available at the site is mentioned in the imia accreditation procedure document that is sent to the institution that asks for accreditation . in this report also the review framework is described . the framework offers the possibility not only to discuss the results of the past but also the ambitions for the future . what are the choices for the future , in which direction will the program develop ? the plans for the future therefore should also be mentioned at the end of the document . an institution that wants a health informatics program to be evaluated has to contact imia . the chairman of the accreditation committee ( during the trial period this committee only consisted of the vice - president ( vp ) special affairs ) receives the request and sends the imia accreditation procedure document to the institution . as explained above this document contains all information needed by the institution to start the process . the requested documents have to be in the possession of the chairman of the accreditation committee one and a half month before the site visit takes place . after sending the imia accreditation procedure document it has to be decided which experts will become member of the site visit committee . these members can be suggested by the institution or by the accreditation committee chairman . in both cases the other party has to agree about the composition of the site visit committee . the committee consists of three senior members and the committee as a whole should have at its disposal expertise with respect to the scientific developments in the field of study , international expertise , expertise with teaching and with the development of education at the level concerned , familiarity with the way the education is delivered ( distance education , workplace related education , flexible education , traditional education , etc . ) and audit expertise . finally the chairman of the accreditation committee and the institution settle a date for the site visit . the chairman of the site visit committee writes a concept accreditation report after the site visit . the report contains the motivated judgements about the subjects of the review framework . in the report the judgements are corroborated by references to the self - assessment report , the discussions with the representatives of the program and data from the material that could be inspected during the site visit . possible actions for improvement are presented in a separate section of the report . in addition the report contains the scores of the judgements of the subjects and criteria , information about the date of the site visit , the names of the discussion partners , basic data about the program , and an overview of the studied material . the report is sent to the accreditation committee of imia after all site visit committee members have agreed with the content . the accreditation committee receives the report from the site visit committee within six weeks after the site visit . the accreditation committee will check whether in the report all subjects have been covered , discussed and assessed and then will send the report to the requesting institution within two weeks after the receipt of the report from the site visit committee . the institution can suggest corrections in case of factual errors and provide relevant additional information within a period of two weeks . after the corrections have been made by the site visit committee , the accreditation committee decides whether the program will be accredited . if the judgment is positive the program can use the label ' accredited by the international medical informatics association ' . to ease the work of the site visit committee , the program management delivers a document ( called the self - assessment report ) , containing a critical reflection about the program . the six subjects mentioned above should be described in sufficient detail so that it is possible for the site visit committee members to evaluate the 16 facets of the accreditation review framework . the report should present the program in such a way that teachers and students recognize and agree with its content . the critical reflection is pre - eminently a means to let teachers , students and the members of the site visit committee discuss the quality of the program . supporting evidence ( like books and other study material ) has to be available during the site visit for possible inspection . the program has to provide - in addition to the self - assessment report - a limited number of additional documents . it is assumed that the information for these documents is readily available within the program . table 2 presents the needed documents . how the self - assessment report should be structured , which additional documents should be added to the self - assessment report and which documents should be available at the site is mentioned in the imia accreditation procedure document that is sent to the institution that asks for accreditation . in this report also the review framework is described . the framework offers the possibility not only to discuss the results of the past but also the ambitions for the future . what are the choices for the future , in which direction will the program develop ? the plans for the future therefore should also be mentioned at the end of the document . an institution that wants a health informatics program to be evaluated has to contact imia . the chairman of the accreditation committee ( during the trial period this committee only consisted of the vice - president ( vp ) special affairs ) receives the request and sends the imia accreditation procedure document to the institution . as explained above this document contains all information needed by the institution to start the process . the requested documents have to be in the possession of the chairman of the accreditation committee one and a half month before the site visit takes place . after sending the imia accreditation procedure document it has to be decided which experts will become member of the site visit committee . these members can be suggested by the institution or by the accreditation committee chairman . in both cases the other party has to agree about the composition of the site visit committee . the committee consists of three senior members and the committee as a whole should have at its disposal expertise with respect to the scientific developments in the field of study , international expertise , expertise with teaching and with the development of education at the level concerned , familiarity with the way the education is delivered ( distance education , workplace related education , flexible education , traditional education , etc . ) and audit expertise . this person should have experience with leading a site visit committee . finally the chairman of the accreditation committee and the institution settle a date for the site visit . the chairman of the site visit committee writes a concept accreditation report after the site visit . the report contains the motivated judgements about the subjects of the review framework . in the report the judgements are corroborated by references to the self - assessment report , the discussions with the representatives of the program and data from the material that could be inspected during the site visit . in addition the report contains the scores of the judgements of the subjects and criteria , information about the date of the site visit , the names of the discussion partners , basic data about the program , and an overview of the studied material . the report is sent to the accreditation committee of imia after all site visit committee members have agreed with the content . the accreditation committee receives the report from the site visit committee within six weeks after the site visit . the accreditation committee will check whether in the report all subjects have been covered , discussed and assessed and then will send the report to the requesting institution within two weeks after the receipt of the report from the site visit committee . the institution can suggest corrections in case of factual errors and provide relevant additional information within a period of two weeks . after the corrections have been made by the site visit committee if the judgment is positive the program can use the label ' accredited by the international medical informatics association ' . the institution can apply again for accreditation after they have corrected identified shortcomings . depending on the circumstances since the imia accreditation procedure was derived using a framework that was only used in the netherlands and belgium it was considered wise to test the procedure on programs established in various countries spread over the globe . only in this way it can be checked whether the procedure works well for programs of different levels and orientations and in different cultural environments . in 2012 three programs were evaluated and accredited : 1 ) the health and human services informatics master 's degree program , university of eastern finland , kuopio , finland 2 ) the biomedical informatics technologist educational program , duocuc school of health , santiago , chile ( non - academic , vocational , technical level ) 3 ) the health informatics bachelor 's degree program and the health informatics master 's degree program , georg - august - universitt , gttingen , germany in 2013 another three programs will be assessed . we mention an example of a change in the documentation that was necessary for theses written in the national language . to demand that the program should translate the theses into english was not considered a good idea : it is too time consuming or costly for the program . however , it appeared that the thesis summaries not always provided enough information to get a sufficient impression of the quality and content of the theses when reading them before the site visit . it was decided that in the future a translation of the table of contents should also be provided . of course individual theses ( examples of the ones with the highest and the lowest marks ) were extensively discussed with the faculty who translated relevant pieces of the theses on the spot . another example is an organizational change . during the trial period the vp special affairs ( a.h . ) designed the accreditation protocol and was chairman of the site visit committees . during the last general assembly of imia it was decided to establish an accreditation committee within the board of imia ( as already described in the accreditation protocol ) . this committee among others will appoint the members of the site visit committee and the site visit committee will report to this committee . until now also all administrative contacts of the institution with imia and vice versa are via the accreditation committee . in an earlier article   we presented the impressions of the health and human services informatics program . this two - year master 's degree program at the university of eastern finland was the first program that was accredited . their objectives for being accredited were among others to provide to their students and alumni knowledge about their status among health informatics programs internationally , in case they were willing to continue their studies abroad . also , it was their wish to make the program more visible locally , nationally and internationally . according to the program the self - assessment report model was very well structured and the instructions in the accreditation protocol were clear . they stated that it was very rewarding to analyze the statistics although they noticed that the university 's administrative information systems were not producing data they needed and they had to create new manual files as well . it is our impression that also the other two institutions that were accredited were positive about the procedure . during the trial period until now imia has already accumulated substantial experience regarding the process and ways of improving it . the different levels and orientations of the programs , the variety of cultures encountered , and the differences in implementation and infrastructural possibilities provided enough material for us to generalize and refine the accreditation procedure to facilitate its routine use in the future . the common characteristics of all visits , for which we were grateful , were the willingness of the volunteering institutions to assume the costs and time commitment for accreditation , the overwhelming preparation and enthusiasm to participate shown at all levels of their hierarchy , and the acceptance of the final judgment of the committee , which included a number of recommendations . an accreditation review committee consisting of three independent imia board members evaluated the first three accreditation reports . the committee came to the conclusion that the site visit committees have carefully studied the respective programs , that they documented their reviews and recommendations extensively and well - written in their reports , and that the imia accreditation review committee fully supported all three recommendations . in addition it was stressed that in case of reaccreditation the actions for improvement , as expressed in the accreditation report , should have been put into practice . imia accreditation can be useful for institutions to show to potential students , be they national or international , that their program in health informatics is of an international level . this was indeed confirmed by the management of the first accredited program . the accreditation protocol , based on the framework used in the netherlands and belgium , proved to be usable also in other countries . the protocol appeared to be clearly written so that it was clear for the management of the programs how to write the self - assessment report . the first three site visits were carried out in 2012 and another three will be carried out in 2013 . the programs all volunteered . the first three accreditation reports were evaluated by an independent committee of the imia board . the accreditation procedure in general worked well and only a few changes had to be made . to our knowledge imia is the only accreditation agency for health informatics programs in the world . as stated before , the imia accreditation does not replace the national accreditation , it is an addition . in the united states , amia is considering cooperating with cahiim for accrediting master degree programs in health informatics . imia accreditation will not be useful for all programs and the national accreditation will suffice for them . however , when a program wants to attract the best national students or also wants to attract foreign students , being accredited by an international organization is very important . but not only for attracting the best students accreditation is helpful , programs may also volunteer for accreditation because they want to show the management of their faculty or their university that the program has a status comparable to well - known international programs . the imia accreditation protocol proved to be easily comprehensible and the self - assessment reports we have obtained until now ( five ) were in accordance with the specifications mentioned in the protocol . the accreditation framework developed in the netherlands and belgium for arbitrary academic programs appears to be transferable to health informatics programs both at the academic and vocational level .
objectiveshealth informatics programs usually are evaluated by national accreditation committees 
 . not always are the members of these committees well informed about the international level of ( education in ) health informatics . 
 therefore , when a program is accredited by a national accreditation committee , this does not always mean that the program is of an international level . 
 the international medical informatics association ( imia ) has expertise in the field of education . 
 the imia recommendations on education in biomedical and health informatics guide curricula development . 
 the goal of this article is to show that imia can also play the role of accreditation agency and to present the imia accreditation protocol and experiences obtained with it.methodsthe accreditation procedure used in the netherlands and belgium was taken as a template for the design of the imia accreditation protocol . in a trial period of one and a half year the protocol is tested out on six health informatics programs.resultsan accreditation protocol was designed . for judging the curriculum of a program 
 the imia recommendations are used . 
 the institution has to write a self - assessment report and a site visit committee visits the program and judges its quality , supported by the self - assessment report and discussions with all stakeholders of the program.conclusionsafter having visited three programs it appears that the imia accreditation procedure works well . 
 only a few changes had to be introduced . 
 writing the self - assessment report already appears to be beneficial for the management of the program to obtain a better insight in the quality of their program .