Getting research into policy -Herpes simplex virus type-2 (HSV-2) treatment and HIV infection: international guidelines formulation and the case of Ghana
May, 2009

H Burris
J Parkhurst
Y Adu-Sarkodie
P Mayaud
Getting research into policy -Herpes simplex virus type-2 (HSV-2) treatment and HIV infection: international guidelines formulation and the case of Ghana
May, 2009R E S E A R C H Open Access From Strengthening the research to policy and practice interface: Exploring strategies used by research organisations working on Sexual and Reproductive Health and HIV and AIDS Liverpool, UK. 18-19
Background: Observational epidemiological and biological data indicate clear synergies between Herpes simplex virus type 2 (HSV-2) and HIV, whereby HSV-2 enhances the potential for HIV acquisition or transmission. In 2001, the World Health Organization (WHO) launched a call for research into the possibilities of disrupting this cofactor effect through the use of antiherpetic therapy. A WHO Expert Meeting was convened in 2008 to review the research results. The results of the trials were mostly inconclusive or showed no impact. However, the WHO syndromic management treatment guidelines were modified to include acyclovir as first line therapy to treat genital ulcer disease on the basis of the high prevalence of HSV-2 in most settings, impact and cost-benefit of treatment on ulcer healing and quality of life among patients.Methods: This paper examines the process through which the evidence related to HIV-HSV-2 interactions influenced policy at the international level and then the mechanism of international to national policy transfer, with Ghana as a case study. To better understand the context within which national policy change occurs, special attention was paid to the relationships between researchers and policy-makers as integral to the process of getting evidence into policy. Data from this study were then collected through interviews conducted with researchers, program managers and policy-makers working in sexual health/STI at the 2008 WHO Expert Meeting in Montreux, Switzerland, and in Accra, Ghana.Results:The major findings of this study indicate that investigations into HSV-2 as a cofactor of HIV generated the political will necessary to reform HSV-2 treatment policy. Playing a pivotal role at both the international level and within the Ghanaian policy context were 'policy networks' formed either formally (WHO) or informally (Ghana) around an issue area. These networks of professionals serve as the primary conduit of information between researchers and policy-makers. Donor influence was cited as the single strongest impetus and impediment to policy change nationally.Conclusions: Policy networks may serve as the primary driving force of change in both international context and in the case of Ghana. Communication among researchers and policy-makers is critical for uptake of evidence and opportunities may exist to formalize policy networks and engage donors in a productive and ethical way. of the supplement are available online at http://www.health-policy-systems. com/supplements/9/S1.

Background

The process by which evidence generated from research is incorporated into policy (at both national and international levels) and practice is not always well understood, particularly in low income countries. While the dominant discourse in public health calls for evidence based policy -where evidence stands above local interests [1,2] numerous policy analysis based models emphasize the importance of local context in shaping policy change or the uptake of evidence itself [3,4]. The overall purpose of this study was to evaluate the process of incorporating evidence from international or national research into both international and national policies/ guidelines, in order to tease out the critical elements that determine likelihood of research uptake in these two international and national contexts respectively. This study focuses on case studies of incorporating management of herpes simplex virus type-2 (HSV-2) into genital ulcer disease (GUD) treatment guidelines at the World Health Organization (WHO, international level) and in Ghana (national level).

HSV-2 and HIV synergies

Sexual acquisition of infection with HSV-2 (and sometimes HSV type-1) causes genital herpes, a chronic, lifelong disease, which manifests itself by recurrent ulcer episodes and frequent viral shedding on genital mucosal surfaces. HSV-2 is one of the most common sexually transmitted infections (STI) worldwide [5][6][7]. A number of clinical, epidemiological and biological studies have shown that HSV-2 is strongly associated with increased rates of HIV acquisition [8,9], and viral shedding in HSV-2/HIV co-infected individuals, thereby increasing their infectious potential for transmission [10][11][12][13]. Moreover, HIV infection alters the natural history of HSV-2 infection and severely immune-suppressed co-infected patients may experience more frequent, severe or prolonged symptomatic recurrences [14,15] as well as increased frequency of HSV-2 genital shedding [11,[16][17][18], facilitating the sexual transmission of either virus. These reciprocal and synergistic relationships underscore the importance of controlling HSV-2 for HIV prevention [15,19].

HSV-2 management: international guidelines

Acyclovir is an anti-herpetic drug that shortens the duration of HSV-2 clinical episodes if taken early, and prevents recurrences if taken over longer periods of time. However, this antiviral cannot cure genital herpes. It has been used widely in high income countries and has a good safety and efficacy profile [20]. WHO recommends that low resource settings manage GUD and other STI syndromes using the syndromic approach, which provides presumptive treatment for all possible treatable causes of the syndrome without the need to carry out expensive or time-consuming diagnostic tests. For a long time, the recommendation only included treatment of curable bacterial infections, not viral infections, such as HSV-2. However, since HSV-2 has become the most common GUD aetiology, and ulcers caused by HSV-2 are not necessarily distinguishable from other types of genital ulcers, particularly in HIV positive individuals, WHO recommended in 2003 to include acyclovir in the cocktail of drugs prescribed to GUD patients, with the provision that it should be supplied in settings where at least 30% of GUD are caused by HSV-2 [21]. Few nations have this country-level data. Moreover, there has been great reluctance in resourcelimited countries to treat HSV-2 as it is perceived to be a self-limiting disease (at least in immuno-competent individuals), treatment is not curative as episodes are typically recurrent, there is a lack of awareness among providers and a lack of access to anti-herpetic drugs at the lower echelons of health care systems.

Prior to the addition of acyclovir to the management guidelines, WHO had convened a meeting of international researchers in 2001 to examine the role of herpes on the HIV epidemic in developing countries [22]. The meeting resulted in a call for research into the possibility of disrupting the observed co-factor effect of HSV-2 with the use of anti-herpetic therapy. Randomized controlled trials were set up in Asia, sub-Saharan Africa, Latin America and the United States to determine the impact of either short-term episodic treatment of genital ulcers or suppressive HSV therapy taken daily over several months, and included HIV-infected and uninfected populations. While the trials were in progress, the Global Strategy for the Prevention and Control of STIs (2006-2015) [23] was adopted at the World Health Assembly in Geneva in June 2006. The Strategy called, inter alia, for greater control of HSV-2 infection. By April 2008, all but one trial had come to an end. The results of the trials, as well as other biological, modeling and economic analyses, were presented at a WHO Expert Meeting in Montreux, Switzerland, which informed the revision of the International STI Treatment Guidelines.

The research found that 1) HSV-2 episodic therapy was marginally beneficial in some, but not all patient groups and settings, in terms of ulcer healing and reduction of HIV levels in the genital tract [24][25][26]; 2) HSV-2 suppressive therapy did not appear to prevent HIV acquisition in two large trials [27,28]; 3) HSV-2 suppressive therapy generally decreased HIV levels in plasma and genital secretions in most studies [10,13,[29][30][31][32][33]; but 4) this was not enough to decrease HIV transmission between partners in HIV serodiscordant couples [34] (this final landmark study ended one year after the Montreux meeting and was published two years later). Despite these globally disappointing results, a recommendation was made during the Expert Meeting to modify the WHO GUD syndromic management guidelines to include anti-herpetic therapy in the syndromic management cocktail, without a prevalence threshold. The decision was based on high HSV-2 prevalence among GUD patients in all settings, clinical benefits to those treated, and a potentially favorable cost-benefit profile. Addition of acyclovir was found to increase the number of ulcers correctly treated thereby reducing the cost per ulcer treated, even when not taking into account the potential for for loss of productivity due to herpetic outbreaks and the increased rate of HIV acquisition among HSV-2 positive individuals [35].

Ghanaian national policy

At the time of this study in July 2008, acyclovir was available in Ghana but only prescribed in the private sector. Meanwhile, Ghana was still employing the pre-2003 WHO GUD syndromic management guidelines which did not include acyclovir [36]. Select physicians, those with more resources, occasionally gave acyclovir as part of their treatment for GUD, but this was a rare occurrence. Ghanaian health officials cited competing health priorities and the chronic nature of herpes as obstacles to guideline changes, despite the quality of life argument to herpes suppression and the potential benefit to Ghanaian workforce productivity.

Methods

The objectives of this study were: (1) to evaluate the process by which findings of trials into the synergy between HSV-2 and HIV on GUD influenced guidelines formulated by the WHO, and (2) to investigate the policy transfer process from international guideline formulation to policy development in Ghana. Both of these policy change mechanisms have been investigated based on theoretical frameworks of the policy process and the ways evidence may be taken up into policy. Also under examination was the relationship between research conducted locally (within Ghana) and national policy development, paying special attention to the Ghanaian policy context in an effort to better understand the climate within which policy change occurs at a national level.

A first set of in-depth interviews (n=11) was conducted informally with attendees of the WHO Expert Meeting to update the GUD syndromic management guidelines in Montreux, Switzerland, in April 2008. Interviewees included senior WHO officials, WHO program staff and researchers from across the globe. Oral consent was obtained based on conditions of anonymity and all interviews were conducted by a single interviewer (HB). A second set of interviews (n=8) was conducted formally with high-ranking government officials, leaders in the non-profit public health sector and distinguished researchers all working in the field of sexual and reproductive health, in Accra, Ghana, during July 2008. Interviews were conducted by the same interviewer (HB) in the presence of a senior Ghanaian STI researcher (YAS). Written consent was obtained from all interviewees. Interview questions were scripted and strictly adhered to for consistency. Interviews were conducted in English, tape-recorded and transcribed. The data from both sets of interviews were analyzed based on trend analysis. With a fairly small number of interviewees at the two sites, it was possible to complete a manual trend analysis by comparing the transcribed interviewee responses in order to identify the prevailing themes.

Selection of case study

This research was commissioned by the DFID-funded Research Project Consortium (RPC) on Research and Capacity Building in Sexual & Reproductive Health and HIV in Developing Countries. Members of the RPC were personally involved in many of the HSV-HIV trials, including one conducted in Ghana [18,24] and they presented their findings at the Montreux meeting. The Ghana trial results had also been presented earlier (June 2006) to national stakeholders in Ghana, but no change in management guidelines was introduced then, although it was found that HSV-2 accounted for over 50% of genital ulcers in Ghana, thereby highlighting its public health importance [18]. The link to HIV also influenced selection of the case study, as international attention paid to HIV prevention and care in recent years has been noted for creating a 'policy window' for change in relation to the treatment of potential cofactor infections, particularly in parts of Africa which are greatly affected by the HIV epidemic [37].

Theoretical frameworks for the evidence-policy interface

There are many theories about the way in which evidence generated from research is (or is not) incorporated into policy. The presence or expectation of an evidence base to a policy or practice has become commonplace, specifically in the public health field which tends to value evidence above ideological concerns [1,2]. However, insights into evidence and policy from a policy analysis perspective recognize the importance of other elements beyond the evidence itself as influential in shaping how research findings get taken up in decision making [38]. These models point to the importance of multiple competing political factors shaping policy-making [39], and often emphasize the links between key networks connecting researchers and policy makers [3]. In this case study, exploration has been dissected into three interconnected relationships to provide a framework to guide research and analysis: (1) evidence to policy theories, (2) actors and policy networks, and (3) international to national policy transfer theories.

Evidence to policy theories

A number of frameworks have been proposed to explain the research-policy interface. One of the most straightforward is the linear/rationalist model, which views policy change as pragmatic problem-solving with evidence providing the basis for policy decisions [40]. In this conceptualization, reviewing relevant evidence is all that is needed to guide policy to a correct decision. When evidence is not used as it should be, the problem is seen as a technical onea breakdown in communication between the 'two-worlds' of researchers and policy makers. The 'two-worlds' view [41] particularly focuses on the different needs and expectations of researchers and policy-makers. The world of researchers is depicted as scientifically complex and places an emphasis on process and purity of findings. The world of policy-makers, on the other hand, wants certainty, timeliness and simplicity. Lomas describes the tension as "decision-makers accuse researchers of irrelevant, poorly communicated 'products'; researchers accuse decision-makers of political expediency that results in irrational outcomes" [42].

This rationalist view, however, strikingly ignores politics and political interest in the research to policy continuum. Political theorists emphasize the political space, and typically point to the multiple competing elements which can influence policy makers. Lin, for instance, refers to three competing 'rationalities' in decision making -'technical' rationalities (such as those driven by evidence) must compete with 'political' and 'cultural' rationalities (demands) [38]. Other authors similarly emphasize that policy making is not a simple point of decision making, but one which occurs in a broader context (with broader issues influencing decision making).

From these perspectives, the nature of the policy making body and its competing demands may be highly relevant to shaping the uptake of research into policy. International organizations, such as the WHO, are expected to have fewer competing political influences and a more homogenous cultural view of the importance of evidence in shaping health policy. Finally, the context of policy making would be insulated from many other issues due to the WHO's narrow focus on healthcare. National governments, however, may show great variety in all these issues. The importance of research evidence in competition with other demands on policy makers, and the changing contexts and importance of health decisions may be very locally specific, and play a great role in shaping the uptake of evidence for any given case.

Actors and policy networks

Many health policy and research-to-policy theories, place actors and networks of actors centrally in explaining policy change [3,4], highlighting the importance of networks in influencing public policy outcomes [43]. Networks can take various forms in these works, including 'epistemic communities' of scientific or disciplinary experts who have access to policy-makers, or cross-cutting 'policy networks' linking actors representing government, economic and professional interests involved in a specific decision making structure [43,44]. Haas in particular contends that it is the informal networks that exist among and around actors that are key to bridging the research-policy gap at all levels [45]. Information flows through these communities freely, and if the community includes policy-makers or other influential persons (as well as researchers, or other custodians of evidence), the community itself can serve to exert pressure on those policy-makers, thus skirting tiresome bureaucratic channels [45]. Haas notes that policy communities in general may be difficult to trace, so their influence in policy development may be underestimated.

In international organizations such as the WHO, however, these networks are much more evident and are often institutionally structured into decision making processes. One would expect to see clear and regular contact between researchers and decision makers in such an institution. At national levels, however, the relationships may be more variablechanging over time and according to the nature of the issue. As such, investigation is needed at the national level to understand how and when such networks play a role in policy change.

The RAPID (Research and Policy in Developing Countries) programme of the Overseas Development Institute reviewed 50 case studies to examine these processes. Their conceptual framework contends that there is an integral interconnectivity between the political context (political structures/processes, institutional pressures, prevailing concepts, policy streams and windows), the evidence (credibility, methods, relevance, use, how the message is packaged and communicated), and links (between policy-makers and other stakeholders, relationships, voice trust, networks, the media and other intermediaries) [46]. This all-inclusive analysis then places these three factors, or overarching themes, in the context of external influences, including economic and cultural influences among others [46]. The degree to which each of the factors takes center stage in terms of driving, impeding or simply engaging in research-to-policy is fluid throughout the process and highly case-specific; however, networks of actors remain central to the landscape of change in every instance.

International to national policy transfer theories

The complexities of policy making at a national level can further be illustrated by the processes in which international recommendations are transferred to the local level. Rather than a simple process of copying higher level guidelines, often a more iterative process exists where pieces of information are taken up, interpreted and adapted [47]. This process can be illustrated through specific country case studies. Based on a study of policy transfer of tuberculosis and STI management in Mozambique [48] for instance, it was found that policies do not appear to follow one transfer mechanism, but rather, policy formulation requires many "loops" that rely on both bottom-up and top-down dissemination. According to another global perspective case study of STI management [49], international-to-national policy transfer results from a process described by Kingdon's famous ''streams" model which may be used to analyze policy change at local, national and international levels [50]. The model focuses on agenda setting and timing as the key components to policy reform. The so-called streams consist of (1) a problem streamlinked to identification or recognition of problems, (2) a policy streamencompassing feasible policy solutions, and (3) a politics streamreflecting the political will to address an issue [50]. A policy window is seen to occur when these three streams 'intersect' in time. That is to say when a problem is recognized, a solution is available, and political will is strong enough. It is then that policy reform is introduced. This window presents itself as the focal point for researchers hoping to influence policy, or the point at which evidence can be incorporated into policy. This window of opportunity may be the result of an organic process, but it may also be induced by wellplaced actors (known as 'policy entrepreneurs') who recognize when time might be ripe for policy change [50]. Network theorists also see networks as playing key roles in international to national policy transfer [44], and it can be conceptualized that these policy entrepreneurs typically need to be members of important policy networks.

As a whole, then, there are numerous theories and models of the process of policy change, and of the uptake of research into policy. Those often used in public health discourse tend to see getting research into policy as a technical exercise-bridging the gap between evidence and policy circles. Those deriving from policy analysis perspectives, however, typically emphasize the complexity of factors influencing decisions and decisionmakers. While diverse, the core of many of these theories have to do with political issues, competing interests, and policy processes that only enable change when particular conditions are met. In both sets of views, key actors and networks play important roles connecting researchers to policy-makers, pushing technical considerations in debates, and identifying windows of opportunity for policy change. Our study uses these insights to compare the evidence to policy process in the sexual health/STI field in both international (WHO) and national (Ghana) contexts.

Results

Influencing international policy: the WHO GUD syndromic management guidelines

Common among all Montreux interviewees is the belief that a 'policy window' was a key determinant for the inclusion of acyclovir in the GUD syndromic management guidelines. As suggested earlier, it would not be illogical to assume that the power of observational data alone may be more influential in the context of the WHO than in a national setting. It was not, however, found to be sufficient. One policy-maker in Montreux noted that "evidence is not sufficient: facts are facts, perception is reality" and went on to say that "even if there is evidence for a change in policy, it will not matter until it is perceived that it should matter." This indicates that even in a context such as the WHO which focuses on best practices in health, there are multiple factors affecting the uptake of evidence. In line with Kingdon's Three Streams Model, the observance of a synergy between HIV and HSV-2 (problem stream) combined with the international attention and donor focus on HIV (politics stream) served to push HSV-2 on to the international agenda. As stated by one WHO policymaker, "without these trials [into disrupting the co-factor effect between herpes and HIV] we would not even be discussing herpes or thinking about making acyclovir standard practice." It was highly anticipated that the trial results would provide evidence for an effective intervention (policy stream), thereby satisfying Kingdon's prerequisites for the creation of a policy window. Interviewees agreed that the momentum generated through the potential to impact HIV transmission and acquisition through addressing HSV-2 allowed for inclusion of acyclovir in the guidelines despite the trials' findings showing no impact on HIV transmission: it provided a platform to those who sought to "treat herpes for herpes sake," commented one researcher.

As noted above, the initial impetus for policy change with regards to HSV-2 was a bottom-up process in which observational data in a few countries triggered international investigation. Once evidence of a synergy between the two viruses had accumulated through in-country observational data and some international reviews and meta-analyses, the 'policy network' of researchers, program managers and policy-makers who were to later comprise the 2008 WHO Expert Review took it upon themselves to drive the agenda. Researchers and policy-makers from this group were active in the drafting of the 2001 call for research and many of these same researchers either ran or advised on the individual trials. These same policy-makers then played a central role in passing the Global Strategy for the Prevention and Control of STI at the World Health Assembly [23], thereby priming the stage for policy change with a renewed international focus on STIs. When questioned on this club-like camaraderie among key contributors to the Montreux meeting, one researcher answered, "well, many of us were here [at the WHO] for the [development of the] first [syndromic management] guidelines."

Although in many respects, at the international level, researchers and policy-makers worked in tandem, the existence of a divide between the so called 'two-worlds' was plainly evident through the course of the Montreux meeting. There, program managers also played a role in the decision-making process. All three groups wanted something different out of the research findings: researchers were interested in the statistical significance of the findings and implications for further studies; policy-makers wanted a recommendation for policy-change; and program managers wanted to be able to supply the communities they served with acyclovir based on the observed disease burden. One program manager voiced his/her concern directly to the researchers: "Are you going to make any recommendations? All I hear is the need for more research." On this point, policy-makers agreed. All non-researchers interviewed were frustrated with the researchers for not getting to the bottom of "the so-what factor" as one interviewee termed it.

Mechanisms of getting research into policy in Ghana

According to WHO interviewees, it often takes as long as two years, or sometimes even longer, for changes in treatment guidelines to be disseminated through national governments to practitioners working in low income countries. One WHO policy maker predicted: "we will be lucky if this [change in the syndromic management treatment guidelines] even gets to the [WHO] country offices in two years time." For this reason, Ghanaian interviewees were asked to speculate on the likely process for policy change in regards to the HSV-2 treatment based on their extensive experience with previous changes in WHO STI treatment guidelines. Donors' stringent funding eligibility requirements were repeatedly cited as the single strongest impetus for policy change. One program manager interviewed stated, "where there is money, we manage to get something done, otherwise we have competing priorities." This is not surprising as Ghana's health sector, particularly in the area of prevention, is heavily dependent on foreign aid. Therefore, donors' interests may often dominate research agendas, programming decisions, and policy, simply due to their financial power. Another interviewee, a researcher, commented, "I am not sure to what extent we or any developing country owns the research agenda … people come from outside and say, 'we want to look at this and we have this money.' There is a lot of frustration and a lot of brain drain." This domination by donor interests can therefore work in two ways: (1) if a donor pays attention to a particular issue it gains national importance, and (2) if a donor does not emphasize an issue, it may be ignored nationally to accommodate a competing priority. Program managers and even some policy-makers felt that they were unable to act upon research findings, even in cases where it was clear that change would be beneficial because "we don't have time and we must be responsive to donors first or we cannot do anything at all," said one policy maker. According to all interviewees, policy-makers [in Ghana] often give more weight to international research results over national research due to the wider dissemination of research findings and the potential influence on donor funding. The policy-makers went further to contend that, in the case of HSV-2 treatment, without clear evidence that acyclovir disrupts the cofactor effect between HSV-2 and HIV, they did not anticipate including acyclovir in the syndromic management cocktail, unless there was funding attached both for procurement and for drug delivery. Because the trial results did not indicate that HSV therapy was an effective HIV prevention strategy, the same interviewees highly doubted that donor organizations, many of which they feel were myopically HIV-focused, would make herpes treatment a priority.

The researchers all felt that there was great difficulty in attracting the policy-makers' attention to this issue: "there is so much going on, it sometimes doesn't matter how loud your voice is." The majority of researchers interviewed went further to predict that this is a case in which formal policy change will lag behind practice and that acyclovir might be used because of the high prevalence of HSV-2 among GUD cases, provided the drugs can be made available. Practice was also a precursor to policy reform for the initial adoption of STI syndromic management itself [51], indicating that in the interest of expediency of delivery, it may be the case that practice may often precede national STI policy reform [49]. Some argued that in the case of HSV-2, in private settings and on a small scale, practice was already preceding policy, as acyclovir is available and prescribed. As noted earlier, acyclovir was not on the national essential drugs list and so not available in the public sector. This is not to say that Ghanaian policy reform is only responsive to donors' directives. Another mechanism through which change may occur is if an influential enough individual (a 'policy entrepreneur') who is either placed directly within the Ministry of Health or National HIV Control Program, and, according to one Ghanaian researcher, "who is well liked either within [the Ministry of Health] or outside [in the community]," makes a strong case for the change. This mechanism is particularly effective for getting operational research findings into policy. In order for a policy entrepreneur to bring about change, however, all interviewees agreed that conditions apply. The policy change must be seen to: (a) save money in the long run, (b) be highly visible and good for public relations, (c) be beneficial to the population at no extra cost, or (d) have any extra costs covered by donor agencies, and/or (e) have the potential to attract additional donor funding. These conditions essentially outline the prerequisites for generating political will at the national level.

Ghana's experience, unsurprisingly, pointed to the many ways that key networks of actorsand links between them-were essential to understanding the research to policy process. Researchers interviewed mentioned their friends in policy positions as being instrumental in the researchers' attempts to impact policy: "If I see something needs to be done and it's not, I call my friend," said one researcher. This dynamic constitutes a policy network, one that links researchers with well placed individuals able to influence policy. Based on the interviews, it appears that within these networks it is often a single champion of a cause (or policy entrepreneur) who carries the issue and generates internal pressure, although this may not always be the case. Many policy-makers and program managers confirmed the existence of these communities. They spoke of personal ties through either old friends or colleagues to certain research groups and cited these ties as their main taproot to the latest research. One policy-maker in Ghana recommended, "We need to make these networks more solid [as a mechanism for bringing research and policy closer together]."

Discussion

According to the Montreux interviewees, the comparatively high profile of HIV generated the political will necessary for HSV-2 to be brought on to the international research agenda. This indicates that even within the context of the WHO, which is comparatively immune to the multiple competing priorities seen to impede national policy reform, policy change still has political elements. In order to address issues which receive little political attention, linking to a larger, more popular issue may be necessary in order to gain political traction. In addition, there was a resounding call from policy-makers and program managers for researchers to engage in helping to bridge the divide between research and practice through indicating the programmatic and policy relevance of both their research and their findings.

On the Ghanaian national policy front, multiple competing priorities appeared to influence the uptake of research findings into national policy reform. Three mechanisms emerged. The first is to bypass policy reform. Many of the researchers in Ghana also have a clinical practice. Therefore, the distance between research and practice can be shortened, as compared to the distance between research and policy. Bypassing policy as a rule will not, however, support provision of care for all who need it. The second mechanism is orientated towards policy reform and focuses on the central role of actors in the national context. Both policy networks and policy entrepreneurs (often working within this group), were described as critical to bridging the gap between research and policy. In the case of Ghana, policy networks are cited as the only functional communication channel between researchers and policy-makers. A final mechanism for influencing policy involves donors. At the national level, donor attention to a particular issue, or lack thereof, heavily influences the likelihood of policy reform. In the case of HSV-2, it was predicted that a lack of donor attention combined with competing donor priorities, would impede the inclusion of acyclovir in national syndromic management guidelines.

Since completion of our study, further policy development has occurred in Ghana. The prediction that lack of donor interest would impede policy change proved incorrect. This appears to be because of the influence of a key policy network (linking both policy-makers and researchers) who, in 2009, met at the National AIDS Control Program to discuss implications from the findings of the Ghanaian HIV/ HSV-2 trial. During the course of the meeting, which included Ghanaian Government health officials, it was decided that acyclovir should and would be added to national GUD treatment policy. It is not clear how this meeting was convened or who drove the agenda, however, what is evident is that there was a network of interested and connected researchers and policy-makers at the heart of the process (Figure 1).

At the international level, there appears to be more formalized networks of actors influential in WHO decisions. The majority of individuals invited to attend the Expert Meeting in Montreux are actually frequent advisors to the WHO. In the case of STIs, this invitation does not appear to extend well beyond the bounds of the personalities present at the meeting, as evidenced by the observation that the same individuals had been involved in the various iterations of the STI syndromic management guidelines development.

Conclusion

It becomes evident that in the case of HSV-2 and the changes made to the GUD syndromic management guidelines, HIV and the observed cofactor effect between HIV and HSV-2 played a pivotal role in generating the political will necessary for the creation of a policy window. Policy networks and policy entrepreneurs emerged as playing recurrent important roles. It appears that these communities and the actors that comprise them may provide the primary impetus for policy change, within both case study contexts. Evidence alone emerged as unable to influence policy without the engagement and alignment of multiple factors.

Based upon these research findings, there are several follow-on recommendations for increasing the likelihood of research uptake into policy/guidelines at both the national and international levels in the field of STIs and HIV. Within the WHO, it appears important to link with existing priorities (if possible) in order to attract attention to an otherwise marginalized issue. The entire sexual health/STI research to policy continuum lives within the apparent confines of the WHO STI policy network. This is a formalized community and one that is recognized for its contribution to policy change. Researchers may wish to proactively target this network, particularly in communicating the practical application of their findings (the "so what factor" of their work). Ideally, such communication would begin at the outset of research work and continue throughout the duration of any study, thereby building up to any potential recommendations for change, and establishing legitimacy of the researchers to the network members when their findings become available.

In the case of Ghana, the policy network is entirely informal, and yet is still a powerful contender in affecting policy change. The existence of this group presents an opportunity to disseminate study findings and exert pressure on policy-makers in an effective manner. In this way, often difficult to reach policy-makers may be included in research from the outset of a study, instead of as an endpoint for the presentation of

Timeline of Relevant Events

•Acyclovir added to the essential drugs list for use at the primary care level. research findings. In this way, policy-makers may also better understand the policy implications of research findings particularly in the case of research conducted locally. Also key to the national research-to-policy continuum are donors. Donor engagement around policy change is a difficult issue. Donor power emerged as a consistent theme in the Ghanaian case study, and there is a high likelihood that this finding can be extrapolated to other health areas and potentially other low-income countries. The possibilities then for ethical donor engagement in research-uptake at the national level, and particularly in the case of research conducted locally, deserves further study.

Post Study Updates

Role of authors

H Burris and P Mayaud conceived and designed the study with contributions from Y Adu-Sarkodie and J Parkhurst. H Burris implemented the field survey with support from Y Adu-Sarkodie. Analysis and interpretation of data was first conducted by H Burris and reviewed by J Parkhurst and P Mayaud. The initial draft of the manuscript was written by H Burris and revised by all authors who approved its final version.

Ethical approval

Figure 1
1Timeline of Relevant Events.

The study was approved by the Research Ethics Committee of the London School of Hygiene & Tropical Medicine and the Ethics Board of the School of Medical Sciences, Kwame Nkrumah University of Sciences & Technology, Kumasi, Ghana. Consent was obtained orally under conditions of anonymity in Switzerland and formal written consent was obtained from all interviewees in Ghana. Presentation This work was presented as a poster presentation at the Bi-Annual Conference of the International Society for Sexually Transmitted Diseases Research (ISSTDR), London, 28 June -1 July 2009 (Abs P4.158).
Acknowledgements and fundingThe authors wish to thank all those who provided their time and insights during interviews at the WHO Revision of STI Guidelines Expert Meeting in Montreux, Switzerland (April 2008) and in Ghana (July 2008). In particular, we want to thank Dr Francis Ndowa, Director of the STI Division of WHO, who facilitated the research process with WHO.Competing interestsThe authors declare that they have no competing interests.
Evidence based policymaking. C Ham, D Hunder, R Robinson, British Medical Journal. 310Ham C, Hunder D, Robinson R: Evidence based policymaking. British Medical Journal 1995, 310:71-72.

Using knowledge brokering to promote evidence-based policy-making: the need for support structures. J Van Kammen, D De Savigny, N Sewankambo, Bulletin of the World Health Organization. 8Van Kammen J, de Savigny D, Sewankambo N: Using knowledge brokering to promote evidence-based policy-making: the need for support structures. Bulletin of the World Health Organization 2006, 8:608-612.

Bridging research and policy: context, evidence and links. London: Overseas Development Institute. E Crewe, J Young, Crewe E, Young J: Bridging research and policy: context, evidence and links. London: Overseas Development Institute; 2002.

Reforming the health sector in developing countries: the central role of policy analysis. Health Policy and Planning. G Walt, L Gilson, 9Walt G, Gilson L: Reforming the health sector in developing countries: the central role of policy analysis. Health Policy and Planning 1994, 9(4):353-370.

Epidemiology of herpes simplex virus type 2 infection in the developing world. H Weiss, Herpes. 11Weiss H: Epidemiology of herpes simplex virus type 2 infection in the developing world. Herpes 2004, 11:24A-35A.

Epidemiology of genital herpes simplex virus infection in developed countries. J E Malkin, Herpes. 111SupplMalkin JE: Epidemiology of genital herpes simplex virus infection in developed countries. Herpes 2004, 11(Suppl 1):2A-23A.

An estimate of the global prevalence and incidence of herpes simplex virus type 2 infection. K J Looker, G P Garnett, G P Schmid, Bulletin of the World Health Organisation. 8610Looker KJ, Garnett GP, Schmid GP: An estimate of the global prevalence and incidence of herpes simplex virus type 2 infection. Bulletin of the World Health Organisation 2008, 86(10):805-12A.

Herpes simplex virus 2 infection increases HIV acquisition in men and women: systematic review and meta-analysis of longitudinal studies. E E Freeman, H A Weiss, J R Glynn, Aids. 20Freeman EE, Weiss HA, Glynn JR, et al: Herpes simplex virus 2 infection increases HIV acquisition in men and women: systematic review and meta-analysis of longitudinal studies. Aids 2006, 20:73-83.

Herpes simplex virus type 2: a key role in HIV incidence. J R Glynn, S Biraro, H A Weiss, Aids. 2312Glynn JR, Biraro S, Weiss HA: Herpes simplex virus type 2: a key role in HIV incidence. Aids 2009, 23(12):1595-8.

Impact of suppressive herpes therapy on genital HIV-1 RNA among women taking antiretroviral therapy: a randomized controlled trial. A Ouedraogo, N Nagot, L Vergne, Aids. 20Ouedraogo A, Nagot N, Vergne L, et al: Impact of suppressive herpes therapy on genital HIV-1 RNA among women taking antiretroviral therapy: a randomized controlled trial. Aids 2006, 20:2305-13.

Roles of clinical and subclinical reactivated herpes simplex virus type 2 infection and human immunodeficiency virus type 1 (HIV-1)-induced immunosuppression on genital and plasma HIV-1 levels. N Nagot, A Ouedraogo, I Konate, Journal of Infectious Diseases. 198Nagot N, Ouedraogo A, Konate I, et al: Roles of clinical and subclinical reactivated herpes simplex virus type 2 infection and human immunodeficiency virus type 1 (HIV-1)-induced immunosuppression on genital and plasma HIV-1 levels. Journal of Infectious Diseases 2008, 198:241-9.

Herpes simplex virus and HIV-1: deciphering viral synergy. P Van De Perre, M Segondy, V Foulongne, Lancet Infectious Diseases. 8Van de Perre P, Segondy M, Foulongne V, et al: Herpes simplex virus and HIV-1: deciphering viral synergy. Lancet Infectious Diseases 2008, 8:490-7.

Impact of aciclovir on genital and plasma HIV-1 RNA in HSV-2/HIV-1 co-infected women: a randomized placebo-controlled trial in South Africa. S Delany, N Mlaba, T Clayton, Aids. 23Delany S, Mlaba N, Clayton T, et al: Impact of aciclovir on genital and plasma HIV-1 RNA in HSV-2/HIV-1 co-infected women: a randomized placebo-controlled trial in South Africa. Aids 2009, 23:461-9.

Severe acquired immunodeficiency in male homosexuals, manifested by chronic perianal ulcerative herpes simplex lesions. F P Siegal, C Lopez, G S Hammer, New England Journal of Medicine. 305Siegal FP, Lopez C, Hammer GS, et al: Severe acquired immunodeficiency in male homosexuals, manifested by chronic perianal ulcerative herpes simplex lesions. New England Journal of Medicine 1981, 305:1439-44.

The Effects of Herpes Simplex Virus-2 on HIV-1 Acquisition and Transmission: A Review of Two Overlapping Epidemics. L Corey, A Wald, C L Celum, T C Quinn, Journal of Acquired Immune Deficiency Syndrome. 35Corey L, Wald A, Celum CL, Quinn TC: The Effects of Herpes Simplex Virus-2 on HIV-1 Acquisition and Transmission: A Review of Two Overlapping Epidemics. Journal of Acquired Immune Deficiency Syndrome 2004, 35:435-445.

Interactions between herpes simplex virus type 2 and human immunodeficiency virus type 1 infection in African women: opportunities for intervention. F X Mbopi-Keou, G Gresenguet, P Mayaud, Journal of Infectious Diseases. 182Mbopi-Keou FX, Gresenguet G, Mayaud P, et al: Interactions between herpes simplex virus type 2 and human immunodeficiency virus type 1 infection in African women: opportunities for intervention. Journal of Infectious Diseases 2002, 182:1090-6.

Association between cervical shedding of herpes simplex virus and HIV-1. R S Mcclelland, C C Wang, J Overbaugh, Aids. 16McClelland RS, Wang CC, Overbaugh J, et al: Association between cervical shedding of herpes simplex virus and HIV-1. Aids 2002, 16:2425-30.

Cervicovaginal HIV-1 and herpes simplex virus type 2 shedding during genital ulcer disease episodes. J Legoff, H A Weiss, G Gresenguet, Aids. 21LeGoff J, Weiss HA, Gresenguet G, et al: Cervicovaginal HIV-1 and herpes simplex virus type 2 shedding during genital ulcer disease episodes. Aids 2007, 21:1569-78.

Genital herpes and human immunodeficiency virus: double trouble. C Celum, R Levine, M Weaver, Wald A , Bulletin of the World Health Organization. 82Celum C, Levine R, Weaver M, Wald A: Genital herpes and human immunodeficiency virus: double trouble. Bulletin of the World Health Organization 2004, 82:447-53.

. Burris, Health Research Policy and Systems. 9SupplBurris et al. Health Research Policy and Systems 2011, 9(Suppl 1):S5 http://www.biomedcentral.com/1478

Morbidity and Mortality Weekly Recommendation Reports (MMWR) Centres for Disease Control and Prevention(CDC). K A Workowski, S M Berman, Sexually transmitted diseases treatment guidelinesWorkowski KA, Berman SM: Sexually transmitted diseases treatment guidelines, 2006. Morbidity and Mortality Weekly Recommendation Reports (MMWR) Centres for Disease Control and Prevention(CDC); 2006, 551-94.

World Health Organisation (WHO): Guidelines for the management of sexually transmitted infections. Revised version. Geneva: WHOWorld Health Organisation (WHO): Guidelines for the management of sexually transmitted infections. Revised version 2003. Geneva: WHO; 2003.

Report on WHO/UNAIDS/LSHTM workshop Herpes simplex virus type 2: programmatic and research priorities in developing countries. London. Geneva: WHOWorld Health OrganisationWorld Health Organisation (WHO), United Nations Joint Programme on AIDS (UNAIDS): Report on WHO/UNAIDS/LSHTM workshop Herpes simplex virus type 2: programmatic and research priorities in developing countries: 14-16 February, 2001; London. Geneva: WHO; 2001.

Global strategy for the prevention and control of sexually transmitted infections. World Health Organisation. World Health Organisation (WHO): Global strategy for the prevention and control of sexually transmitted infections: 2006-2015. Geneva: WHO/RHR; 2006.

Impact of acyclovir on genital and plasma HIV-1 RNA, genital herpes simplex virus type 2 DNA, and ulcer healing among HIV-1-infected African women with herpes ulcers: a randomized placebo-controlled trial. P Mayaud, J Legoff, H A Weiss, Journal of Infectious Diseases. 200Mayaud P, Legoff J, Weiss HA, et al: Impact of acyclovir on genital and plasma HIV-1 RNA, genital herpes simplex virus type 2 DNA, and ulcer healing among HIV-1-infected African women with herpes ulcers: a randomized placebo-controlled trial. Journal of Infectious Diseases 2009, 200:216-26.

Improvement in healing and reduction in HIV shedding with episodic Acyclovir therapy as part of syndromic management among men: a randomized controlled trial. G Paz-Bailey, M Sternberg, A J Puren, Journal of Infectious Diseases. 200Paz-Bailey G, Sternberg M, Puren AJ, et al: Improvement in healing and reduction in HIV shedding with episodic Acyclovir therapy as part of syndromic management among men: a randomized controlled trial. Journal of Infectious Diseases 2009, 200:1039-49.

Impact of acyclovir on ulcer healing, lesional, genital and plasma HIV-1 RNA among patients with genital ulcer disease in Malawi. S Phiri, I F Hoffman, H A Weiss, Sexually Transmitted Infections. 865Phiri S, Hoffman IF, Weiss HA, et al: Impact of acyclovir on ulcer healing, lesional, genital and plasma HIV-1 RNA among patients with genital ulcer disease in Malawi. Sexually Transmitted Infections 2010, 86(5):345-52.

Effect of herpes simplex suppression on incidence of HIV among women in Tanzania. D Watson-Jones, H A Weiss, M Rusizoka, New England Journal of Medicine. 358Watson-Jones D, Weiss HA, Rusizoka M, et al: Effect of herpes simplex suppression on incidence of HIV among women in Tanzania. New England Journal of Medicine 2008, 358:1560-71.

Effect of aciclovir on HIV-1 acquisition in herpes simplex virus 2 seropositive women and men who have sex with men: a randomised, double-blind, placebo-controlled trial. C Celum, A Wald, J Hughes, The Lancet. 371Celum C, Wald A, Hughes J, et al: Effect of aciclovir on HIV-1 acquisition in herpes simplex virus 2 seropositive women and men who have sex with men: a randomised, double-blind, placebo-controlled trial. The Lancet 2008, 371:2109-19.

Reduction of HIV-1 RNA levels with therapy to suppress herpes simplex virus. N Nagot, A Ouedraogo, V Foulongne, New England Journal of Medicine. 356Nagot N, Ouedraogo A, Foulongne V, et al: Reduction of HIV-1 RNA levels with therapy to suppress herpes simplex virus. New England Journal of Medicine 2007, 356:790-9.

Herpes simplex virus (HSV) suppression with valacyclovir reduces rectal and blood plasma HIV-1 levels in HIV-1/HSV-2-seropositive men: a randomized, doubleblind, placebo-controlled crossover trial. R A Zuckerman, A Lucchetti, W L Whittington, Journal of Infectious Diseases. 196Zuckerman RA, Lucchetti A, Whittington WL, et al: Herpes simplex virus (HSV) suppression with valacyclovir reduces rectal and blood plasma HIV-1 levels in HIV-1/HSV-2-seropositive men: a randomized, double- blind, placebo-controlled crossover trial. Journal of Infectious Diseases 2007, 196:1500-8.

Herpes simplex virus (HSV)-suppressive therapy decreases plasma and genital HIV-1 levels in HSV-2/ HIV-1 coinfected women: a randomized, placebo-controlled, cross-over trial. J M Baeten, L B Strick, A Lucchetti, Journal of Infectious Diseases. 198Baeten JM, Strick LB, Lucchetti A, et al: Herpes simplex virus (HSV)- suppressive therapy decreases plasma and genital HIV-1 levels in HSV-2/ HIV-1 coinfected women: a randomized, placebo-controlled, cross-over trial. Journal of Infectious Diseases 2008, 198:1804-8.

Suppressive acyclovir therapy reduces HIV cervicovaginal shedding in HIV-and HSV-2-infected women. E F Dunne, S Whitehead, M Sternberg, Journal of Acquired Immune Deficiency Syndrome. 49Dunne EF, Whitehead S, Sternberg M, et al: Suppressive acyclovir therapy reduces HIV cervicovaginal shedding in HIV-and HSV-2-infected women, Chiang Rai, Thailand. Journal of Acquired Immune Deficiency Syndrome 2008, 49:77-83.

HSV suppression reduces seminal HIV-1 levels in HIV-1/HSV-2 co-infected men who have sex with men. R A Zuckerman, A Lucchetti, W L Whittington, Aids. 23Zuckerman RA, Lucchetti A, Whittington WL, et al: HSV suppression reduces seminal HIV-1 levels in HIV-1/HSV-2 co-infected men who have sex with men. Aids 2009, 23:479-83.

Acyclovir and transmission of HIV-1 from persons infected with HIV-1 and HSV-2. C Celum, A Wald, J R Lingappa, New England Journal of Medicine. 3625Celum C, Wald A, Lingappa JR, et al: Acyclovir and transmission of HIV-1 from persons infected with HIV-1 and HSV-2. New England Journal of Medicine 2010, 362(5):427-39.

Cost-effectiveness of incorporating episodic treatment for Herpes simplex virus type-2 (HSV-2) into the syndromic algorithm for genital ulcer disease. P Vickerman, F Ndowa, P Mayaud, Sexually Transmitted Infections. 84Vickerman P, Ndowa F, Mayaud P: Cost-effectiveness of incorporating episodic treatment for Herpes simplex virus type-2 (HSV-2) into the syndromic algorithm for genital ulcer disease. Sexually Transmitted Infections 2008, 84:243-248.

World Health Organisation (WHO): Guidelines for the management of sexually transmitted infections. Geneva: WHOWorld Health Organisation (WHO): Guidelines for the management of sexually transmitted infections. Geneva: WHO; 1994.

Translating HIV/AIDS research findings into policy: lessons from a case study of the Mwanza trial. A Philpott, D Maher, H Grosskurth, Health Policy and Planning. 172Philpott A, Maher D, Grosskurth H: Translating HIV/AIDS research findings into policy: lessons from a case study of the Mwanza trial. Health Policy and Planning 17(2):196-201.

Competing rationalities: evidence-based health policy. V Lin, Evidencebased health policy: problems & possibilities. OxfordOxford University PressLin V: Competing rationalities: evidence-based health policy. In Evidence- based health policy: problems & possibilities. Oxford: Oxford University Press;

. V Lin, B Gibson, Lin V, Gibson B 2003:3-17.

Evidence based policy: proceed with care. N Black, British Medical Journal. 323Black N: Evidence based policy: proceed with care. British Medical Journal 2001, 323:275-279.

Reorienting health-research communication. S Kuruvilla, N Mays, The Lancet. 366Kuruvilla S, Mays N: Reorienting health-research communication. The Lancet 2005, 366:1416-1418.

Research and Evidence-Based Decision Making. J Lomas, Australian and New Zealand Journal of Public Health. 215Lomas J: Research and Evidence-Based Decision Making. Australian and New Zealand Journal of Public Health 1997, 21(5):439-441.

Using 'Linkage and Exchange' To Move Research into Policy at a Canadian Foundation: Encouraging partnerships between researchers and policymakers is the goal of a promising new Canadian initiative. J Lomas, Health Affairs19Lomas J: Using 'Linkage and Exchange' To Move Research into Policy at a Canadian Foundation: Encouraging partnerships between researchers and policymakers is the goal of a promising new Canadian initiative. Health Affairs 2000, 19(3):236-240.

The development of the policy network approach. D Marsh, Comparing Policy Networks. Marsh DBuckingham Open University PressMarsh D: The development of the policy network approach. In Comparing Policy Networks. Buckingham Open University Press;Marsh D 1998:3-17.

Policy transfer networks: an insider's perspective. In Policy Transfer in Global Perspective. M Evans, P Mccomb, Ashgate Publishing LtdEvans M, McComb P: Policy transfer networks: an insider's perspective. In Policy Transfer in Global Perspective. Ashgate Publishing Ltd;

. M Evans, Aldershot, Evans M. Aldershot 2004:46-63.

When Knowledge is Power: Three Models of Change in International Organizations. E Haas, University of California PressBerkeley and Los AngelesHaas E: When Knowledge is Power: Three Models of Change in International Organizations. Berkeley and Los Angeles: University of California Press; 1990.

Bridging Research and Policy on HIV/AIDS in Developing Countries. London: Overseas Development Institute. J Court, Court J: Bridging Research and Policy on HIV/AIDS in Developing Countries. London: Overseas Development Institute; 2004.

International organizations in transfer of infectious diseases: iterative loops of adoption, adaptation and marketing. G Walt, L Lush, J Ogden, Governance. 172Walt G, Lush L, Ogden J: International organizations in transfer of infectious diseases: iterative loops of adoption, adaptation and marketing. Governance 2004, 17(2):189-204.

What's in a name? Policy transfer in Mozambique: DOTS for tuberculosis and syndromic management for sexually transmitted infections. J Cliff, G Walt, I Nhatave, Journal of Public Health Policy. 251Cliff J, Walt G, Nhatave I: What's in a name? Policy transfer in Mozambique: DOTS for tuberculosis and syndromic management for sexually transmitted infections. Journal of Public Health Policy 2004, 25(1):38-55.

Transferring policies for treating sexually transmitted infections: what's wrong with global guidelines? Health Policy and Planning. L Lush, G Walt, J Ogden, 18Lush L, Walt G, Ogden J: Transferring policies for treating sexually transmitted infections: what's wrong with global guidelines? Health Policy and Planning 2003, 18(1):18-30.

J Kingdon, Agendas, Alternatives and Public Policies. Boston: Little Brown & CoKingdon J: Agendas, Alternatives and Public Policies. Boston: Little Brown & Co; 1984.

Epidemiological treatment of gonorrhea. A Meheus, 10.1186/1478-4505-9-S1-S5The Lancet. 2Meheus A: Epidemiological treatment of gonorrhea. The Lancet 1973, 2:678-9. doi:10.1186/1478-4505-9-S1-S5

Getting research into policy -Herpes simplex virus type-2 (HSV-2) treatment and HIV infection: international guidelines formulation and the case of Ghana. Burris, Health Research Policy and Systems. 95Cite this article as. SupplCite this article as: Burris et al.: Getting research into policy -Herpes simplex virus type-2 (HSV-2) treatment and HIV infection: international guidelines formulation and the case of Ghana. Health Research Policy and Systems 2011 9(Suppl 1):S5.


Mobile App for Simplifying Life With Diabetes: Technical Description and Usability Study of GlucoMan

BScKaspar S Schmocker
; Fabian
BSc;S Zwahlen
Dipl Inform, Dr rerKerstin Denecke email@example.com
Nat

Institute for Medical Informatics
Institute for Medical Informatics
Bern University of Applied Sciences
BielSwitzerland

Bern University of Applied
Sciences Quellgasse 21BielSwitzerland

Mobile App for Simplifying Life With Diabetes: Technical Description and Usability Study of GlucoMan
10.2196/diabetes.8160Original Paper Corresponding Author: Kerstin Denecke, Dipl Inform, Dr rer nat
Background: Patients with diabetes can be affected by several comorbidities that require immediate action when occurring as they may otherwise cause fatal or consequential damage. For this reason, patients must closely monitor their metabolism and inject insulin when necessary. The documentation of glucose values and other relevant measurements is often still on paper in a diabetes diary.Objective: The goal of this work is to develop and implement a novel mobile health system for the secure collection of relevant data referring to a person's metabolis and to digitize the diabetes diary to enable continuous monitoring for both patients and treating physicians. One specific subgoal is to enable data transmission of health parameters to secure data storage.Methods:The process of implementing the system consists of (1) requirements analysis with patients and physicians to identify patient needs and specify relevant functionalities, (2) design and development of the app and the data transmission, and (3) usability study.Results:We developed and implemented the mobile app GlucoMan to support data collection pertaining to a person's metabolism. An automated transfer of measured values from a glucometer was implemented. Medication and nutrition data could be entered using product barcodes. Relevant background knowledge such as information on carbohydrates was collected from existing databases. The recorded data was transmitted using international interoperability standards to the MIDATA.coop storage platform. The usability study revealed some design issues that needs to be solved, but in principle, the study results show that the app is easy to use and provides useful features.Conclusions: Data collection on a patient's metabolism can be supported with a multifunctional app such as GlucoMan. Besides monitoring, continuous data can be documented and made available to the treating physician. GlucoMan allows patients to monitor disease-relevant parameters and decide who accesses their health data. In this way, patients are empowered not only to manage diabetes but also manage their health data.

Introduction

According to the International Diabetes Federation, approximately 642 million people worldwide will suffer from diabetes in 2040 [1]. Diabetes mellitus poses enormous challenges for patients and health carers. Once diabetes is diagnosed, lifelong self-management is critical for glycemic control with direct impact to long-term prognosis for the patients. Diabetes self-management includes self-monitoring of blood glucose, weight management, eating, and taking and managing medications. Furthermore, preventing and controlling diabetes complications (eye, foot, and renal) is important and requires regular checkups with physicians [2]. Care costs for chronic diseases are immense. Research showed that these costs can be reduced by supporting the self-management capabilities of patients [3]. Studies have proven that self-management allows patients to effectively deal with the challenges of chronic diseases and their treatment by reducing complications and symptoms, thus maintaining the level of quality of life [4]. With the rapid and ongoing growth of wireless connectivity and mobile phone availability, apps are increasingly considered interesting for supporting disease management. There is evidence from small studies that app use may have a beneficial effect on health outcomes [5]. The American Diabetes Association guidelines confirmed that apps may be a useful tool for monitoring diabetes and preventing complications [2]. With this in mind, we designed an app supporting diabetes self-management and digitized the existing paper-based diabetes diary.

Even though thousands of diabetes apps are available in the iTunes App Store and Google Play store for Android [6], these have limitations, which we address with our diabetes manager, GlucoMan. For example, the app mySugr allows a user to document blood sugar and other values uploaded from measurement systems [7]. DiaFit [8] supports uploading data from gadgets such as Apple Watch for fitness activity and glucose monitoring. Lithgow et al [9] claim that existing apps often do not support synchronization with a glucometer, although this feature is desired by patients. Existing apps support data export via email or sharing in social media platforms [10], but secure data export to a database that physicians can easily access through their information systems is not at all supported [10]. Arnhold et al [11] performed a systematic review on diabetes apps and found out that most of the 656 apps they reviewed provided only one function, such as documentation, information gathering, data forwarding, reminder, or therapy support. Further, they concluded that data transmission of health parameters to physicians is an important issue for future systems and is currently not well established.

The goal of this work is to develop and implement a novel mobile health system that digitizes the diabetes diary, enabling continuous monitoring of relevant data regarding a person's metabolism, and addresses the limitations of existing systems. A multifunctional app was developed aimed at supporting patients with diabetes in managing their disease by enabling documentation, data communication, and information gathering. Data is stored on a health platform where it can be accessed by physicians and researchers after patient authorization.

Methods

Requirements Analysis

We developed GlucoMan within the context of the Hospital of the Future Live (Spital der Zukunft Live, or SDZL), a Swiss project involving 16 companies and 6 hospitals that focused on eHealth technologies to develop information technology (IT) solutions for future optimized health care processes [12]. The Institute for Medical Informatics of the Bern University of Applied Sciences executes SDZL on behalf of GS1 Switzerland to study to what extent IT can optimize public health sector processes such as information flow and logistics in a system that starts and ends at home and involves the patient, carers, family doctor, specialists, and the hospital and rehab clinic. The project SDZL runs from June 2016 to June 2018. Several partners from the project were involved in the development of GlucoMan through provision of technology (hospINDEX, MIDATA, see below) and assistance with the requirements analysis. This particular subproject ran from September 2016 to June 2017.

We developed the concept and collected requirements based on interviews and discussions with 3 doctors from the university hospital in Bern, 2 representatives from Diabetes Switzerland, the national diabetes association, and 2 patients with diabetes recruited from the authors' personal environments. In this way, we assessed and considered the needs of health professionals and patients during the app development phase. Additional information was collected by reviewing scientific literature and teaching materials retrieved by searching PubMed using combinations of the keywords "mobile app," "diabetes," "diabetes management," "patient empowerment," "mobile health," and "self-management." The existing paper-based diabetes diary was used as a basis for app development and deciding on functionalities to be integrated.

Knowledge and Technological Resources

Drug information was retrieved from hospINDEX (HCI Solutions AG) based on the Global Trade Item Number. hospINDEX contains article and partner data in XML format, and the referenced articles are linked to commercial and scientific data. The selection of the data covers around 220,000 articles. Additionally, hospINDEX provides clinical decision support data. The database contains information on allergies, interactions with food, use during pregnancy, maximum dosages, and more.

We used the open food databases openfoodfacts.org, openfood.ch, and fddb.info to import the values of carbohydrates of nutrition products. The current version of the prototype supports communication and data exchange with the MyGlucoHealth (Entra Health Systems) wireless Bluetooth glucose meter. We selected this device since it provides a wireless interface. Other devices such as FreeStyle Libre (Abbott Laboratories) have been assessed for integration but were excluded due to proprietary data formats or missing data transmission interfaces.

Data is stored on the MIDATA IT platform [13]. MIDATA.coop has developed an open source IT platform for the secure storage, management, and sharing of personal health data of any sort. The platform underwent 3 independent security checks before the first personal data were stored. MIDATA.coop has also established a clear trust-promoting governance framework. A developer's guide is available [14] that explains the general architecture of the platform and how apps and plugins can interact with it.

Our app is developed with the Ionic v2 Framework and Cordova (HTML, Cascading Style Sheets, Typescript); therefore, it can be built for multiple platforms (Android, iOS, Windows Phone, Blackberry, etc). The runnable version was only created for Android because the iPhone Bluetooth interface could not be used as required.

Usability Study

The objective of the usability study is to identify usability problems and refine the design of the system to address the identified problems. Two subjects suffering from diabetes, 1 diagnosed with type 1 (male, age 57 years) and 1 with type 2 (male, age 60 years), were recruited from the author's personal environment for the study. They also contributed to the requirements analysis. Diagnosed 12 years ago and 8 years ago, respectively, both test persons already have some years of experience with living with the disease. Additionally, 4 persons who are not diagnosed with diabetes were included in the study: 2 females, aged 73 and 38 years, and 2 males, aged 73 and 56 years, from the author's broader environment (friends and relatives of colleagues who were not involved in the app development). All test persons use their mobile phones daily. None of them had medical training. For the usability test, they were asked to use the app installed on a separate device so the test conditions would be the same for all participants. They had no time in advance to get familiar with the app. Instead, they had to complete the tasks with only a brief verbal introduction to the functionalities by the study coordinator.

The usability test comprises 81 tasks concerning the different functionalities of the app. For example, the test persons had to navigate to the monitoring screen and add a new appointment or remove it. Another task required manually entering measurement values such as weight or pulse or importing data from the glucometer. From the nutrition screen, the test persons manually entered carbohydrate values for their meals or scanned products to import the carbohydrate data into the app.

The number of trials per task was recorded (ie, how often the task had to be started to finish it-immediately, second try, more than 2 trials). Additionally, the number of clicks needed to fulfill each task was collected. For each task, we assessed the optimal number of clicks beforehand and compared this number to the measured values. The test persons were asked to think aloud when problems occurred. After participants completed the tasks, overall feedback on usability of the app was assessed with an 8-question questionnaire.

Even though the number of participants in the study was low, previous studies from the human-computer interface literature found that 80% of usability problems can be found with only 5 research subjects [15,16]. Turner et al [15] even claims that the most serious usability problems can be revealed with only 3 subjects. The problem space determines the estimated required sample size [11]. The tasks to be supported by GlucoMan are well defined, and the problem space is limited compared to other software systems. Thus, the 6 persons included in our study are expected to be sufficient to determine the main problems related to usability of the app.

Results

Requirements

Based on the requirements engineering, literature reviews, and interviews, we identified the following features to be implemented in GlucoMan:

• Patient can access personal medical data related to metabolism independently from time and location.

• Defined members of a patient's care team can view the measured values documented and shared by the patient regardless of time and location.

• Data such as glucose levels are transmitted automatically from measurement devices to the app.

• Patient can specify target rates as control measures for specific values and get immediate feedback on the last added measurement value relating to a defined target range.

Architecture and System Functionalities

All collected data is made available to selected physicians and researchers when the patient provides access rights. The app connects to nutrition and medication Web services for carbohydrate and drug information (see section on technological resources). Data from medical devices are collected via Bluetooth. The concept underlying GlucoMan comprises a mobile phone app, data collection from medical devices or gadgets, and data storage (see Figure 1; the following numbers in the descriptions pertain to numbers in the figure).

To add new measurement values, Bluetooth-capable devices can be connected to the app (1). Upon data request, the actual measurements are imported to GlucoMan (2). In the current prototype, the glucose meter MyGlucoHealth is integrated as an example. Other devices can be added easily. Food names or data on nutrition (3) can be entered manually by the patient, and barcodes on food labels can be scanned. Current medication names (5) can be added manually or the drug barcode can be scanned by the patient. The scanned or entered products are searched in the drug or food databases, and relevant parameters are stored. For food items, information on carbohydrates (4) is retrieved, and for medications, article details such as product number and images (6) are retrieved. All collected and relevant data are uploaded to the personal account of the patient on the MIDATA platform (7).

The data exchange between GlucoMan and the platform MIDATA is realized using the Health Level Seven International (HL7) Fast Healthcare Interoperability Resources (FHIR) standard. This standard is based on resources, so-called observations, which are formatted in JavaScript Object Notation. Due the multiply encrypted data, MIDATA ensures a high safety standard, which is indispensable for personal medical data. The encryption of the key guarantees that the data are exclusively controlled by the owner. Without the key, the data can no longer be decrypted and are thus lost. Additional health data servers can be integrated easily as data sources via Bluetooth (8). From the MIDATA server, GlucoMan can retrieve relevant data for visualization (12). The data collected by the app and transferred to the MIDATA server can be made available by the patient for anonymized use in studies (9) or for monitoring purposes by the personal health care team (10). With the authorization of the patient, physicians are able to upload additional data like diagnoses, treatment, and personal notes to the account of a patient (11), which can be imported to GlucoMan where the patient can access it (12). GlucoMan shows all stored data aggregated in graph-like representations. The app allows specifying a measurement scheme comprising ranges for specific types of values and provides emergency support for persons who find a diabetic person in a situation of low blood sugar, advice for traveling with diabetes and on diabetes self-management, measurement values for HbA 1c , blood pressure, and weight as measured in the monthly or bimonthly checkups. Different types of measured values such as blood sugar, blood pressure, pulse, and weight can be uploaded via Bluetooth (Figure 2). Information on nutrition and medication can be entered to enable monitoring ( Figure 2). The app provides the functionality to import the carbohydrate value by scanning the bar code of a product to retrieve nutritional values from food databases. If the database also contains the information on portion size, it is imported instead of the normal 100 g portion data. Before data are saved, the nutrition description, portion size (in grams), and carbohydrates (in grams) are displayed in an alert so that the user can still make changes. All measured values are visualized in an intuitive manner, enabling a user to monitor the changes in values. The different colors in the nutrition visualization represent the time of day. The size of the bar is determined by the number of carbohydrates (Figure 2). In order to record medication data, 4 types of medications are distinguished to enable a better overview: prescription medications, over-the-counter medications and supplements, insulin, and drug allergies. New drugs can be added by scanning the product bar code.

Usability Study Outcomes

In general, the app has been rated as easy to use by the 6 subjects. The descriptions of buttons were understandable. Some interactive functionalities were not recognized: checkboxes that could be selected or that a further view could be obtained by swiping. Surprisingly, the 2 oldest study participants (aged 73 years) had no problems identifying the swiping to change the view.

Most of the features were instantly recognized and completed in the desired number of clicks. Five out of 6 test persons managed to complete the majority of tasks in 1 trial. One test person completed 8 tasks in 3 trials, 15 tasks in 2 trials, and the other tasks in 1 trial. For tasks related to adapting the visualizations or defining ranges for values, more than the expected number of clicks were made. The reason was that the desired functionality was captured in the Options menu which was hard to find. The test persons desired explanations on the possible options that could be adapted in the app (eg, changing the measurement schema) and mentioned that it would be helpful to get more obvious hints when pages can be swiped. The 2 oldest test persons requested a larger font size and larger checkboxes.

The 4 test persons who did not have diabetes were impressed with the possibilities of the app and in particular liked that the information was provided in a clear manner and no irrelevant data were presented or collected.

The 2 test persons with diabetes had different types and considered certain functions more or less relevant and evaluated them differently. In the case of type 1 diabetes, several blood glucose measurements have to be made per day. This requires monitoring the measured values more often than with type 2 diabetes, where glucose is measured only 1 or 2 times daily.

The test person with type 2 diabetes stated that he would use the app in future if the diet in his therapy gains in importance. This person considers the data import by Bluetooth or barcode very practical.

The test person with type 1 diabetes currently measures his blood glucose level with a continuous measuring device. In order for the app to be used by him, a connection of his current measuring device needs to be enabled to import the values. In general, he considers the barcode detection a very helpful option. It would be beneficial if not only carbohydrates of ready-made meals could be calculated and recorded because this test person normally eats self-cooked food or in a restaurant.

Discussion

Principal Findings

The purpose of the proposed app GlucoMan is to relieve the patient from the duty of entering or manually documenting measured data for monitoring purposes and provide a user-friendly overview of available measurements. In this way, the patient is put into the position of managing and monitoring his or her diabetes-the patient is empowered to understand the disease. The data collection feature was confirmed to be useful by the person with type 1 diabetes; he currently has to record such values manually in the diabetes diary.

GlucoMan stores the data on the MIDATA IT platform. For further use of the stored data, it is possible to authorize other users of the platform to access the data or open it for use in studies. For example, researchers can use the data for finding hidden patterns in the diabetes data of a larger population. In this way, scientists can have access to anonymized data of a large population in the future. The treating physician with an account on MIDATA can inspect the recorded measurements and add treatment-and diagnosis-relevant data regardless of location and time.

By scanning the barcode of a food product or drug, the patient can obtain additional information on carbohydrates or medication doses. Data entry is simple and easy to use with the barcode scanner. Bluetooth-connected measurement devices transfer data directly to the system without any media break.

Comparison With Prior Work

Functionalities of existing diabetes apps vary. Hood et al [17] distinguished apps that support monitoring tasks (diabetes-specific self-management tasks, weight and blood pressure tracking) from those that have educational purposes. Few apps provide personalized feedback or content. Most apps are equipped with glucose tracking, calorie counting, activity tracking, and education. Lithgow et al [9] found out that collecting data directly from a glucose meter is a feature missing [9] or supported only by a few apps [8]. Our app addresses this limitation.

Measurement devices normally support uploading values to the user's account. Often, this data can neither be used from these platforms by external parties nor easily analyzed by a physician. Furthermore, existing diabetes management apps support data-sharing only in social networks or by export via email. By storing data on MIDATA, the patient remains the owner of his data and can provide access rights to selected physicians or even offer the data to clinical studies. This is in contrast to portals from hardware providers such as Whitings or Fitbit that store the data on proprietary platforms without giving any rights to the patient. Storing data on MIDATA can be recognized as a first step toward an electronic health record that integrates clinical and personal health data. All treating physicians can access the personal health data of a patient. This is a unique feature compared to existing apps. Additionally, no other app could be identified that uses HL7 FHIR for data transmission even though it is obvious that the use of standards is important for achieving interoperability and data reuse.

Whereas several Bluetooth and Internet of Things measuring devices already on the market for common vital signs like blood pressure, pulse, and weight give access on the measured data, many manufacturers of blood glucose meters are implementing proprietary protocols. For this reason, it is impossible for third-party systems to access or process the data. Our concept allows easily integrating data from gadgets or medical devices when accessible data protocols are provided. A future extension of the app would be the integration of an insulin pen such as inPen (Companion Medical) which would enable the person to also track insulin doses.

The open question for our app and also for many other available systems is the usefulness for patients in managing their diabetes. Studies by Hou et al [18] showed that mobile phone apps have the potential to improve glycemic control in the self-management of diabetes. However, they also concluded that younger patients were more likely to benefit from the app use. Additionally, a randomized controlled trial by Quinn et al [19] found that traditional intervention methods could not provide adequate blood glucose control, but a mobile diabetes intervention method improved clinical outcomes. The US Food and Drug Administration has approved some apps for diabetes management. This shows that apps can be useful in this context. Jo et al [20] tested the app Healthy-note with patients and found out that effective support can be achieved when the app provides suggestions for lifestyle adaptations and helps in monitoring those. According to their results, interaction with the patient is important for setting goals and providing continuous encouragement. Through the specification of ranges for the values in GlucoMan, a patient is enabled to set goals for specific measurement values. Including features for encouraging a patient to work toward achieving the goals is still open for future work.

Limitations

The user study involved 2 persons diagnosed with diabetes and 4 persons not diagnosed with diabetes. The latter could judge and test the functionalities but not the relevance of the app for diabetes management. However, we were able to identify main usability problems during the tests. Even though we involved the national diabetes association, it was not possible to recruit more patients in the short time available for this project. Even though the test persons were recruited from the personal environment of the authors, we are convinced that this does not affect the results of the usability study; the test persons completed defined tasks and number of clicks were counted, which is an objective measure. A comprehensive clinical study for testing the impact of GlucoMan on the self-management capacity and studying the usability of the system is currently planned.

Even though the concept enables data access by physicians, a corresponding user interface or data integration with existing information systems was not implemented as part of this work. This remains open for future work. We developed the connection to one specific glucose meter. To connect another medical device to the app, technical documentation needs to be available for the device that provides details on data requests and corresponding responses. For using the app in other countries than Switzerland, the underlying drug database would need to be changed. The hospINDEX only allows recognizing drugs that are approved on the Swiss market.

Currently, GlucoMan only enables entering data from products that have a barcode or where the patient enters the carbohydrates manually. A future extension is the integration of the GoCARB [21], a mobile system that allows taking a photo from a plate with food and calculates the carbohydrates automatically. This would clearly simplify the collection process for self-cooked meals.

Conclusion

Collection of data on a patient's metabolism can be supported with a multifunctional app such as GlucoMan. Besides monitoring, continuous data can be documented and made available to the treating physician. GlucoMan allows patients to monitor disease-relevant parameters and decide who accesses their health data. In this way, patients are empowered not only to manage diabetes but also to manage their health data.

Figure 1 .
1Concept and functionalities of the mobile app GlucoMan.

Figure 2 .
2Left: GlucoMan screen showing glucose and blood pressure readings. Right: GlucoMan nutrition overview. Carbohydrates per meal are shown graphically and in a table for 3 continuous days.
JMIR Diabetes 2018 | vol. 3 | iss. 1 | e6 | p.2 http://diabetes.jmir.org/2018/1/e6/ (page number not for citation purposes)
JMIR Diabetes 2018 | vol. 3 | iss. 1 | e6 | p.3 http://diabetes.jmir.org/2018/1/e6/ (page number not for citation purposes)
JMIR Diabetes 2018 | vol. 3 | iss. 1 | e6 | p.4 http://diabetes.jmir.org/2018/1/e6/ (page number not for citation purposes)
JMIR Diabetes 2018 | vol. 3 | iss. 1 | e6 | p.5 http://diabetes.jmir.org/2018/1/e6/ (page number not for citation purposes)
JMIR Diabetes 2018 | vol. 3 | iss. 1 | e6 | p.6 http://diabetes.jmir.org/2018/1/e6/ (page number not for citation purposes)
JMIR Diabetes 2018 | vol. 3 | iss. 1 | e6 | p.7 http://diabetes.jmir.org/2018/1/e6/ (page number not for citation purposes)
JMIR Diabetes 2018 | vol. 3 | iss. 1 | e6 | p.8 http://diabetes.jmir.org/2018/1/e6/ (page number not for citation purposes)
AcknowledgmentsThis work was realized within the project Hospital of the Future Live (Spital der Zukunft Live) led in conjunction with GS1 Switzerland.Conflicts of InterestNone declared.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Diabetes, is properly cited. The complete bibliographic information, a link to the original publication on http://diabetes.jmir.org/, as well as this copyright and license information must be included.
2017-06-04International Diabetes Federation Diabetes Atlas. 8th Edition. WebCite Cache ID 6qxyuQsxmInternational Diabetes Federation Diabetes Atlas, 8th Edition. URL: http://www.diabetesatlas.org/across-the-globe.html [accessed 2017-06-04] [WebCite Cache ID 6qxyuQsxm]

American Diabetes Association standards of medical care in diabetes 2017. P H Marathe, H X Gao, K L Close, 10.1111/1753-0407.12524J Diabetes. 94Medline: 28070960Marathe PH, Gao HX, Close KL. American Diabetes Association standards of medical care in diabetes 2017. J Diabetes 2017 Apr;9(4):320-324. [doi: 10.1111/1753-0407.12524] [Medline: 28070960]

Efficiency and cost effectiveness of the chronic care models URL. C Steurer-Stey, ffffffff-b66f-0448-0000-00005cc3b48c/review_CCM_effekt_cost02februar2010.pdf [accessed 2018-02-01WebCite Cache ID 6wv7m39UTSteurer-Stey C. Efficiency and cost effectiveness of the chronic care models URL: http://www.hausarztmedizin.uzh.ch/ dam/jcr:ffffffff-b66f-0448-0000-00005cc3b48c/review_CCM_effekt_cost02februar2010.pdf [accessed 2018-02-01] [WebCite Cache ID 6wv7m39UT]

Chronic care model: an evidence-based approach to caring for people with chronic disease. C Steurer-Stey, T Rosemann, 10.1024/1661-8157/a000123Praxis. 9911Medline: 20506090Steurer-Stey C, Rosemann T. Chronic care model: an evidence-based approach to caring for people with chronic disease. Praxis 2010 May 26;99(11):655-659. [doi: 10.1024/1661-8157/a000123] [Medline: 20506090]

Mobile phone and smartphone technologies for diabetes care and self-management. L F Garabedian, D Ross-Degnan, J F Wharam, 10.1007/s11892-015-0680-8Economics Research Program. Research 2 Guidance mHealth app developer economics 2015: the current status and trends of the mHealth app market URL. 15109accessed 2018-02-01. WebCite Cache ID 6wv7xfgcIGarabedian LF, Ross-Degnan D, Wharam JF. Mobile phone and smartphone technologies for diabetes care and self-management. Curr Diab Rep 2015 Dec;15(12):109. [doi: 10.1007/s11892-015-0680-8] [Medline: 26458380] 6. mHealth Economics Research Program. Research 2 Guidance mHealth app developer economics 2015: the current status and trends of the mHealth app market URL: http://research2guidance.com/r2g/r2g-mHealth-App-Developer-Economics-2015. pdf [accessed 2018-02-01] [WebCite Cache ID 6wv7xfgcI]

. Mysugr, Url, 2017-06-02WebCite Cache ID 6qv9IH0WnMySugr. URL: https://mysugr.com/de/ [accessed 2017-06-02] [WebCite Cache ID 6qv9IH0Wn]

DiaFit: the development of a smart app for patients with type 2 diabetes and obesity. F Modave, J Bian, E Rosenberg, T Mendoza, Z Liang, R Bhosale, 10.2196/diabetes.6662JMIR Diabetes. 125Modave F, Bian J, Rosenberg E, Mendoza T, Liang Z, Bhosale R, et al. DiaFit: the development of a smart app for patients with type 2 diabetes and obesity. JMIR Diabetes 2016 Dec 13;1(2):e5. [doi: 10.2196/diabetes.6662]

Smartphone app use for diabetes management: evaluating patient perspectives. K Lithgow, A Edwards, D Rabi, 10.2196/diabetes.6643JMIR Diabetes. 212Lithgow K, Edwards A, Rabi D. Smartphone app use for diabetes management: evaluating patient perspectives. JMIR Diabetes 2017 Jan 23;2(1):e2. [doi: 10.2196/diabetes.6643]

Popular glucose tracking apps and use of mHealth by Latinos with diabetes: review. J P Williams, D Schroeder, 10.2196/mhealth.3986JMIR Mhealth Uhealth. 3384FREE Full text. Medline: 26307533Williams JP, Schroeder D. Popular glucose tracking apps and use of mHealth by Latinos with diabetes: review. JMIR Mhealth Uhealth 2015;3(3):e84 [FREE Full text] [doi: 10.2196/mhealth.3986] [Medline: 26307533]

Mobile applications for diabetics: a systematic review and expert-based usability evaluation considering the special requirements of diabetes patients age 50 years or older. M Arnhold, M Quade, W Kirch, 10.2196/jmir.2968J Med Internet Res. 164104FREE Full text. Medline: 24718852Arnhold M, Quade M, Kirch W. Mobile applications for diabetics: a systematic review and expert-based usability evaluation considering the special requirements of diabetes patients age 50 years or older. J Med Internet Res 2014;16(4):e104 [FREE Full text] [doi: 10.2196/jmir.2968] [Medline: 24718852]

Integrated care processes designed for the future healthcare system. T Bürkle, K Denecke, M Lehmann, E Zetz, J Holm, Stud Health Technol Inform. 245Medline: 29295044Bürkle T, Denecke K, Lehmann M, Zetz E, Holm J. Integrated care processes designed for the future healthcare system. Stud Health Technol Inform 2017;245:20-24. [Medline: 29295044]

. Midata Cooperative, 2018-02-01WebCite Cache ID 6wv8TizLlMIDATA Cooperative. URL: https://www.midata.coop/ [accessed 2018-02-01] [WebCite Cache ID 6wv8TizLl]

2018-02-01MIDATA developer guide. WebCite Cache ID 6wv8aCr4zMIDATA developer guide. URL: https://test.midata.coop/ [accessed 2018-02-01] [WebCite Cache ID 6wv8aCr4z]

Determining usability test sample size. C Turner, J Lewis, J Nielsen, International Encyclopedia of Ergonomics and Human Factors. Karwowski WBoca RatonCRC PressTurner C, Lewis J, Nielsen J. Determining usability test sample size. In: Karwowski W, editor. International Encyclopedia of Ergonomics and Human Factors. Boca Raton: CRC Press; 2006:3084-3088.

Sample sizes for usability tests. Interactions. J R Lewis, 10.1145/1167948.116797313Lewis JR. Sample sizes for usability tests. Interactions 2006 Nov 01;13(6):29-33. [doi: 10.1145/1167948.1167973]

What do we know about mobile applications for diabetes self-management? A review of reviews. M Hood, R Wilson, J Corsica, L Bradley, D Chirinos, A Vivo, 10.1007/s10865-016-9765-3J Behav Med. 396Medline: 27412774Hood M, Wilson R, Corsica J, Bradley L, Chirinos D, Vivo A. What do we know about mobile applications for diabetes self-management? A review of reviews. J Behav Med 2016 Dec;39(6):981-994. [doi: 10.1007/s10865-016-9765-3] [Medline: 27412774]

Do mobile phone applications improve glycemic control (HbA1c) in the self-management of diabetes? A systematic review, meta-analysis, and GRADE of 14 randomized trials. C Hou, B Carter, J Hewitt, T Francisa, S Mayor, 10.2337/dc16-0346Diabetes Care. 3911Medline: 27926892Hou C, Carter B, Hewitt J, Francisa T, Mayor S. Do mobile phone applications improve glycemic control (HbA1c) in the self-management of diabetes? A systematic review, meta-analysis, and GRADE of 14 randomized trials. Diabetes Care 2016 Nov;39(11):2089-2095. [doi: 10.2337/dc16-0346] [Medline: 27926892]

Cluster-randomized trial of a mobile phone personalized behavioral intervention for blood glucose control. C C Quinn, M D Shardell, M L Terrin, E A Barr, S H Ballew, A L Gruber-Baldini, 10.2337/dc11-0366Diabetes Care. 349FREE Full text. Medline: 21788632Quinn CC, Shardell MD, Terrin ML, Barr EA, Ballew SH, Gruber-Baldini AL. Cluster-randomized trial of a mobile phone personalized behavioral intervention for blood glucose control. Diabetes Care 2011 Sep;34(9):1934-1942 [FREE Full text] [doi: 10.2337/dc11-0366] [Medline: 21788632]

Diabetes management via a mobile application: a case report. I Jo, S Yoo, D Y Lee, C Park, E M Kim, 10.7762/cnr.2017.6.1.61Clin Nutr Res. 61FREE Full text. Medline: 28168183Jo I, Yoo S, Lee DY, Park C, Kim EM. Diabetes management via a mobile application: a case report. Clin Nutr Res 2017 Jan;6(1):61-67 [FREE Full text] [doi: 10.7762/cnr.2017.6.1.61] [Medline: 28168183]

Computer vision-based carbohydrate estimation for type 1 patients with diabetes using smartphones. M Anthimopoulos, J Dehais, S Shevchik, B H Ransford, D Duke, P Diem, 10.1177/1932296815580159J Diabetes Sci Technol. 93FREE Full text. Medline: 25883163Anthimopoulos M, Dehais J, Shevchik S, Ransford BH, Duke D, Diem P, et al. Computer vision-based carbohydrate estimation for type 1 patients with diabetes using smartphones. J Diabetes Sci Technol 2015 May;9(3):507-515 [FREE Full text] [doi: 10.1177/1932296815580159] [Medline: 25883163]