Evaluation of general practice computer templates. Lessons from a pilot randomised controlled trial. What factors are associated with the integration of evidence retrieval technology into routine general practice settings? Cluster randomized controlled trial of the effectiveness of audit and feedback and educational outreach on improving nursing practice and patient outcomes. Pragmatic randomised trial to evaluate the use of patient held records for the continuing care of patients with cancer. A randomized evaluation of a computer-based nursing documentation system. Educational workshop improved information-seeking skills, knowledge, attitudes and the search outcome of hospital clinicians: a randomised controlled trial.
We conducted a pilot randomised trial of computerised templates for the management of asthma and diabetes in general practice in six general practices in North London. Uptake of the guidelines by general practitioners and practice nurses was assessed using qualitative (semi-structured interviews designed to assess the users' views) and quantitative (change in use of the template during the study period) outcome measures. The practice nurses used the templates frequently but general practitioners rarely used them. Several reasons were offered for non-use of the templates, such as the length of the template and non-involvement in the care of asthma or diabetes. Despite this, however, health professionals were favourably disposed to the use of templates for general clinical care. Pilot investigations of computerised templates are best achieved by observational or quasi-experimental methods rather than a randomised controlled trial. The use of both qualitative and quantitative methods in this study allowed exploration of the barriers to use of computers. Information retrieval systems have the potential to improve patient care but little is known about the variables which influence clinicians' uptake and use of systems in routine work.
                To determine which factors influenced use of an online evidence retrieval system.
                Computer logs and pre- and post-system survey analysis of a 4-week clinical trial of the Quick Clinical online evidence system involving 227 general practitioners across Australia.
                Online evidence use was not linked to general practice training or clinical experience but female clinicians conducted more searches than their male counterparts (mean use=14.38 searches, S.D.=11.68 versus mean use=8.50 searches, S.D.=9.99; t=2.67, d.f.=157, P=0.008). Practice characteristics such as hours worked, type and geographic location of clinic were not associated with search activity. Information seeking was also not related to participants' perceived information needs, computer skills, training nor Internet connection speed. Clinicians who reported direct improvements in patient care as a result of system use had significantly higher rates of system use than other users (mean use=12.55 searches, S.D.=13.18 versus mean use=8.15 searches, S.D.=9.18; t=2.322, d.f.=154 P=0.022). Comparison of participants' views pre- and post- the trial, showed that post-trial clinicians expressed more positive views about searching for information during a consultation (chi(2)=27.40, d.f.=4, P< or =0.001) and a significantly greater number reported seeking information between consultations as a result of having access to an online evidence system in their consulting rooms (chi(2)=9.818, d.f.=2, P=0.010).
                Clinicians' use of an online evidence system was directly related to their reported experiences of improvements in patient care. Post-trial clinicians positively changed their views about having time to search for information and pursued more questions during clinic hours. Current understanding of implementation methods is limited, and research has focused on changing doctors' behaviors.
                Our aim was to evaluate the impact of audit and feedback and educational outreach in improving nursing practice and patient outcomes.
                Using a factorial design, cluster randomized controlled trial, we evaluated 194 community nurses in 157 family practices and 1078 patients with diagnosis of urinary incontinence (UI) for nurses compliance with evidence-linked review criteria for the assessment and management of UI and impact on psychologic and social well-being and symptoms. In the outreach arms, nurses' self-reported barriers informed development of tailored strategies.
                In comparison with educational materials alone, the implementation methods tested did not improve care at 6 months follow-up. Moderate rates of improvement (10-17% of patients) in performance for the assessment of UI and greater rates of improvement (20-30% of patients) for the management of care were found but effects were similar across arms. Improvement in patient outcomes was more consistently positive for educational outreach than for audit and feedback but differences were not significant. Adjustment for caseload size, severity or duration of UI and patients' age did not alter results.
                Printed educational materials alone may be as effective as audit and feedback and educational outreach in improving nurses' performance and outcomes of care for people with UI. Greater understanding of the underlying processes in improving performance within multidisciplinary teams through further, theory-driven studies with "no intervention" control groups and longer follow-up are needed. To evaluate the use of a multidisciplinary record held by patients with cancer in the community.
                Pragmatic randomised controlled trial.
                The environs of Swansea in south west Wales.
                501 patients under the care of the Department of Oncology, Singleton Hospital, Swansea.
                A patient held record used by the patient and healthcare professionals. Main outcome measures-Health related quality of life (EORTC QLQ-C30) measured at entry into the study and at 6 months; patients' views at 6 months; healthcare professionals' views collected after the completion of patient follow up; NHS resource and booklet use.
                1148 patients were eligible for the study; 501 were recruited (44%) and 344 completed the study (172 in each group). There was no significant difference between the two groups in change in quality of life or NHS resource use. The patient held record did not have an impact on communication but was significantly helpful to patients in preparing for appointments, reducing difficulties in monitoring their own progress, and helping them to feel more in control (p<0.05). Fifty three percent of patients would have preferred not to have a patient held record. There was a low level of use of the record by healthcare professionals but most of those who remembered using it indicated that they would prefer patients to have it.
                The patient held record is valued by some patients and professionals but has no significant impact on the quality of life of patients or NHS resource use. It has a positive impact on quality by helping patients feel more in control and prepare for meetings with healthcare staff. Patients who find it useful tend to be younger and have more professionals involved in their care. It is recommended that it should be made available to patients on request and used by them according to need. A two-month randomized, controlled trial based on 60 patients has been performed on a ward of the Department of Psychiatry at Heidelberg University Medical Center, Germany, to investigate the influence of computer-based nursing documentation on time investment for documentation, quality of documentation and user acceptance. Time measurements, questionnaires, documentation analysis and interviews were used to compare patients documented with the computer-based system (PIK group) with the control group (patients documented with the paper-based system). The results showed the advantages and disadvantages of computer-based nursing documentation. Time needed for nursing care planning was lower in the PIK group. Some formal aspects of quality were considerably better in the PIK group. On the other hand, time required for documentation of tasks and for report writing was greater in the PIK group. User acceptance increased significantly during the study. The interviews indicated a positive influence of PIK on the cooperation between nurses and physicians. A double-blind randomised controlled trial was conducted on a group of Hong Kong hospital clinicians. The objective was to test if a three-hour educational workshop (with supervised hands-on practice) is more effective (than no training) to improve clinical question formulation, information-seeking skills, knowledge, attitudes, and search outcomes. The design was a post-test-only control group; recruitment by stratified randomization (by profession), blocked at 800. End-user training was more effective than no training in improving clinical question formulation, in raising awareness, knowledge, confidence and use of databases, but had made no impact on preference for secondary databases. It changed the attitude of clinicians to become more positive towards the use of electronic information services (EIS). Participants had higher search performance and outcomes (satisfaction with information obtained (NNT = 3), EIS satisfaction (NNT = 3) and success in problem solving (NNT = 4)). The workshop improved knowledge and skills in evidence-based searching, but this effect gradually eroded with time. Search logs confirmed that follow-up is required if effects are to be sustained. Longer effects on search behaviours appear to be positive. A randomised controlled trial is valuable in identifying cause-and-effect relations and to quantify the magnitude of the effects for management decision-making.
We found some limited evidence of effects on practice attributable to changes in record systems. It is clear from the literature that it is possible to set up the randomised trials or other quasi-experimental designs needed to produce evidence for practice. Qualitative nursing research to explore the relationship between practice and information use could be used as a precursor to the design and testing of nursing information systems.