Paola Rebora,Carlo Alberto Scirè,Giuseppe Occhino,Francesco Bortolan,Olivia Leoni,Francesco Cideni,Alberto Zucchelli,Emanuele Focà,Alessandra Marengoni,Giuseppe Bellelli,Maria Grazia Valsecchi
Development and validation of an electronic database-based frailty index to predict mortality and hospitalization in a population-based study of adults with SARS-CoV-2
care transitions,health services,public health,COVID-19,hospital,community
Background Electronic health databases are used to identify people at risk of poor outcomes. Using electronic regional health databases (e-RHD), we aimed to develop and validate a frailty index (FI), compare it with a clinically based FI, and assess its association with health outcomes in community-dwellers with SARS-CoV-2. Methods Data retrieved from the Lombardy e-RHD were used to develop a 40-item FI (e-RHD-FI) in adults (i.e., aged ≥18 years) with a positive nasopharyngeal swab polymerase chain reaction test for SARS-CoV-2 by May 20, 2021. The considered deficits referred to the health status before SARS-CoV-2. The e-RHD-FI was validated against a clinically based FI (c-FI) obtained from a cohort of people hospitalized with COVID-19 and in-hospital mortality was evaluated. e-RHD-FI performance was evaluated to predict 30-day mortality, hospitalization, and 60-day COVID-19 WHO clinical progression scale, in Regional Health System beneficiaries with SARS-CoV-2. Results We calculated the e-RHD-FI in 689,197 adults (51.9% females, median age 52 years). On the clinical cohort, e-RHD-FI correlated with c-FI and was significantly associated with in-hospital mortality. In a multivariable Cox model, adjusted for confounders, each 0.1-point increment of e-RHD-FI was associated with increased 30-day mortality (Hazard Ratio, HR 1.45, 99% Confidence Intervals, CI: 1.42–1.47), 30-day hospitalization (HR per 0.1-point increment = 1.47, 99%CI: 1.46–1.49), and WHO clinical progression scale (Odds Ratio = 1.84 of deteriorating by one category, 99%CI 1.80–1.87). Conclusion The e-RHD-FI can predict 30-day mortality, 30-day hospitalization, and WHO clinical progression scale in a large population of community-dwellers with SARS-CoV-2 test positivity. Our findings support the need to assess frailty with e-RHD.
Development and validation of an electronic database-based frailty index to predict mortality and hospitalization in a population-based study of adults with SARS-CoV-2

Electronic health databases are used to identify people at risk of poor outcomes. Using electronic regional health databases (e-RHD), we aimed to develop and validate a frailty index (FI), compare it with a clinically based FI, and assess its association with health outcomes in community-dwellers with SARS-CoV-2.

Data retrieved from the Lombardy e-RHD were used to develop a 40-item FI (e-RHD-FI) in adults (i.e., aged ≥18 years) with a positive nasopharyngeal swab polymerase chain reaction test for SARS-CoV-2 by May 20, 2021. The considered deficits referred to the health status before SARS-CoV-2. The e-RHD-FI was validated against a clinically based FI (c-FI) obtained from a cohort of people hospitalized with COVID-19 and in-hospital mortality was evaluated. e-RHD-FI performance was evaluated to predict 30-day mortality, hospitalization, and 60-day COVID-19 WHO clinical progression scale, in Regional Health System beneficiaries with SARS-CoV-2.

We calculated the e-RHD-FI in 689,197 adults (51.9% females, median age 52 years). On the clinical cohort, e-RHD-FI correlated with c-FI and was significantly associated with in-hospital mortality. In a multivariable Cox model, adjusted for confounders, each 0.1-point increment of e-RHD-FI was associated with increased 30-day mortality (Hazard Ratio, HR 1.45, 99% Confidence Intervals, CI: 1.42–1.47), 30-day hospitalization (HR per 0.1-point increment = 1.47, 99%CI: 1.46–1.49), and WHO clinical progression scale (Odds Ratio = 1.84 of deteriorating by one category, 99%CI 1.80–1.87).

The e-RHD-FI can predict 30-day mortality, 30-day hospitalization, and WHO clinical progression scale in a large population of community-dwellers with SARS-CoV-2 test positivity. Our findings support the need to assess frailty with e-RHD.

The unprecedented burden on healthcare systems caused by the coronavirus disease 2019 (COVID-19) pandemic has highlighted the need for tools to assist decision-makers in planning resource allocation. Since the first wave of the pandemic, healthcare providers have focused on the need to promptly identifying risk factors for COVID-associated severe disease and death (1). Age and comorbidity have been widely adopted as the main, if not the only, criteria to allocate healthcare resources and stratify care levels in affected individuals (2, 3). However, these parameters do not fully capture the biological heterogeneity of individual health trajectories, especially in older patients. Indeed, there is significant variability in socio-economic, functional, and cognitive status across individuals, as well as in lifestyle habits. Frailty is a clinical syndrome that can be defined as a decline in body functions and physiological reserves, resulting in increased vulnerability and reduced resilience to physical and mental stressors, ultimately leading to an increased risk of negative health outcomes (4). Several studies have shown that frailty is useful to detect the heterogeneity in risk among people of the same chronological age (5, 6), including middle-aged individuals (7–9). Frailty can also predict survival, even in the absence of comorbidity (7, 10). Based on this evidence, international guidelines recommend frailty screening in order to stratify patients according to their risk of poor outcomes (11, 12). Furthermore, screening for frailty at the population level is appropriate to identify those who would benefit from a comprehensive geriatric assessment (CGA). CGA can provide the basis for a coordinated and integrated intervention to maximize the overall health status of the individual (13). Among the available operationalizations of frailty, the so-called Frailty Index (FI), proposed by Rockwood and colleagues, is one of the most used (14). The FI measures the accumulation of health deficits (i.e., clinical signs, symptoms, diseases, and disabilities) that tend to increase with aging. The FI is obtained by calculating the ratio between the number of deficits observed in a person and the total number of deficits considered for its computation (15, 16). In several studies, FI was associated with increased mortality risk in both hospitalized (6, 17–21) and community-dwelling COVID-19 patients (22). However, few studies have used an automated FI, based on routine collection of administrative community health data (23, 24), and none used a similar approach during the COVID-19 pandemic. In this context, electronic regional health databases (e-RHDs) represent an important resource. E-RHDs could identify people at higher risk for severe outcome or death, even when detailed information, usually collected in clinical studies, is not available. Therefore, we undertook this study with the following objectives: To identify health deficits in adult beneficiaries of the Lombardy Regional Health System, using an e-RHD. To develop and validate a frailty index based on an e-RHD (e-RHD-FI). To assess whether e-RHD-FI is an adequate source of information on frailty, compared to a clinically based frailty index (c-FI). To assess the association between e-RHD-FI and adverse health outcomes in adult beneficiaries of the Lombardy Regional Health System with SARS-CoV2.

Patients who had a positive nasopharyngeal swab polymerase chain reaction (PCR) test for SARS-CoV-2 by May 20, 2021 (n = 821,475) were extracted from the Lombardy region COVID-19 database. Patients aged 18 years and older who were beneficiaries of the Lombardy Regional Health system on December 31, 2019 (n = 689,197, in the Supplementary Figure S2) were selected for the analyses. Fully anonymized patient data were retrieved from the database, from routine physician visits between 2017 and 2021. The following variables were included: demographics, outpatient care, inpatient care, emergency healthcare and transports, primary care, delivery of assistive products for people with disability, mental illness care, home care services, residential care, drug prescriptions, exemptions (available since 2010), and mortality. Data were collected on exemptions from healthcare payments for selected conditions.

Health deficits and determinants were retrieved by cross-referencing the different data sources in the e-RHD. Health deficits were defined as symptoms, signs, disabilities, and diseases, covering a range of systems and domains (i.e., Physical, Mental and Social). Chronic diseases were derived from the algorithm used for the management of chronic patients in Lombardy (25, 26). The co-payment exemptions database, Integrated Home Assistance, and Intermediate Assistance Observation Sheet datasets were evaluated to obtain a proxy for socio-economic status and to identify nursing home residents. Physical disabilities were retrieved from exemptions, Integrated Home Assistance, and prosthesis delivery service. Mental illness data were used to assess the mental domain (27, 28). The algorithms used to select these variables were based on previously published studies (23, 24) and were validated in the community. Full details on data source structure, health deficits and determinants, and algorithm development are reported in Supplementary material, Frailty index derivation on Regional Healthcare Databases section.

The Electronic-regional healthcare database frailty index (e-RHD-FI) was developed according to Rockwood’s model (16, 29) in adult beneficiaries of the Lombardy Regional Health System who had a positive nasopharyngeal swab PCR test for SARS-CoV-2. Health deficits and determinants were assessed prior to the COVID-19 diagnosis. The date of positivity at the nasopharyngeal swab test for SARS-CoV-2 was used as the index date. We applied a variable recall period of 1 to 10 years, according to different types of health deficits and determinants (see Supplementary Tables S1, S2 for more details). For each patient, a 40-items e-RHD-FI was calculated as the ratio between the sum of the observed health deficits and determinants and the total number of health deficits and determinants included in the index (theoretical range 0–1). All deficits contributed to the index with 1 point, except income, which was classified into three categories: upper-middle/high income (no contribution to the index), lower-middle income (0.5 contribution), and low income (1 point contribution).

The FRACOVID study is an observational multicentre study which included 1,344 COVID-19 patients admitted to 2 hospitals in Lombardy (6). The study recorded 36 variables including sociodemographic, biological, and clinical data, symptoms, and disabilities. Data were collected on admission to two acute Geriatrics and two Infectious Diseases wards at Spedali Civili Hospital in Brescia and San Gerardo Hospital in Monza (6). A clinical frailty index (c-FI) was calculated in accordance with Rockwood’s model (16). Furthermore, the Clinical Frailty Scale (CFS) was also assessed (14). Both c-FI and CFS were significantly associated with in-hospital and 1-year mortality (6). Data from the FRACOVID study were used to validate the e-RHD.

This study was approved by the Brianza Institutional Review Board under the number 3356–07/08/2020.

To assess the concurrent criterion validity of the e-RHD-FI, we compared it with the c-FI and the CFS of patients included in the FRACOVID study (6). A probabilistic model was defined using information on sex, age at nasopharyngeal swab test positivity, and hospital records (dates of admission and discharge, mortality, and center) to link patients included in the FRACOVID study with their data from the e-RHD (30, 31). Further details on the model are available in Supplement (Probabilistic Matching section). Spearman’s correlation coefficient (rho) was used to test the correlation between e-RHD-FI, c-FI, and CSF. The performance of e-RHD-FI and c-FI for predicting in-hospital mortality was compared using the area under the Receiver Operating Characteristic (ROC) curve (AUC). The association between e-RHD-FI and in-hospital mortality was assessed in the matched dataset by a Cox regression model after adjustment for sex, age, and period of hospital admission.

Different end-points were evaluated: (i) 30-day mortality; (ii) 30-day hospitalization; (iii) a composite endpoint of 30-day mortality or hospitalization; (iv) an ordinal end-point based on the WHO clinical progression scale for COVID-19 at 60 days after SARS-CoV-2 test positivity (i.e., non-hospitalized, hospitalized, admitted to intensive care unit (ICU) or dead). Mortality was ascertained from death registers. Hospital and/or ICU admission were obtained from the COVID-19 database and from hospital discharge records. We randomly split the cohort into a training set (70%) and a validation set (30%). We identified the optimal cut-off using the Youden index on the ROC curve in the training set. In the validation set, we estimated the AUC of the ROC curve. Survival was estimated by the Kaplan–Meier method, and differences between groups defined according to the optimal cut-off were tested using the log-rank test. To categorize frailty in four groups, we used the identified cut-offs, along with two other cut-offs used in previous studies; namely 0.13 (which is the cut-off used in the FRACOVID study) (6) and 0.25 (which is the cut-off used in most non-COVID studies) (32, 33). The observation time started from the date of the positive SARS-CoV-2 swab. All patients were followed up until death, emigration/end of reception of regional assistance or June 19, 2021, whichever occurred first. For the 30-day hospitalization endpoint and the composite endpoint, the observation time stopped at the time of hospitalization. Cause-specific Cox proportional hazards regression models were used to investigate the association between e-RHD-FI and time to event (30-day mortality, 30-day hospitalization, and the composite of both). Ordinal logistic regression was used to test the association between the e-RHD-FI and the WHO clinical progression scale. Potential confounders were sex, age, and period of the diagnosis (before or after July 1, 2020). The prognostic ability of the e-RHD-FI was also assessed in population subgroups. Participants were stratified according to age class, calendar period (according to COVID-19 waves), and hospitalization (hospital admission or not). Hazard Ratios (HRs) or Odds ratios (ORs) with 99% confidence intervals (CIs) were reported. All analyses were performed using SAS version 9.4 (SAS Institute Inc., Cary, NC). The alpha error was set at 0.01 due to the large sample size (two-tailed).

A total of 689,197 adult beneficiaries of the Lombardy Regional Health System (357,495 females, 51.9%) were positive at a nasopharyngeal swab PCR test for SARS-CoV-2 by May 20, 2021 Supplementary Figure S2. The median age was 52 years (first-third quartile, 38–66) and the Charlson Comorbidity Index (CCI) (34) was 0 for 96% of the population. The health deficits and determinants included in the e-RHD-FI are reported in Table 1 along with their prevalence. The most frequent deficit/determinant was hypertension (156,560, 22.7%) followed by low income (116,097, 16.8%) and heart disease (90,655, 13.2%). The e-RHD-FI showed a typical asymmetric distribution (Figure 1) with a median of 0.02 (first-third quartile, 0–0.05).

We matched the e-RHD and the clinical data in the cohort of 1,173 patients (median age 68 years, first-third quartile, 56–79, 63.2% males) recruited in the FRACOVID study, observing good agreement (close to 80%, see Supplementary Table S3) between the variables of e-RHD-FI and c-FI. The overall agreement for hypertension was 78%. The variable “visual loss” had an overall agreement of 95%: among the 1,091 patients who did not report visual loss in the FRACOVID study, almost all (1,090, 99.9%) had no visual loss according to the e-RHD. Conversely, among the 65 patients who reported visual impairment in the FRACOVID study, only 5 (7.7%) had visual impairment according to e-RHD. The median e-RHD-FI was 0.06 (first-third quartile, 0.04–0.11), compared to a median c-FI of 0.09 (first-third quartile, 0.03–0.20). The e-RHD-FI showed a strong correlation with the c-FI (Figure 2A, Spearman rho 0.59, 95%CI: 0.55–0.63) with a trend toward lower values for the e-RHD-FI. The e-RHD-FI was associated with the CFS score (Figure 2B, Spearman rho 0.44, 95%CI: 0.39–0.49). Figure 2C compares the performance of e-RHD-FI and c-FI in predicting in-hospital mortality. The AUC for e-RHD-FI was 71.6% (99%CI: 66.4–76.8%), lower than c-FI (AUC = 79.6, 99%CI: 75.5–83.7%, Figure 2C). e-RHD-FI was associated with in-hospital mortality after adjustment for potential confounders, with a HR of 1.39 (99%CI, 1.09–1.78, Supplementary Table S4) per 0.1-point increment of e-RHD-FI, similar to the FRACOVID study (HR = 1.29, 95%CI: 1.16–1.43).

482,438 adults, of whom 20,392 (4.2%) died within 30 days of a positive result at the nasopharyngeal swab test, were included in the training set. The AUC for 30-day mortality was 87% (99%CI: 86.7–87.3%) for e-RHD-FI and 57.9% (99%CI: 57.6–58.2%) for CCI. E-RHD-FI performed better than CCI in predicting mortality in adults younger than 50 years (84, 99%CI: 86.7–87.3% for e-RHD-FI versus 59.9, 99%CI: 56.2–63.6% for CCI). The optimal e-RHD-FI cut-off for mortality prediction was 0.056, with a sensitivity of 81.2% (99%CI 80.7–81.9%) and specificity of 78.5% (99%CI 78.3–78.6%). 206,759 adults, with 8,739 (4.2%) deaths within 30 days, were included in the validation set. When the cut-off was applied to stratify the validation set, the two strata showed significantly different mortality (log-rank p < 0.001). The ROC curve for the validation set is shown in Figure 3A, along with the predictive performance of three different cut-offs. The 30-day survival estimates for the four groups defined using these cut-offs are shown in Figure 3B. The groups with the lowest (≤0.056) and highest (>0.25) e-RHD-FI scores had 99% (99%CI: 98.9–99.1%, standard error (SE) = 0.03%) and 67.5% (99%CI: 65–69.9%, SE = 0.9%) 30-day survival, respectively. In a multivariable model adjusted for male sex, age, and period of diagnosis, the association between the e-RHD-FI score and 30-day mortality was significant (HR per 0.1-point increment of e-RHD-FI = 1.45, 99%CI: 1.42–1.47) (Table 2). The association between e-RHD-FI and 30-day mortality remained significant, even after stratifying for age class (Supplementary Table S5, hospital admission (Supplementary Table S6), and period of diagnosis (Supplementary Table S7). In the multivariable model, e-RHD-FI was also significantly associated with a higher risk of hospitalization (HR per 0.1-point increment = 1.47, 99%CI: 1.46–1.49), and with the WHO clinical progression scale. For each 0.1-point increment of the e-RHD-FI, there was a 1.84-fold increase in the odds of worsening by one point at the WHO Clinical Progression Scale (Table 2).

We developed and validated an e-RHD-FI, using information from the electronic healthcare database of the Lombardy region, Italy. The e-RHD-FI was developed according to the standardized criteria recommended by Searle et al. (16). The e-RHD-FI was validated against the c-FI and the CFS, using a set of clinical data prospectively collected in a multicentre study of patients hospitalized for COVID-19 (6). Overall, the study showed that e-RHD-FI had good performance in predicting in-hospital and 30-day mortality, risk of hospital admission, and worsening on the WHO clinical scale in COVID-19 patients. Previous studies investigated the predictive power of the electronic FI (e-FI) for adverse outcomes in both hospitalized and community-dwelling individuals. Mak and colleagues developed a 48-item e-FI from routinely collected health records of 13,188 hospitalized older adults in Sweden, finding that a 0.03 increment in e-FI was independently associated with increased risk of in-hospital, 30-day, and 6-month mortality (35). Previously, Clegg and colleagues demonstrated that a 36-item e-FI was able to robustly predict mortality, hospitalization, and nursing home admission in a cohort of 931,541 older community-dwellers (24). Other studies, which computed an automated FI based on electronic health records, have been conducted in Canada (36), the United States (37), the United Kingdom (38), and France (39). However, only one study used a database-derived e-FI (i.e., the Hospital Frailty Risk Score) to assess mortality in an English cohort of hospitalized older people affected by COVID-19 (40). To the best of our knowledge, this is therefore the first study to use an e-RHD-FI for predicting mortality in an adult community-dwelling population with SARS-CoV-2. There are several findings from this study that should be highlighted. It is noteworthy that our e-RHD-FI had one of the highest performances in predicting mortality, compared to other electronic FIs. This result suggests that the variables included in our e-RHD-FI were adequately selected to represent the multiple dimensions of frailty. In fact, the e-RHD-FI included not only a list of chronic diseases usually considered in models predicting mortality but also several other conditions, known to increase susceptibility to adverse events (i.e., poor socio-economic status, sensory, cognitive, and functional impairments). Previous electronic FIs did not consider all these domains. For instance, four of the FIs included in a recent systematic review (41) did not include socioeconomic status (24, 38, 39, 42), which is a determinant of health status, whereas two other studies did not include cognitive problems or functional status (27, 37). Given its composition, we believe that our e-RHD-FI can also be proposed for non-COVID-19 patients, but future studies are required. Another key finding of our study is that the AUC of the ROC curve for 30-day mortality was higher in the general population (AUC = 87%) than in adults hospitalized for COVID-19. In hospitalized patients, e-RHD-FI showed similar predictive power for short-term mortality to the FRACOVID study (6). The fact that frail elderly patients were less likely to be hospitalized during the pandemic, compared with robust counterparts, may partially explain our results. The e-RHD-FI was applied to the whole population, and not just to elderly patients, showing very good performance in younger adults. We also found that the ability of e-RHD-FI to predict 30-day mortality was higher than CCI, suggesting the potential benefits of assessing frailty in younger patients. Other findings should be mentioned too. The agreement between each variable included in e-RHD-FI and c-FI was high. We found low sensitivity, but good or even excellent specificity for most of the variables included in the e-RHD-FI compared to clinical data. This was probably because electronic databases report health deficits only when they are highly pronounced. For example, in our e-RHD-FI, patients were classified as visually impaired only if they satisfied one of the two following criteria: (i) the patient benefited from an exemption (which is granted by the regional health system when contact lenses, eyeglasses, or Braille devices are required); ii) the patient had a diagnosis of visual impairment in medical records at hospital discharge. e-RHD-FI showed lower performance than c-FI in predicting in-hospital mortality (71.6% vs. 79.6%), likely because electronic databases are not as accurate as clinical databases in reporting health deficits. The e-RHD-FI cut-offs used in our study had a low positive predictive value (14.2%) but a very high negative predictive value (99%), suggesting good performance in detecting individuals at low risk of death after a diagnosis of SARS-CoV-2. The 0.25 cut-off had optimal performance in identifying those at high risk of mortality (33%) and a low negative predictive value (96.1%), indicating that individuals with e-RHD-FI ≤ 0.25 had a 3.9% risk of 30-day mortality. The results of this study may be useful, from a healthcare governance perspective, for managing frailty not only during but also after the pandemic. Currently, in the Italian National Health System, frail subjects are identified based only on generic characteristics, such as old age or the co-occurrence of chronic diseases. However, this approach is unable to capture the true nature of frailty and therefore is inadequate to target individuals who can truly benefit from specific interventions for frailty. The e-RHD-FI may serve this purpose, by enabling the Regional Health System to identify frail persons in a timely and simple manner. For instance, e-RHD-FI can be used to target people who will benefit most from vaccines. In this regard, surveillance systems based on predictive models adopted in restricted geographical areas have successfully prevented disease progression among people during the COVID-19 pandemic (1). The e-RHD-FI may also be used, on an individual basis, to identify individuals in need of coordinated and integrated interventions. On a regional level, the e-RHD-FI may help compare patient case mix and healthcare resources utilization across hospitals, according to frailty levels. This could have an important economic impact, given that frailty is associated with increased utilization of healthcare resources (10). A strength of this study is that we used a large population-based healthcare database. Furthermore, we validated the e-RHD-FI against a FI based on ad hoc clinical data. We measured the accuracy of the deficits included in the e-RHD and the association between the e-RHD-FI and other well-known tools used to assess frailty (c-FI and CFS). This study also has some limitations. First, the e-RHD-FI was validated only in individuals with SARS-CoV-2 by May 20, 2021, thus excluding those who developed SARS-CoV-2 afterwards. We cannot exclude that the large fluctuations in COVID-19 infection and mortality rates observed during the pandemic, as well as the advent of vaccination, may have influenced our results. However, we expect the index to show good performance also in those who were positive for SARS-COV-2 during the third and fourth waves, as the index performance did not change significantly when we applied stratification for time of diagnosis. Furthermore, e-RHD-FI showed lower values than c-FI, possibly underestimating frailty. This might be due to the fact that it was not possible to retrieve complete information on all health deficits and determinants from administrative data (e.g., mental health). Moreover, we were unable to retrieve all the variables included in the c-FI (such as smoking status). However, the reduction in the prognostic performance was limited when comparison with c-FI was applied. Finally, the data refer only to the Lombardy region, therefore our results are not generalizable to the whole country. To conclude, e-RHD-FI can predict mortality in community-dwelling adults with SARS-CoV-2 and can be used to target people at risk for future pandemics. Our findings also support the need to assess frailty with regional healthcare databases to implement specific approaches for frail people.

The datasets presented in this article are not readily available because they need an agreement to be accessed. Requests to access the datasets should be directed to Regione Lombardia.

The studies involving human participants were reviewed and approved by the Brianza Institutional Review Board under the number 3356-07/08/2020.

PR, CS, GB, and MGV contributed to the conception and design of the study. AZ, EF, AM, PR, GO, MGV and GB contributed to the acquisition of the data. PR, GO, and MGV were responsible for the statistical analysis. PR, CS, FB, OL, FC, AZ, EF, AM, GB, and MGV were responsible for the interpretation of the data. PR, CS, AZ, EF, AM, GB, and MGV contributed to the draft of this paper. All authors have read, revised, and approved the final manuscript.

This work was supported by a grant from the Cariplo (Cassa di Risparmio delle Province Lombarde) Foundation, Lombardia Region, Italy (The FRACOVID study, ClinicalTrials.gov Identifier: NCT04412265).

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.