although the subject of neonatal hyperbilirubinemia is part of the curricular content of medical schools and graduate pediatrics programs in brazil , the current literature provides no clear proposals on how to practically teach physicians in training to manage the icteric newborn [ 46 ] . in 2004 , a specialized committee of the american academy of pediatrics ( aap ) published a guideline reviewing the matter [ 13 ] . due to the metabolic peculiarities of the newborn child , hyperbilirubinemia is universally found in the first days of life . it can be difficult to manage and , if not identified early and treated adequately , can carry a grim prognosis [ 3 , 4 ] . given the current practice of discharging infants from maternity care at the 48th hour of life and the increased frequency of breastfeeding in response to breastfeeding encouragement strategies , physiological hyperbilirubinemia which generally arises after the 72nd hour of life ,- and may be exacerbated by breastfeeding  has come to present more intensely , and become a frequent reason for hospital readmission after maternity discharge [ 3 , 46 ] . the aap stresses the particular importance of looking for risk factors for hyperbilirubinemia or kernicterus in full - term or near - term neonates about to be discharged [ 3 , 7 , 8 ] 
  this study seeks to define specific theoretical content geared at guiding practical management of neonatal jaundice by producing a theoretical assessment instrument composed of practical items on the theme of neonatal indirect hyperbilirubinemia , with the following research question :  what is the minimal theoretical content required to give future pediatricians the capacity to recognize the risk of kernicterus in jaundiced neonates ? this study was structured as a descriptive survey leading to the development of an instrument that could answer its research question . the delphi consensus method for expert - based questionnaire validation was used . in designing the questionnaire , we used the current literature to define key points for practice in the management of neonatal jaundice before discharge . these indicators were also tied in with the 2004 aap guidelines [ 3 , 8 , 12 ] . one of the limitations of this method as used in our study is that experts were not included in the primary definition of these questions , only in their later discussion . we believed it would have been inappropriate to burden these busy experts with such an arduous and time - consuming task . they did , however , take part in assessing the form , content , and detail of each of the items presented . advantages of the delphi method included the fact that isolated responses minimized the tendency for experts to influence one another , while maximizing our ability to discern distinctive opinions . furthermore , the possibility of conducting the delphi rounds via email made this a cost - effective and efficient method , saving time and money on data input and output . ten vignettes on the topic of neonatal hyperbilirubinemia were grouped and the questionnaire items prepared were validated by means of the delphi method . each item was recorded on a report , which was resent to each expert for approval or rejection until a final consensus was obtained . delphi principles and corresponding methodological adaptation:which indicators were selected for the questions to be formulated to explore the matter ?   questionnaire itemswho are the experts , and where are they ?   selected expertswhich technique will be applied ?   systematic delphi stageswhat are the expected results ?   instrument validation . which indicators were selected for the questions to be formulated to explore the matter ?   questionnaire items  who are the experts , and where are they ?   selected experts  which technique will be applied ?   systematic delphi stages  what are the expected results ?   instrument validation . the ten items of the student questionnaire ( sq ) were as follows : 1 ) epidemiological indicators of worsening hyperbilirubinemia ; 2 ) predictors of risk of bilirubin encephalopathy ; 3 ) visual clinical recognition of jaundice and its hazards ; 4 ) correlation between clinical indicators of encephalopathy and progression to kernicterus ; 5 ) laboratory assessment of pathological neonatal jaundice ; 6 ) management of indirect hyperbilirubinemia ; 8) management of neonatal jaundice detected before the 48th hour of life ; 9 ) diagnostic definition of neonatal jaundice at review ( after discharge ) ; 10 ) minimum systematic approach for recognition of kernicterus . our pool of experts was composed of national council for scientific and technological development ( cnpq ) fellows conducting research on neonatal indirect hyperbilirubinemia who agreed to take part in the study . the criteria for expert selection used the lattes platform , an online database maintained by the brazilian government and containing information on researchers and research institutions working in science , technology , and innovation in the country . the database was searched for medical school professors who had authored articles with the descriptors  neonatal jaundice  ,  newborn hyperbilirubinemia  , or we invited the top 30 such authors ( as of 2007 ) to take part in the study . of these , the first 15 to agree were selected to make up the expert panel ; 14 remained on the panel until the end of the study . the stages of sq development , from concept to validation , were : 1 ) production of questionnaire ( target audience : pediatricians in training ) ; 2 ) questionnaire sent to experts who agreed to take part ; 3 ) consensus analysis of the first expert responses received ; 4 ) modification of sq and pilot study to assess item clarity ; 5 ) second ( modified ) sq sent to experts ; 6 ) consensus report , concluding that the sq was validated by the expert panel . the target demographic of the measurement instrument comprised future pediatricians who were finishing medical school or had graduated from medical school no more than 6 months before responding to the questionnaire . the sq sent to the 14 selected experts for validation comprised ten items , or questions , of theoretical and practical relevance to  neonatal hyperbilirubinemia in the first days of life  . all 12 items of the expert questionnaire or eq ( with item 8 subdivided into two , for a total of 13 questions ) were designed to enable validation of the 10-item sq . experts were asked to measure the relevance and importance of proposed content ; give their opinion as to whether content should be kept or changed , suggesting improvements as necessary ; and give their opinion on whether additional relevant items should be included , or redundant items removed . 1 ) instructions ; 2 ) clarity ; 3 ) subjectivity ; 4 ) bias ; 5 ) redundancy ; 6 ) omission ; 7 ) success ( i.e. , the potential for successful responses ) ; 8) comprehensiveness in terms of a ) hyperbilirubinemia and b ) kernicterus ; 9 ) overall comprehensiveness ; 10 ) item weights ; 11 ) relevance of content ; 12 ) format / presentation ( fig . the validated consensus on content , presentation , and qualification was pooled to become the overall consensus , obtained by means of the eq ( table 1 ) , which was used to define each sq item as indispensable , important , or expendable and ( based on presentation ) whether each sq item should be kept , modified , or removed . expert validation of the 10-item student questionnaire ( sq ) ; means and standard deviations of the 12/13-item expert questionnaire ( eq ) consensus of expert questions ( eq ) for validation of the student questionnaire ( sq ) mean of 14 experts opinions regarding content , 10 sq items/11 eq items mean of 14 experts opinions regarding format , 10 sq items/12 eq items mean of means ( mom ) for 14 experts opinions regarding the 10 sq items in the 12/13 eq items final mean for numbers corresponding to the cumulative percentage > 60% in the 10 sq questions for each of the 12/13 eq questions  + mean of means ( mom ) for all opinions of all 14 experts regarding the 10 sq items per response to the 12/13 eq items . final mean or rating variation in eq expert rating for the 10 sq items . here , the scale is inversely proportional : the fewer points ( denoting less variation ) , the better the consensus . on the basis of overall qualification of means and standard deviations of likert - type assessments , each sq item was defined as complete / perfect , fair , poor , or unacceptable . all comments made by experts during epidemiological assessment and validation of the sq were taken into account . the literature framework for the 10 sq items analysis enabled description of the mean ( standard deviation ) as the likelihood of the statistical outcome . the delphi method proved effective in constructing a consensus expert opinion on the sq after two rounds of study . our pool of experts was composed of national council for scientific and technological development ( cnpq ) fellows conducting research on neonatal indirect hyperbilirubinemia who agreed to take part in the study . the criteria for expert selection used the lattes platform , an online database maintained by the brazilian government and containing information on researchers and research institutions working in science , technology , and innovation in the country . the database was searched for medical school professors who had authored articles with the descriptors  neonatal jaundice  ,  newborn hyperbilirubinemia  , or we invited the top 30 such authors ( as of 2007 ) to take part in the study . of these , the first 15 to agree were selected to make up the expert panel ; 14 remained on the panel until the end of the study . the stages of sq development , from concept to validation , were : 1 ) production of questionnaire ( target audience : pediatricians in training ) ; 2 ) questionnaire sent to experts who agreed to take part ; 3 ) consensus analysis of the first expert responses received ; 4 ) modification of sq and pilot study to assess item clarity ; 5 ) second ( modified ) sq sent to experts ; 6 ) consensus report , concluding that the sq was validated by the expert panel . the target demographic of the measurement instrument comprised future pediatricians who were finishing medical school or had graduated from medical school no more than 6 months before responding to the questionnaire . the sq sent to the 14 selected experts for validation comprised ten items , or questions , of theoretical and practical relevance to  neonatal hyperbilirubinemia in the first days of life  . all 12 items of the expert questionnaire or eq ( with item 8 subdivided into two , for a total of 13 questions ) were designed to enable validation of the 10-item sq . experts were asked to measure the relevance and importance of proposed content ; give their opinion as to whether content should be kept or changed , suggesting improvements as necessary ; and give their opinion on whether additional relevant items should be included , or redundant items removed . 1 ) instructions ; 2 ) clarity ; 3 ) subjectivity ; 4 ) bias ; 5 ) redundancy ; 6 ) omission ; 7 ) success ( i.e. , the potential for successful responses ) ; 8) comprehensiveness in terms of a ) hyperbilirubinemia and b ) kernicterus ; 9 ) overall comprehensiveness ; 10 ) item weights ; 11 ) relevance of content ; 12 ) format / presentation ( fig . 1 ) . the validated consensus on content , presentation , and qualification was pooled to become the overall consensus , obtained by means of the eq ( table 1 ) , which was used to define each sq item as indispensable , important , or expendable and ( based on presentation ) whether each sq item should be kept , modified , or removed . expert validation of the 10-item student questionnaire ( sq ) ; means and standard deviations of the 12/13-item expert questionnaire ( eq ) consensus of expert questions ( eq ) for validation of the student questionnaire ( sq ) mean of 14 experts opinions regarding content , 10 sq items/11 eq items mean of 14 experts opinions regarding format , 10 sq items/12 eq items mean of means ( mom ) for 14 experts opinions regarding the 10 sq items in the 12/13 eq items final mean for numbers corresponding to the cumulative percentage > 60% in the 10 sq questions for each of the 12/13 eq questions  + mean of means ( mom ) for all opinions of all 14 experts regarding the 10 sq items per response to the 12/13 eq items . final mean or rating variation in eq expert rating for the 10 sq items . here , the scale is inversely proportional : the fewer points ( denoting less variation ) , the better the consensus . on the basis of overall qualification of means and standard deviations of likert - type assessments , each sq item was defined as complete / perfect , fair , poor , or unacceptable . all comments made by experts during epidemiological assessment and validation of the sq were taken into account . the literature framework for the 10 sq items was combined with the comments made by the 14 experts to validate the instrument . analysis enabled description of the mean ( standard deviation ) as the likelihood of the statistical outcome . the delphi method proved effective in constructing a consensus expert opinion on the sq after two rounds of study . overall , the structure of the pilot version of the sq was modified on the basis of the consensus expert decision that , when faced with difficulties in management of neonatal jaundice , physicians should consult the relevant literature . this is particularly important in the study sample , which consisted of inexperienced young physicians or medical students , who still lack the expertise and discernment required to carry out risk assessment on the basis of clinical observation alone . the present study took on a more instructional nature through the addition of reference material for assessment of hyperbilirubinemia risk , including hour - specific nomograms for hyperbilirubinemia , to the questionnaire . of note , tsb , gestational age ( ga ) , birth weight ( bw ) , and age must always be recorded and presented for nomogram analysis . some unanimous expert suggestions were used to enrich the vignettes used in the questionnaire , but the material provided as background for contextualization of answers ( fig . 2 and 3 and box 1 ) was based exclusively on aap guidelines , which were , in turn , based on robust epidemiological data . hour - specific nomogram of mean tsb levels ( mg / dl ) indicating high - intensity phototherapy in newborns with a gestational age 35 weeks and birth weight 2 kg hour - specific nomogram of mean tsb levels ( mg / dl ) indicating exchange transfusion in newborns with a gestational age 35 weeks and birth weight 2 kg . an example of risk characterization based on the sq items and not on the references used to build the sq was the mention of kramer 's rule . although the caudal progression of clinical jaundice is not a proven prognostic indicator of severity , it was suggested during the expert validation process . greater emphasis was afforded to the relevance of the difficulty of clinically observing jaundice during phototherapy , particularly in patients with darker skin and/or in the absence of natural lighting . experts noted the difficulty of assessing the risk of hyperbilirubinemia by visual observation of jaundice even when carried out by experienced neonatologists . in addition to the factors described in the aap material , experts mentioned the need for careful assessment of the following neurotoxic factors for kernicterus : administration of drugs that compete with albumin binding of bilirubin ( vitamin k , sulfas , ceftriaxone ) ; and intracranial bleeding with increased cerebral blood flow . we note that the potential for adverse effects of high - dose synthetic vitamin k therapy was addressed years ago , and no longer poses any risk , as long as appropriate dosages are used [ 17 , 18 ] . the experts also stressed the importance of quantitating glucose-6-phosphate dehydrogenase ( g6pd ) whenever prolonged exposure to adequate phototherapy is unable to effect a reduction in hyperbilirubinemia , regardless of ethnicity or family history of g6pd deficiency [ 3 , 7 , 13 ] . another point of emphasis was that  intensive phototherapy  , defined as the use of high levels of irradiance  in the 430 to 490 nm range , 30w / cm2/nm or higher  should be measured directly at the bassinet by a radiometer whenever indicated [ 3 , 14 ] . expert suggestions were used to expand and adapt the sq vignettes to the brazilian reality . for instance , in adapting the aap guidelines to the brazilian reality , we removed the need for notification of kernicterus to the cdc , as brazil has no equivalent organization to receive this information . we also disregarded the possibility of transcutaneous bilirubin measurement , which would only be possible with bilirubinemia below 15 mg / dl . furthermore , the device mentioned in the aap guidelines for measurement of etcoc as it relates to hyperbilirubinemia is extremely costly , and used only in clinical research , thus making it a low priority for acquisition in brazil . mean of means , consensus opinions of the 14 experts on the 10 sq items another consensus comment was that , in the etiologic diagnosis of jaundice , one must stress that variations from birth weight upon follow - up exam generally coincide with a physiological weight reduction , which may be confused with low or inadequate infant feeding . the last validated sq question recommended a minimum response standard , focusing on diagnostic and therapeutic strategies applicable to healthcare professionals and to the caregivers of newborn infants , meant to address the repercussions of jaundice as early as the first days of life , using data from prenatal care and including intervention whenever necessary [ 18 , 20 , 21 ] . our decision to recruit experts with teaching experience and applying their suggestions to a questionnaire administered to a sample of young physicians and medical students appears to have reached its primary objective : to develop an accurate , validated instrument for determination of the minimum theoretical content required to teach kernicterus risk assessment to physicians in training . we humbly thank the 14 investigators who assisted in the construction of this instrument in their capacity as brazil 's foremost experts in neonatal hyperbilirubinemia . in conclusion , the minimum theoretical content that must be part of medical education programs if pediatricians are to identify and address neonatal jaundice in an appropriate manner is mostly tied to building awareness of the epidemiological risk factors for indirect hyperbilirubinemia and of the potential risk characteristics for bilirubin encephalopathy , in light of the specific literature guidelines for clinical conduct analysis of each case . the guidelines and rules for reference are those found in the literature , and must be made available in services that provide neonatal care . the minimum primary care capacity physicians must have is the discernment to consult reference materials specific to each clinical situation where hyperbilirubinemia may be involved . this study places particular emphasis on knowledge of the four variables that should guide management of neonatal jaundice : gestational age at birth , birth weight , extrauterine age , and total serum bilirubin . this validated questionnaire should prove a useful instrument , preparing pediatricians to recognize the possibility of bilirubin encephalopathy in susceptible neonates and to provide timely intervention whenever necessary .
objectivethe objective of this study was to define the minimum academic content required for pediatricians to recognize the risk of kernicterus.methodsa questionnaire was developed on the basis of american academy of pediatrics guidelines seeking to develop a consensus for pediatricians in training on the theoretical content about neonatal hyperbilirubinemia . to validate the instrument 
 , we used the delphi consensus method . 
 the 14 invited experts interviewed , eminent brazilian researchers of neonatal hyperbilirubinemia , analyzed the questions posed in accordance with the literature and validated the instrumentfindingsan assessment instrument , the student questionnaire ( sq ) , was developed on the basis of indicators of risk of neonatal hyperbilirubinemia obtained from the literature . 
 a panel of academic experts , composed of the leading researchers of neonatal hyperbilirubinemia in brazil according to research rankings of the brazilian government 's lattes platform , was assembled for consensus validation of the assessment instrument . 
 validation of the sq was achieved after two rounds of the delphi technique . 
 finally , the sq itself was validated with the medical education content required for recognition of kernicterus risk.conclusionthe consensus among experts stressed the need to identify the primary epidemiologic risk factors for significant hyperbilirubinemia associated with neonatal jaundice and to characterize risk of bilirubin encephalopathy according to the literature . 
 the minimum capacity required of physicians in training is that they have the insight to consult the reference material specific to each clinical situation in which hyperbilirubinemia may be involved . 
 the present study emphasized the need for knowledge of the four variables related to management of neonatal jaundice : gestational age , birth weight , infant age , and total serum bilirubin . 
 this validated questionnaire can be a useful tool to prepare pediatricians to recognize the possibility of bilirubin encephalopathy in neonates and prescribe intervention as necessary .