in non - small cell lung cancer ( nsclc ) , proven ipsi- ( n2 ) or contralateral ( n3 ) mediastinal lymph node involvement often precludes cure by surgery . 2-deoxy-2-[f-18]fluoro - d - glucose - positron emission tomography ( fdg - pet ) is used to stage nsclc patients . the yield of whole - body pet pertains to typing the primary pulmonary lesion and on the preoperative identification of distant and lymph node metastases . moreover , pet simplifies and improves lymph node evaluation by setting the indication for biopsy and improving its yield . mediastinoscopy is the standard technique of invasive lymph node staging but the results in daily practice are quite variable . it has been suggested that the proportion of tumor - positive procedures increases if guided by pet [ 2 , 3 ] . so far , mediastinoscopy is the most often used invasive method , but more recently , endoscopic techniques [ like transesophageal ultrasound - guided fine needle aspiration ( eus - fna ) ] have been developed . because the mediastinal areas covered by mediastinoscopy and eus - fna are largely complementary , proper localization of possible malignant nodes is important to assign patients to the appropriate procedure . fdg - pet criteria of test positivity for mediastinal lymph node staging are based on recognition of focally enhanced uptake (  hot spots  ) vs. background , rather than on quantitative assessment ( like the 1-cm short axis criterion with ct scanning ) . results from pet studies pertaining to its accuracy in mediastinal staging are robust , but as the technique is disseminating , observer variation and learning curves still need to be documented . the aim of the present study was to measure the observer agreement and accuracy vs. expert readings of mediastinal lymph nodes in nsclc staging with fdg - pet at various levels of complexity and as a function of experience . we used a set of 30 pet scans from the study by joshi et al .   of consecutive patients referred for staging to the department of nuclear medicine and pet research of the vrije university medical centre . to obtain an adequate case mix , we included scans of patients with a range of mediastinal lymph node sizes at ct scanning : ( 1 ) 10  mm short axis diameter ( n  =  10 ) , ( 2 ) 10.115  mm ( n  =  10 ) , and ( 3 )  >  15  mm ( n  =  10 ) . pet scans had been performed according to the standard protocol in our institution using a full ring bgo pet scanner ( ecat exact hr+ , cti / siemens , starting 60  min after 370  mbq fdg ) . the scans were analyzed by 14 nuclear medicine physicians who had extensive experience with spect but variable expertise with pet and mediastinal lymph node staging in nsclc : seven had no personal experience with pet ( the  inexperienced group  ) , whereas the others had at least 1  year of experience with pet in nsclc patients in their own clinical practice , which comprised access to mobile pet once every 1 or 2  weeks ( the more  experienced group  ) . on average , the inexperienced group had reviewed 015 pet scans , each compared to a 100150 ( with at least 50% nsclc ) each in the experienced group . prior to this study , the observers had been instructed in workshops by two expert pet readers , a pulmonologist , and a surgeon about the concepts , principles , and practice of mediastinal staging in nsclc by pet and other methods . the results of all observers were compared to the combined judgment of two expert nuclear medicine physicians ( efc and osh ) , and the latter readings were used as the gold standard . the expert readers had been working together in the same university hospital for numerous years and had a broad experience with pet [ 68 ] . we developed a software tool running matlab 5.3 , which allowed simultaneous visualization of pet images in the axial , coronal , and sagittal planes ( at 5 or 10  mm slice thickness ) , with possible cross linking . each observer was requested to identify and interpret any abnormal hot spot representing primary tumor or lymph node , blinded for the results of the other readers . this software tool was installed on the personal computer of each observer , and the results were electronically stored for analysis . to be able to accurately relate the results of different observers , the coordinates of each hot spot identified by an observer were stored and linked to the assigned interpretation . because none of the observers had worked with this software before , we provided a test set ( derived from the original data set ) of three scans to each observer prior to the study . these three scans comprised 29 separate abnormal mediastinal lymph node localizations and therefore provided an adequate way to practice working with naruke s map of lymph node localizations ( adapted from mountain and dresler ) . observers had knowledge of the clinical information provided with the original pet scan referral , except for the mediastinal stage at ct . the observers were asked to interpret abnormal hot spots pertaining to the primary tumor and lymph nodes in terms of their localization and likelihood of malignancy using the classification systems shown in table  1 . furthermore , observers were asked to formulate a recommendation with respect to the next management step to the referring clinician ( table  1 ) . in this context , we instructed them to use the following protocol : ( 1 ) recommend biopsy of mediastinal lymph nodes in case of suspected ( hilar or mediastinal ) lymph node involvement and in case of tumors adjacent to the mediastinum or hilus , ( 2 ) recommend thoracotomy in case of a peripheral primary tumor without suspicious mediastinal lymph nodes at pet , and ( 3 ) recommend an expectative (  wait and see  ) policy in case pet shows no abnormal uptake in either the primary site nor in lymph nodes . for the purpose of the present investigation , they were instructed to ignore possible suspicious extrathoracic localizations in these management considerations . table  1classification system of tumor and lymph nodescharacteristicclassificationprimary tumor  presenceno tumor presentprimary tumorsecond primary  localizationperipheraladjacent to mediastinumadjacent to hiluslymph node localizationno lymph nodes presentn1 l / rn2 l / rn3n4 l / rn5/ * n6/ * n7n8 l / rn9 l / rn10 l / rclavicular l / rlikelihood of malignancydefinitely benignprobably benignequivocalprobably malignantdefinitely malignantmanagement recommendationinvasive lymph node evaluationthoracotomyexpectative policyaccording to the map of lymph node definitions by mountain and dresler classification system of tumor and lymph nodes according to the map of lymph node definitions by mountain and dresler using the individual scores of the observers , we assigned an n - stage according to pet  for each observer and each patient using the following classification : 
 n0 , peripheral primary tumor , no mediastinal hot spotn1 , peripheral primary tumor and separate hot spot considered to be a hilar lymph noden0n1 , primary tumor within hilar area , no separate mediastinal hot spotn0n2 , primary tumor adjacent to mediastinum , no separate mediastinal hot spotn2 , hot spot compatible with ipsilateral mediastinal lymph noden3 , hot spot compatible with contralateral mediastinal or clavicular lymph node n0 , peripheral primary tumor , no mediastinal hot spot n1 , peripheral primary tumor and separate hot spot considered to be a hilar lymph node n0n1 , primary tumor within hilar area , no separate mediastinal hot spot n0n2 , primary tumor adjacent to mediastinum , no separate mediastinal hot spot n2 , hot spot compatible with ipsilateral mediastinal lymph node n3 , hot spot compatible with contralateral mediastinal or clavicular lymph node we performed a more detailed analysis of the nature of the errors in the  management recommendation  classification vs. the expert reading , identifying whether these errors followed the observers own interpretation of suspicious lymph node stations or resulted from true errors ( protocol violation ) . for example , the former situation occurred if , in case of a peripheral primary tumor , an observer considered the ipsilateral right lower tracheobronchial station to be positive at pet , whereas the expert only identified the primary lesion . the resulting discrepant management recommendations ( mediastinoscopy vs. thoracotomy , respectively ) directly flow from these classifications . however , if this observer would have advised to proceed directly to thoracotomy , this was considered a protocol violation ( p ) . we also measured how accurately readers could define and localize suspected mediastinal lymph node stations at pet . compatible with known limitations of pet with respect to spatial resolution and accounting for different levels of clinical relevance , we accepted the following differences of nodal classifications : naruke stations 1 and 2 [ left ( l)/right ( r ) , respectively ] , 4r and 10r , 4l and 10l and 5 , and 8 and 9 ( l / r , respectively ) . using this simplified system , we analyzed whether observers defined and localized suspected lymph node metastases vs. the expert readings  correctly ,   incorrectly ,  or  not at all . statistical analysis was done by spss version 13.0 software . to determine interobserver agreement regarding  management recommendation  and  n - stage ,  and to compare this to expert readings , we calculated the kappa coefficients , using agree version 7.2 . furthermore , to detect potential differences between the two groups of observers with different pet experience with respect to the nature of the management recommendation errors , and the classification of separate mediastinal hot spots , we used the wilcoxon  mann we used a set of 30 pet scans from the study by joshi et al .   of consecutive patients referred for staging to the department of nuclear medicine and pet research of the vrije university medical centre . to obtain an adequate case mix , we included scans of patients with a range of mediastinal lymph node sizes at ct scanning : ( 1 ) 10  mm short axis diameter ( n  =  10 ) , ( 2 ) 10.115  mm ( n  =  10 ) , and ( 3 )  >  15  mm ( n  =  10 ) . pet scans had been performed according to the standard protocol in our institution using a full ring bgo pet scanner ( ecat exact hr+ , cti / siemens , starting 60  min after 370  mbq fdg ) . the scans were analyzed by 14 nuclear medicine physicians who had extensive experience with spect but variable expertise with pet and mediastinal lymph node staging in nsclc : seven had no personal experience with pet ( the  inexperienced group  ) , whereas the others had at least 1  year of experience with pet in nsclc patients in their own clinical practice , which comprised access to mobile pet once every 1 or 2  weeks ( the more  experienced group  ) . on average , the inexperienced group had reviewed 015 pet scans , each compared to a 100150 ( with at least 50% nsclc ) each in the experienced group . prior to this study , the observers had been instructed in workshops by two expert pet readers , a pulmonologist , and a surgeon about the concepts , principles , and practice of mediastinal staging in nsclc by pet and other methods . the results of all observers were compared to the combined judgment of two expert nuclear medicine physicians ( efc and osh ) , and the latter readings were used as the gold standard . the expert readers had been working together in the same university hospital for numerous years and had a broad experience with pet [ 68 ] . we developed a software tool running matlab 5.3 , which allowed simultaneous visualization of pet images in the axial , coronal , and sagittal planes ( at 5 or 10  mm slice thickness ) , with possible cross linking . each observer was requested to identify and interpret any abnormal hot spot representing primary tumor or lymph node , blinded for the results of the other readers . this software tool was installed on the personal computer of each observer , and the results were electronically stored for analysis . to be able to accurately relate the results of different observers , the coordinates of each hot spot identified by an observer were stored and linked to the assigned interpretation . because none of the observers had worked with this software before , we provided a test set ( derived from the original data set ) of three scans to each observer prior to the study . these three scans comprised 29 separate abnormal mediastinal lymph node localizations and therefore provided an adequate way to practice working with naruke s map of lymph node localizations ( adapted from mountain and dresler ) . observers had knowledge of the clinical information provided with the original pet scan referral , except for the mediastinal stage at ct . the observers were asked to interpret abnormal hot spots pertaining to the primary tumor and lymph nodes in terms of their localization and likelihood of malignancy using the classification systems shown in table  1 . furthermore , observers were asked to formulate a recommendation with respect to the next management step to the referring clinician ( table  1 ) . in this context , we instructed them to use the following protocol : ( 1 ) recommend biopsy of mediastinal lymph nodes in case of suspected ( hilar or mediastinal ) lymph node involvement and in case of tumors adjacent to the mediastinum or hilus , ( 2 ) recommend thoracotomy in case of a peripheral primary tumor without suspicious mediastinal lymph nodes at pet , and ( 3 ) recommend an expectative (  wait and see  ) policy in case pet shows no abnormal uptake in either the primary site nor in lymph nodes . for the purpose of the present investigation , table  1classification system of tumor and lymph nodescharacteristicclassificationprimary tumor  presenceno tumor presentprimary tumorsecond primary  localizationperipheraladjacent to mediastinumadjacent to hiluslymph node localizationno lymph nodes presentn1 l / rn2 l / rn3n4 l / rn5/ * n6/ * n7n8 l / rn9 l / rn10 l / rclavicular l / rlikelihood of malignancydefinitely benignprobably benignequivocalprobably malignantdefinitely malignantmanagement recommendationinvasive lymph node evaluationthoracotomyexpectative policyaccording to the map of lymph node definitions by mountain and dresler classification system of tumor and lymph nodes according to the map of lymph node definitions by mountain and dresler n - stage according to pet  for each observer and each patient using the following classification : 
 n0 , peripheral primary tumor , no mediastinal hot spotn1 , peripheral primary tumor and separate hot spot considered to be a hilar lymph noden0n1 , primary tumor within hilar area , no separate mediastinal hot spotn0n2 , primary tumor adjacent to mediastinum , no separate mediastinal hot spotn2 , hot spot compatible with ipsilateral mediastinal lymph noden3 , hot spot compatible with contralateral mediastinal or clavicular lymph node n0 , peripheral primary tumor , no mediastinal hot spot n1 , peripheral primary tumor and separate hot spot considered to be a hilar lymph node n0n1 , primary tumor within hilar area , no separate mediastinal hot spot n0n2 , primary tumor adjacent to mediastinum , no separate mediastinal hot spot n2 , hot spot compatible with ipsilateral mediastinal lymph node n3 , hot spot compatible with contralateral mediastinal or clavicular lymph node we performed a more detailed analysis of the nature of the errors in the  management recommendation  classification vs. the expert reading , identifying whether these errors followed the observers own interpretation of suspicious lymph node stations or resulted from true errors ( protocol violation ) . for example , the former situation occurred if , in case of a peripheral primary tumor , an observer considered the ipsilateral right lower tracheobronchial station to be positive at pet , whereas the expert only identified the primary lesion . the resulting discrepant management recommendations ( mediastinoscopy vs. thoracotomy , respectively ) directly flow from these classifications . however , if this observer would have advised to proceed directly to thoracotomy , this was considered a protocol violation ( p ) . we also measured how accurately readers could define and localize suspected mediastinal lymph node stations at pet . compatible with known limitations of pet with respect to spatial resolution and accounting for different levels of clinical relevance , we accepted the following differences of nodal classifications : naruke stations 1 and 2 [ left ( l)/right ( r ) , respectively ] , 4r and 10r , 4l and 10l and 5 , and 8 and 9 ( l / r , respectively ) . using this simplified system , we analyzed whether observers defined and localized suspected lymph node metastases vs. the expert readings  correctly ,   incorrectly ,  or  not at all . statistical analysis was done by spss version 13.0 software . to determine interobserver agreement regarding  management recommendation  and  n - stage ,  and to compare this to expert readings , we calculated the kappa coefficients , using agree version 7.2 . furthermore , to detect potential differences between the two groups of observers with different pet experience with respect to the nature of the management recommendation errors , and the classification of separate mediastinal hot spots , we used the wilcoxon  mann the 30 pet scans comprised a total of 89 locations of suspected malignancy , according to the gold standard ( expert reading ) . thirty - four represented tumor locations , 55 were lymph nodes ( 10 hilar , 39 mediastinal , and six supraclavicular ) . according to expert readers , there was a mean of three sites ( primary lesion and lymph nodes ) per patient ( range 113 ) . the experts classified ( according to table  1 ) 82 lesions as  definitely malignant ,  five as  probably malignant ,  and two as  equivocal .  in the final analysis , these  probably  and  definitely  malignant locations were classified as malignant . n2 ,  and five  n3 ,  according to the definitions mentioned earlier . management recommendations were correct in 80% of cases ( 86 errors out of 420 recommendations , 42 in the experienced group and 44 in the inexperienced group ) . the accuracy vs. expert reading was moderate ( kappa 0.59 ) at either level of experience ( table  2 ) . the level of agreement among inexperienced observers tended to be lower but did not reach significance . four scans accounted for a total of 38 errors ( 44% ) , while not a single mistake by any observer was made in eight . 
 table  2interobserver agreement and accuracy as a function of experience with respect to the classification of inexperienced observers ( n  =  7)experienced observers ( n  =  7)overallmanagement recommendationagreement vs. expert0.60 ( 0.420.77)0.58 ( 0.370.79)0.59 ( 0.420.76)pair wise agreement0.48 ( 0.350.62)0.56 ( 0.410.71)0.50 ( 0.370.63)n - stageagreement vs. expert0.58 ( 0.360.80)0.72 ( 0.550.88)0.65 ( 0.470.83)pair wise agreement0.56 ( 0.440.68)0.61 ( 0.490.74)0.58 ( 0.460.69 ) kappa ( 95% confidence interval)weighted kappa ( 95% confidence interval ) interobserver agreement and accuracy as a function of experience with respect to the classification of  n - stage  and  management recommendation  kappa ( 95% confidence interval ) weighted kappa ( 95% confidence interval ) in the group of inexperienced readers , 29 ( of 44 ; 66% ) of the incorrect management recommendations were protocol violations ( type  p  ) , vs. 17 ( of 42 ; 40% ) in the experienced readers group ( p  =  0.12 ) . on the contrary , errors that directly flow from reading errors ( type  m  ) were significantly more prevalent in the group of experienced readers ( 25 out of 42  =  59% ) , vs. 15 out of 44 ( 34% ) in the inexperienced readers group ( p  =  0.03 ) . common errors ( type  p  , protocol violations ) were , e.g. , to recommend  expectative policy  or  directly to thoracotomy  in a patient without enhanced pet uptake in primary tumor and mediastinal lymph nodes . however , the provided clinical information stated that bronchoalveolar cell carcinoma had been proven histologically . therefore ,  mediastinal lymph node evaluation  should have been recommended because the mediastinum in a patient with adenocarcinoma without fdg uptake of the primary tumor can not be reliably evaluated so that histological confirmation of the mediastinum is required . n - stage classifications were correct in 68% of cases ( 286 out of 420 assigned n - stages , 138 in the inexperienced group and 148 in the experienced group ) . experienced observers tended to have a better agreement with the expert reading than inexperienced ones ( weighted kappa s 0.72 and 0.58 , respectively ) . n - stages were overestimated in 17.4% ( 16.7% by the experienced and 18.1% by the inexperienced observers ) and underestimated in 14.5% of cases ( 12.9 and 16.2% , respectively ) . the individual scores of the observers ( table  3 ) reveal that errors in either direction were made by most of them . table  3details on n - stage ( using the classification system described in the methods section ) in 30 scans for each observer  n - stage classified correctly [ % ( n)]n - stage overestimated [ % ( n)]inexperienced observersinexp 170.0 ( 21)20.0 ( 6)inexp 256.7 ( 17)20.0 ( 6)inexp 370.0 ( 21)13.3 ( 4)inexp 463.3 ( 19)23.3 ( 7)inexp 566.7 ( 20)20.0 ( 6)inexp 666.7 ( 20)20.0 ( 6)inexp 766.7 ( 20)10.0 ( 3)total65.7 ( 138)18.1 ( 38)experienced observersexp 163.3 ( 19)30.0 ( 9)exp 276.7 ( 23)6.7 ( 2)exp 373.3 ( 22)10.0 ( 6)exp 573.3 ( 22)13.3 ( 4)exp 673.3 ( 22)16.7 ( 5)exp 760.0 ( 18)20.0 ( 6)total70.5 ( 148)16.7 ( 35)percentage of n - stages classified correctly vs. expert readingpercentage of overestimated n - stages vs. expert reading details on n - stage ( using the classification system described in the methods section ) in 30 scans for each observer percentage of n - stages classified correctly vs. expert reading percentage of overestimated n - stages vs. expert reading because we used three scans to practice on localizing mediastinal lymph nodes , 27 scans remained with 26 separate lymph node localizations . the detection rate of individual mediastinal lymph node stations was similar for inexperienced and experienced observers ( 71 and 74% , respectively , table  4 ) , and the variation within the groups was also comparable . however , experienced readers were better at localizing the stations than inexperienced readers were ( correct in 68 vs. 51% , respectively ) . the most common mislocalizations ( table  5 ) were to classify right tracheobronchial stations ( 4r ) as upper - right paratracheal ( 2r ) , subcarinal ( 7 ) as right tracheobronchial ( 4r ) , and left para - esophageal ( 8/9l ) as left tracheobronchial ( 4l ) . 
 table  4accuracy of inexperienced and experienced observers to detect and localize the 26 mediastinal lymph node stations present according to the expert reading  identified [ % ( n)]correctly localized [ % ( n)]inexperienced observersinexp 176.9 ( 20)30.0 ( 6)inexp 284.6 ( 22)63.6 ( 14)inexp 361.5 ( 16)62.5 ( 10)inexp 480.8 ( 21)23.8 ( 5)inexp 569.2 ( 18)55.6 ( 10)inexp 665.4 ( 17)64.7 ( 11)inexp 757.7 ( 15)66.7 ( 10)total70.9% ( 129)51.2% ( 66)experienced observersexp 176.9 ( 20)65.0 ( 13)exp 261.5 ( 16)81.3 ( 13)exp 369.2 ( 18)83.3 ( 15)exp 473.1 ( 19)89.5 ( 17)exp 584.6 ( 22)77.3 ( 17)exp 680.8 ( 21)42.9 ( 9)exp 769.2 ( 18)38.9 ( 7)total73.6% ( 134)67.9% ( 91 ) percentage of identified nodal stations vs. expert reading percentage of correctly localized nodal stations vs. expert reading ( e.g. , inexp 1 identified 20 out of the 26 stations , and 6 out of 20 were localized correctly).table  5mediastinal lymph node stations by experienced and inexperienced observers , according to mountain and dreslerexpert ( ca)experienced and inexperienced observers2r34l4r678r8lsctmissed2 r ( 1 r)419373134 l ( 5 , 10 l)24114314 r ( 10 r)18185111141971213151258 r ( 9 r)48118 l ( 9 l)91819sc 221463mediastinal lymph node stations using the simplified system mentioned in the  materials and methods section regarding the acceptance of different lymph node classifications , consistent with clinical practice , for expert and both groups of observersca = correct alternative according to simplified system , sc = supra- or infraclavicular lymph nodes , t = tumorobserver identified pertaining mediastinal lymph node as primary or second primary tumor accuracy of inexperienced and experienced observers to detect and localize the 26 mediastinal lymph node stations present according to the expert reading   percentage of identified nodal stations vs. expert reading   percentage of correctly localized nodal stations vs. expert reading ( e.g. , inexp 1 identified 20 out of the 26 stations , and 6 out of 20 were localized correctly ) . mediastinal lymph node stations by experienced and inexperienced observers , according to mountain and dresler mediastinal lymph node stations using the simplified system mentioned in the  materials and methods  section regarding the acceptance of different lymph node classifications , consistent with clinical practice , for expert and both groups of observers ca = correct alternative according to simplified system , sc = supra- or infraclavicular lymph nodes , t = tumor observer identified pertaining mediastinal lymph node as primary or second primary tumor observer variation is the achilles heel of diagnostic imaging   and especially of tests that apply visual interpretation . it is therefore surprising that the clinical pet literature contains few studies on observer variation beyond the level of occasional reports on variation between two observers participating in an accuracy study . the present study reports on the results of 14 observers stratified by their experience with pet , and it accounts for several aspects of the clinical context of nsclc staging ( management recommendation , n - stage , nodal stations ) . we found that the accuracy ( vs. expert reading ) was moderate to substantial at moderate levels of interobserver agreement . our results suggest that clinical experience with pet improves the ability of readers to localize mediastinal hot spots correctly , and this is relevant with respect to the next clinical step : i.e. , to decide which invasive verification method should follow and to enhance the yield of such procedures . moreover , within the more experienced group , the agreement of assigning n - stages and management recommendations tended to be better . finally , familiarity with clinical practice and staging protocols for nsclc patients may have contributed to fewer inconsistencies in management recommendations . our management advice constructs were designed to account for generally recognized limitations of pet in mediastinal staging . with slightly different endpoints , the interobserver agreement of ct reading appears to be similar to what we have reported for pet : in ct evaluation of mediastinal lymph node size , guyatt et al . reported a kappa of 0.61 regarding the presence of any nodes greater than 1  cm on ct scan . however , agreement in different nodal groups varied widely , and it appeared to be far more difficult for the left superior mediastinal nodes . in our study , we found that some mistakes were made relatively more often regarding localizing separate lymph nodes ( table  5 ) . with the increasing clinical methods to verify imaging findings ( transesophageal , transbronchial eus - fna , mediastinoscopy , video - assisted thoracoscopy ) , the relevance of interpreting images at the nodal level is growing . ct helps to improve the yield of pet and ct reading in patients newly presenting with lung cancer , but also in restaging after neoadjuvant therapy . using pet ct in this study , instead of pet alone , would probably have been more clinically relevant . however , we believe that the errors related to localizing suspicious foci will improve with pet  ct , but this is not the case for detection and interpretation errors . other limitations of our study were the relative unfamiliarity of the observers with the display and registration software and , perhaps , the lack of standardized computer screens . in the netherlands , the availability of fdg - pet is rapidly expanding , even in smaller hospitals , and this has major implications for local nuclear medicine physicians , as well as for residents . to our knowledge , the duration of time that is needed before results on pet are adequately reviewed and interpreted (  the learning curve  ) by nuclear medicine physicians is unknown . we had anticipated striking differences between experienced and inexperienced readers , but this was not the case . however , there was obvious room for improvement in the experienced group and we suggest that optimal performance is not acquired by experience alone but requires higher levels of direct feedback . we propose that such feedback could be achieved efficiently in experimental settings like those applied in our study . we believe that data sets like that of the present study should play a key role in the training of residents because they can learn and demonstrate improving skills at any time during their training . however , for example , in the dutch setting , this requires that residents should spend more time in such skill labs and less in daily clinical production . emerging alternatives to invasively stage the mediastinum in nsclc puts high levels of skill to interpret pet and ct scans in nsclc patients . observer variation of pet in mediastinal staging appears to be similar to ct reading , as reported in literature , with obvious room for improvement . training of imaging specialists may require higher levels of feedback , which can more efficiently be obtained in skill labs using existing databases than are currently achievable in local daily clinical practice .
purposeto test the extent of variation among nuclear medicine physicians with respect to staging non - small cell lung cancer with positron emission tomography ( pet).procedurestwo groups of nuclear medicine physicians with different levels of pet experience reviewed 30 pet scans . 
 they were requested to identify and localize suspicious mediastinal lymph nodes ( mln ) using standardized algorithms . 
 results were compared between the two groups , between individuals , and with expert reading.resultsoverall we found good interobserver agreement ( kappa 0.65 ) . 
 experience with pet translated into a better ability to localize mln stations ( 68% vs. 51% , respectively ) , and experienced readers appeared to be more familiar with translating pet readings into clinically useful statements.conclusionsalthough our results suggest that clinical experience with pet increases observers ability to read and interpret results from pet adequately , there is room for improvement . 
 experience with pet does not necessarily improve the accuracy of image interpretation .