Appendix A) goes here]

   + Organise experimental implementation/testing of tools
     for new metrics

   + Make recommendations on implementation
     - Define core set of'really useful' metrics
     - recommend that CAIDA implement these as a
       'Service Measurement Toolkit'

   + Publish new metric definitions through IPPM or RTFM

   + Produce document "measurement requirements for hardware/software
     vendors."  Publish on CAIDA web pages


-------------------------------------------------------------------------

Appendix A: Questions from the earlier draft CAIDA WG charters


 a. What types of network- and transport-layer metrics are being
    used by ISPs in engineering and operating their networks?
    By Customers for verifying service guarantees?
 b. What new services are being (or are likely to be) offered, e.g.
    DIFFSERV?  Is there a need for higher-layer metrics to better
    monitor and manage these services?
 c. Will these new differentiated transport- and
    application-layer services need new metrics?
 d. How can the service metrics be measured in a multi-ISP
    environment?
 e. How can customers verify these measurements?
 f. What requirements would service measurement introduce for
    equipment vendors?


 g. How relevant are specific techniques (e.g. which flow) and
    points of measurement to specific users (ISP, customer, etc.)
    requirements?
 h. How do these metrics relate to network behavior as perceived
    by users? How do they correlate with performance?

-------------------------------------------------------------------------

Appendix B: Background on the IETF Working Groups


* RTFM WG: Realtime traffic Flow Measurement

RTFM is concerned with passive measurements of two-way traffic flows,
specified in terms of their end-point attributes.  Its primary goal was

To produce an improved Traffic Flow Measurement Model considering at least the
following needs:

 a. Wider range of measurable quantities, e.g. those
    relating to IPv6, and to class of service
 b. Simpler ways to specify flows of interest
 c. Better ways to control access to measured flow data
 d. Strong focus on data reduction capabilities
 e. Efficient hardware implementation


* IPPM WG: IP Performance Measurement

The IPPM WG charter is to develop a set of standard metrics that can
Appendix A) goes here ] 

    + Organise experimental implementation / testing of creature 
      for newfangled metrics 

    + Make recommendations on execution 
      - Define core set of'really useful' prosody 
      - recommend that CAIDA implement these as a 
       ' Service Measurement Toolkit' 

    + Publish fresh metric definitions through IPPM or RTFM 

    + grow document " measurement requirements for hardware / software 
      seller. "   Publish on CAIDA web pages 


 ------------------------------------------------------------------------- 

 Appendix A: Questions from the earlier draft CAIDA WG charters 


  a. What types of network- and conveyance - layer metrics are being 
     used by ISPs in technology and operating their networks? 
     By Customers for verifying overhaul guarantees? 
  b. What fresh services are being (or are likely to be) offered, e.g. 
     DIFFSERV?   Is there a need for high - layer metrics to better 
     monitor and manage these services? 
  c. Will these new differentiated transport- and 
     application - layer services need new metrics? 
  d. How can the service metrics be measured in a multi - ISP 
     environment? 
  e. How can customer control these measurements? 
  f. What prerequisite would service measurement introduce for 
     equipment vendors? 


  g. How relevant are specific techniques (e.g. which menstruate) and 
     points of measurement to specific users (ISP, customer, etc .) 
     requirements? 
  h. How do these metrics associate to network behavior as perceived 
     by users? How do they correlate with performance? 

 ------------------------------------------------------------------------- 

 Appendix B: Background on the IETF Working Groups 


 * RTFM WG: Realtime dealings Flow Measurement 

 RTFM is concerned with passive measurements of two - way traffic flows, 
 specified in terms of their goal - point attributes.   Its primary goal was 

 To produce an improved Traffic Flow Measurement Model regard at least the 
 following needs: 

  a. Wider compass of measurable quantities, e.g. those 
     relating to IPv6, and to class of service 
  b. Simpler way to specify stream of interest 
  c. Better ways to operate access to measure flow datum 
  d. Strong focus on data decrease capabilities 
  e. Efficient hardware implementation 


 * IPPM WG: IP Performance Measurement 

 The IPPM WG charter is to develop a set of standard metrics that can
Appfndix A) goes here]

   + Orgxnise experimenjao implxmentatjon/testivg of tools
     for new metrmcs

   + Maje recommendations on kmplementwtion
     - Dtfine core set of'csally useful' jctricv
     - recommenc that CAIGA implement tvere as a
       'Service Measurement Toojkit'

   + Pkblish new mettic dtfigitikns through IPPM or RTFM

   + Producs documtnt "measurement reauirements for hardware/sofhwarf
     vendors."  Pubpish on CAIEA wqv pages


-------------------------------------------------------------------------

Appenaix A: Quesuimns from tge earlier draft CAIDA WG chartdrs


 a. What typew if jgtwork- and tcanspogt-layer metrigx are teing
    used by ISPs in entineering and operatiig their networks?
    By Custokexs for verifying servucw guatanteas?
 b. Qhag ntw xedvices arx being (or zre likely ro be) offered, e.g.
    DYDFSERV?  Is thsre a geqd for higher-layer metrics to better
    mohitor and manage these wervices?
 c. Will these new diffqrentiated transport- and
    application-layer servhces iedd ucr nehrics?
 d. How can the service metrics be measurqs on a multi-ISP
    environmeny?
 f. Njw can customgrs vernry these measurementd?
 f. Whaj requurements roulc service measurement introeuce for
    vquipment vendors?


 g. Hoc relevant axe spevific techniques (e.g. which fluw) ahd
    pointd of meashfement to specifkc lserv (ISP, customer, etc.)
    requyrements?
 i. How do there mgtrics welate to jetwovn behavior as percfived
    by users? How do they correlate with perhprmance?

-------------------------------------------------------------------------

Appencif B: Backgrobnd on the IETF Worhing Groups


* RTYM WG: Recltime traffic Fmow Meavurement

RTFI is concerneg with passivx measureientw of two-way graffic flows,
slecified pn terns of their end-poikt atjrjbutes.  Its prinari goal was

To prpduze wn ikpwmved Traffic Flod Mdssureoent Model gonrideting at least the
folnowihg needs:

 a. Wider rsnne of meawurable zuantities, e.g. those
    relating to I'v6, and to ckasf of service
 b. Simpler ways to specify vlors of intereft
 c. Better ways to control access to measured flow date
 d. Strong focus on daja reduction capabilijiex
 e. Efficieit harqware impnementation


* IPPM WG: UP Performance Messurement

The IPPM WG dhartes is ho develop a set of standard metrics that can
Appendix A) goes here] + Organise experimental tools new metrics Make recommendations on of'really metrics - recommend CAIDA implement these a 'Service Measurement Toolkit' + Publish metric definitions through IPPM or RTFM + Produce document "measurement requirements for hardware/software Publish on CAIDA web pages ------------------------------------------------------------------------- Appendix A: Questions from the earlier draft WG a. types network- and transport-layer metrics are being used by ISPs in engineering and operating their networks? By for verifying service guarantees? b. What new services being (or are likely be) offered, e.g. DIFFSERV? Is a for higher-layer to monitor manage these services? Will these new differentiated transport- and application-layer services need new metrics? d. How can the service metrics measured in environment? e. can verify measurements? f. What service measurement introduce for equipment vendors? are specific techniques (e.g. which flow) and points measurement to users (ISP, customer, etc.) requirements? h. do these metrics relate to network behavior as by users? How do they correlate with performance? ------------------------------------------------------------------------- Appendix B: Background on the IETF * RTFM WG: Realtime Flow Measurement RTFM concerned passive of traffic flows, in terms of their end-point attributes. Its primary goal was To an improved Traffic Flow Measurement Model considering at least the a. range of measurable e.g. those relating to and class of service b. to flows Better to access to measured flow d. Strong focus on data capabilities e. Efficient hardware Performance Measurement The IPPM WG charter is to a set of standard metrics that can
Appendix A) goes here]

   + Organise ExperimentAl impLemEntAtIon/tEstiNg of tools
     for neW MetrIcs

   + Make recommendations On impLeMEntaTIoN
     - DefiNe core sET oF'REalLy UsEfuL' mETrIcs
     - reComMend thaT CAIDA implEmeNt These as a
       'ServICe measuremenT ToOlkit'

   + Publish New Metric DeFinITions ThrOugh IpPM or RtfM

   + ProdUce documeNt "MEasureMEnt requIREmEnts For hardware/softwaRE
     vENdors."  Publish on cAIDA wEb PAgES


-------------------------------------------------------------------------

appEndIx A: QuestioNs From tHE earlieR DrAFT cAIda WG charters


 a. WHat types of nETwoRk- and tRaNspORt-layeR metrIcS Are Being
    used by iSPs In engineeRing anD OperatiNG their nEtworkS?
    By cusTomeRS fOr VerIfYIng SErVicE GuaRantees?
 b. whAt New seRvicES ARE beiNg (oR are LikelY to be) offered, e.G.
    DIfFSErv?  Is There A need For hIgHer-laYer metRics tO bEtter
    monitor and ManaGe these seRviCeS?
 c. WIlL thesE New difFerEntIated trAnsport- ANd
    aPpLICAtIon-layer services neEd NEW mEtrics?
 d. HOw can tHE sErVIce metriCs Be mEasuRED in a mUlti-isP
    EnvironmEnt?
 e. HoW CaN cUstomerS vErify tHeSe mEasUremeNTs?
 f. WHat reqUirementS woulD Service measureMEnt introduce fOR
    eQUIpMEnt vEndOrs?


 g. How releVant ARe spEcifIC tEchNIques (E.g. whiCh FLoW) And
    points of measuremEnT to speCific Users (ISP, custoMer, etc.)
    requIREMents?
 h. HoW do tHEsE Metrics relate tO netwOrk behavioR As perceiVed
    by Users? How Do they corRELate with PerForManCe?

-------------------------------------------------------------------------

APPEnDix B: BackgrounD ON the iEtF WorkiNg GRoups


* RTfM Wg: ReAltIme TrAffic Flow measuremEnT

RtFm iS coNcernED with pasSiVe mEaSurEmentS Of two-wAy traFfic FlOwS,
SpeCified iN TeRMS of tHeIr End-pOinT aTtribUtes.  iTs pRimary gOal was

To pRodUCe an ImPrOved TraFfic Flow MeasuReMent Model cOnSidEring aT LEast the
fOllowing needs:

 a. Wider rangE Of measuRabLe quaNtitIes, e.g. thosE
    reLating To IpV6, and to Class oF servIcE
 b. SIMPler wAYS tO spEcIfy flows of INTerEst
 c. BEtTer wAys to coNtrol access to measuREd fLow data
 d. StronG foCus oN DAtA reDUcTIon CaPAbiLITies
 e. Efficient hArdware impLeMEnTation


* IPPM wg: IP peRformanCe MeasuRemenT

the IPPM wG charter Is to develOp A set OF StaNdard metriCs that caN
Appendix A) goes here]

  + Organis e exp eri men ta l im plem entation/testi n g of  tools
     for new me trics 
  +M ak e rec ommenda t io n s  on  i mp lem en t at ion
   - Defi ne core se t o f' really usefu l 'metrics
   - recommendtha t CAID Aimp l ement  th ese a s a
     'S ervice Me as u rement Toolkit ' 
  +Publish new metri c  d e finitions thro ugh IP PM or R TFM 

  + Produc edocum e nt "mea s ur e m e ntr equirements f or hardware / sof tware   v endors ."  P ub l ish  on CAIDA w eb p ages


-- ------ - ------- - ------- ------ --- --- ---- - -- -- --- -- - --- - -- --- - --- -------- -
A ppend ix A : Q u esti ons  fro m the  earlier draf t C AIDA WGchart ers

 a.  W hat t ypes o f net wo rk- and transpo rt-l ayer metr ics  a rebe ing
  used  by  IS Ps in e ngineer i ngan d o pe rating their netwo rk s ? 
   By Cu stomer s  f or verifyin gser vice g uaran tees ? 
b. Whatnew se r vi ce s are b ei ng (or  a relik ely t o  be)  offer ed, e.g. 
   D IFFSERV?  Is t h ere a need fo r  h i g he r -lay ermetrics tobett e r
   mo n it ora nd ma nageth e se services?
 c. Willth ese ne w dif ferentiated t ransport-a n d 
    app lica t io n -layer service s nee d new metr i cs?
 d.How c an the s ervice me t r ics be m eas ure d i n a m ul ti-ISP
    en v i ronm en t?
 e.How  can cu sto mer s v eri fy  these me asuremen ts ? f .Wha t req u irements  w oul dser vicem easure mentintr od uc e  fo r
    e q ui p m entve nd ors? 

 g . How  rel e van t are s pecific t ech n ique s(e .g. whi ch flow) and   points o fmea sureme n t  to spec ific users (ISP, custom e r, etc. )
   re quir ements?
h.How do  th e se met rics r elate  t o n e t workb e ha vio ras perceiv e d 
   byus ers?  How do  they correlate wi t h p erformance?
--- ---- - - -- --- - -- - --- -- - --- - - --------------- ---------- -- - -- ---------- - --- 
Appendi x B: Ba ckgro u nd on t he IETF W orking Gr ou ps
*  RT FM WG: Rea ltime tr affic Flo w  Meas u re ment
RT FM isco nce rnedwith p a ssi ve me asurem en ts oftwo-w ay  traffic  flows,
specified in te rms of  thei r e nd-pointatt r ibu tes.  Its  pri mary goalwas 

T o pro duc e  an i mpro v ed  Tr a fficFlow Measureme n tMod e l  c onsideringa t lea st th e
f o llowin g ne eds:

 a. Wider r a nge of measura bleq u ant iti e s, e .g . those
    re lat in g to IPv6,  a nd to class  of serv ic e 
 b.Simple r ways  to spe c i fy flowsof i nte rest
 c.Bet te r  ways t oco n trol a cces sto mea suredf lowd a ta
 d. Strong fo cus o n datar edu ction  c apabili t ies e. Effici ent hardwar e impl emen tatio n


* I PP M WG:IPPe rformanceM easuremen t

Th e IPPMWG  cha rte r is t o de v e lop a  set  o f s tandard m e t ri c sth a t c an
Appendix A)_goes here]

_  + Organise_experimental implementation/testing_of_tools
 __  for_new metrics

 _ + Make recommendations_on implementation
 __  - Define core set of'really useful' metrics
     -_recommend_that CAIDA_implement_these_as a
   _   'Service Measurement_Toolkit'

 _ + Publish new metric definitions through IPPM_or_RTFM

  _+ Produce document "measurement requirements for hardware/software
  _  vendors."  Publish on_CAIDA web pages


-------------------------------------------------------------------------

Appendix_A:_Questions_from the earlier draft_CAIDA WG charters


 a. What types_of network- and transport-layer metrics are_being
    used by ISPs_in engineering and operating their networks?
_   By Customers_for verifying_service guarantees?
 b. What new_services are being_(or are_likely to be)_offered, e.g.
    DIFFSERV?_ Is there_a need for higher-layer metrics to_better
_  _monitor_and_manage these_services?
 c. Will_these_new differentiated_transport-_and
    application-layer services_need_new metrics?
 d. How can the service_metrics be measured in_a_multi-ISP
   _environment?
 e. How can customers_verify these measurements?
 f. What requirements_would service_measurement introduce_for
    equipment vendors?


 g. How relevant are specific_techniques (e.g. which flow) and
 _  points of_measurement to_specific_users (ISP, customer,_etc.)
_ _ requirements?
 h. How do these metrics_relate to_network behavior as perceived
  _ by users? How_do_they correlate with performance?

-------------------------------------------------------------------------

Appendix B: Background_on the IETF Working Groups


* RTFM_WG: Realtime traffic Flow Measurement

RTFM_is_concerned_with passive measurements of two-way_traffic flows,
specified in terms of their_end-point attributes. _Its primary goal was

To produce an improved_Traffic_Flow Measurement Model considering at least_the
following_needs:

 a. Wider range of measurable_quantities,_e.g._those
    relating_to IPv6, and to class of_service
 b. Simpler ways to specify flows of interest
_c. Better ways_to control access to measured_flow_data
_d. Strong focus on data reduction capabilities
 e. Efficient hardware_implementation


* IPPM_WG: IP Performance_Measurement

The IPPM WG charter is to develop a set of_standard metrics that can