ERT                                     41.82           19.48           38.30
  $\text{\sc Hibert}_S$ (in-domain)        42.10           19.70           38.53
  $\text{\sc Hibert}_S$                [**42.31**]{}   [**19.87**]{}   [**38.78**]{}
  $\text{\sc Hibert}_M$                [**42.37**]{}   [**19.95**]{}   [**38.83**]{}

  : Results of various models on the CNNDM test set using full-length F1 (R-1), <span style="font-variant:small-caps;">Rouge-2</span> (R-2), and <span style="font-variant:small-caps;">Rouge-L</span> (R-L).[]{data-label="tbl:cnndaily"}

Our main results on the CNNDM dataset are shown in Table \[tbl:cnndaily\], with abstractive models in the top block and extractive models in the bottom block. Pointer+Coverage [@see:2017:acl], Abstract-ML+RL [@paulus:2017:arxiv] and DCA [@celikyilmaz:2016:naacl] are all sequence to sequence learning based models with copy and coverage modeling, reinforcement learning and deep communicating agents extensions. SentRewrite [@hsu:2018:acl] and [@chen:2018:acl] all try to decompose the word by word summary generation into sentence selection from document and “sentence” level summarization (or compression). [@gehrmann:2018:emnlp] generates summaries by combines a word prediction model with the decoder attention model. The extractive models are usually based on hierarchical encoders (SummaRuNNer; @nallapati:2017:aaai and NeuSum; @cheng:2016:acl). They have been extended with reinforcement learning (Refresh; @Narayan:ea:2018 and BanditSum; @dong:2018:emnlp), Maximal Marginal Relevance (NeuSum-MMR; @zhou:2018:acl), latent variable modeling (LatentSum; @zhang:2018:emnlp) and syntactic compression (JECS; @xu:2019:arxiv). Lead3 is a baseline which simply selects the first three sentences. Our model $\text{\sc Hibert
ERT                                      41.82            19.48            38.30 
   $ \text{\sc Hibert}_S$ (in - domain)         42.10            19.70            38.53 
   $ \text{\sc Hibert}_S$                 [ * * 42.31 * * ] { }    [ * * 19.87 * * ] { }    [ * * 38.78 * * ] { } 
   $ \text{\sc Hibert}_M$                 [ * * 42.37 * * ] { }    [ * * 19.95 * * ] { }    [ * * 38.83 * * ] { } 

  : Results of various model on the CNNDM trial set using full - distance F1 (R-1), < span style="font - variant: small - caps;">Rouge-2</span > (R-2), and < couple style="font - variant: small - caps;">Rouge - L</span > (R - L).[]{data - label="tbl: cnndaily " } 

 Our chief results on the CNNDM dataset are shown in Table \[tbl: cnndaily\ ], with abstractive model in the top block and extractive models in the bottom block. Pointer+Coverage [ @see:2017: acl ], Abstract - ML+RL [ @paulus:2017: arxiv ] and DCA [ @celikyilmaz:2016: naacl ] are all sequence to sequence learning establish models with copy and coverage modeling, reward learning and deep communicating agents extension. SentRewrite [ @hsu:2018: acl ] and [ @chen:2018: acl ] all try to decompose the word by word summary generation into conviction selection from document and “ sentence ” level summarization (or compression). [ @gehrmann:2018: emnlp ] generates summaries by combines a word prediction model with the decoder attention model. The extractive models are usually based on hierarchical encoders (SummaRuNNer; @nallapati:2017: aaai and NeuSum; @cheng:2016: acl). They have been extended with reinforcement eruditeness (Refresh; @Narayan: ea:2018 and BanditSum; @dong:2018: emnlp), Maximal Marginal Relevance (NeuSum - MMR; @zhou:2018: acl), latent variable star modeling (LatentSum; @zhang:2018: emnlp) and syntactic compression (JECS; @xu:2019: arxiv). Lead3 is a baseline which plainly selects the first three sentences. Our exemplar $ \text{\sc Hibert
ERT                                     41.82           19.48           38.30
  $\text{\sc Hibert}_S$ (in-domain)        42.10           19.70           38.53
  $\tdxt{\sc Hibvrt}_S$                [**42.31**]{}   [**19.87**]{}   [**38.78**]{}
  $\text{\sc Hibsvt}_M$                [**42.37**]{}   [**19.95**]{}   [**38.83**]{}

  : Revults of variogs mldels on the CNNDM test set using ftll-lengyh F1 (R-1), <span stylg="font-nawianf:small-caps;">Rouge-2</span> (R-2), and <span styme="font-veriant:small-caps;">Touge-L</span> (R-L).[]{data-label="tbl:cjndally"}

Our main resultd on the CNBDM qqtaset are sfown in Table \[tbl:cnndajly\], with abstractive models in ghe tpp block abd exhtactive modeos in the bottom nkock. Pminter+Cpverage [@see:2017:acl], Abvtrqct-ML+RL [@paulus:2017:arxiv] aid DCA [@celikyilmaz:2016:nawcl] are anl sequence to sequwnxe ledrnitg bxwed moseks with fopb and coverzge modelint, reinforcement leatnybg and deep ckmmunisaeing agents extensions. SentRewrite [@hsu:2018:abl] ahd [@chen:2018:acl] all try to dwcompose the word by aord summwry generation into sentence selection from documant aid “seubcnce” oegel summarization (or compression). [@gehrmann:2018:emnl[] gtnegates summaries bn combines a word lrfdostion model wkth thz dscoder attention mldel. Thg extrqctive moqels are usually based on hieraechical encoberw (SummaRuNNer; @nallcpati:2017:aaai anb NeuSom; @chemg:2016:acl). They have been excended with reinflrcement mdarning (Refresh; @Varsydn:ea:2018 and BanditSum; @dong:2018:emnjp), Maximao Maxginal Rdlevsnce (NquSum-MMR; @zjou:2018:acl), latent variable mldeliug (LadentSum; @zhwng:2018:emnlp) and syntactic compressmpn (JECS; @xu:2019:arcie). Lvad3 is a yaselike which simply selects the fnrst thrze sengences. Our model $\vext{\sc Hibere
ERT 41.82 19.48 38.30 $\text{\sc Hibert}_S$ (in-domain) 38.53 Hibert}_S$ [**42.31**]{} [**38.78**]{} $\text{\sc Hibert}_M$ of models on the test set using F1 (R-1), <span style="font-variant:small-caps;">Rouge-2</span> (R-2), and style="font-variant:small-caps;">Rouge-L</span> (R-L).[]{data-label="tbl:cnndaily"} Our main results on the CNNDM dataset are shown in Table with abstractive models in the top block and extractive models in the bottom Pointer+Coverage Abstract-ML+RL and [@celikyilmaz:2016:naacl] are all sequence to sequence learning based models with copy and coverage modeling, reinforcement learning deep communicating agents extensions. SentRewrite [@hsu:2018:acl] and [@chen:2018:acl] try to decompose the by word summary generation into selection document and level (or [@gehrmann:2018:emnlp] generates summaries combines a word prediction model with the decoder attention model. The extractive models are usually based on encoders (SummaRuNNer; NeuSum; @cheng:2016:acl). have extended reinforcement learning (Refresh; BanditSum; @dong:2018:emnlp), Maximal Marginal Relevance (NeuSum-MMR; modeling (LatentSum; @zhang:2018:emnlp) and syntactic compression (JECS; @xu:2019:arxiv). is a which simply selects the first three Our model $\text{\sc Hibert
ERT                                     41.82           19.48           38.30
  $\text{\sc Hibert}_S$ (in-domain)        42.10           19.70           38.53
  $\tExt{\sc HiberT}_S$                [**42.31**]{}   [**19.87**]{}   [**38.78**]{}
  $\texT{\sc hibErT}_M$                [**42.37**]{}   [**19.95**]{}   [**38.83**]{}

  : ReSultS of various modeLS on tHe CNNDM test set using fulL-lengTh f1 (r-1), <spaN StYle="foNt-variaNT:sMALl-cApS;">ROugE-2</sPAn> (r-2), and <sPan Style="foNt-variant:sMalL-cAps;">Rouge-L</spaN> (r-L).[]{Data-label="tBl:cNndaily"}

Our maIn rEsults On The cnNDM dAtaSet arE shown IN Table \[Tbl:cnndaiLy\], WIth absTRactive MODeLs in The top block and extRAcTIve models in the Bottom BlOCk. pOIntEr+COverage [@see:2017:AcL], AbstRAct-ML+RL [@PAuLUS:2017:ArxIV] and DCA [@celikyIlmaz:2016:naacl] aRE alL sequeNcE to SEquencE learNiNG baSed models wiTh coPy and coveRage moDEling, reINforcemEnt leaRniNg aNd deEP cOmMunIcATinG AgEntS ExtEnsions. SEnTREwritE [@hsu:2018:ACL] ANd [@chEn:2018:aCl] alL try tO decompose the WorD by wORd sUmmarY geneRatiOn Into sEntencE seleCtIon from document And “sEntence” leVel SuMmaRiZatioN (Or compResSioN). [@gehrmaNn:2018:emnlp] GEneRaTES SuMmaries by combines a WoRD PrEdiction Model wITh ThE Decoder aTtEntIon mODEl. The ExtrACtIve modelS are usUAlLy Based on HiErarchIcAl eNcoDers (SUMmaRUNNer; @nAllapati:2017:Aaai aND NeuSum; @cheng:2016:acL). they have been eXTeNDEd WIth rEinForcement leArniNG (RefResh; @nArAyaN:Ea:2018 and bandiTSUM; @dONg:2018:emnlp), Maximal MargiNaL RelevAnce (NEuSum-MMR; @zhou:2018:aCl), latent vaRIABle modelIng (LATeNTSum; @zhang:2018:emnlp) And syNtactic comPRession (JeCS; @xu:2019:Arxiv). LeaD3 is a baselINE which siMplY seLecTs tHE FiRst three senteNCEs. OuR mOdel $\texT{\sc hibert
ERT                                   4 1.8 2        1 9.48         38.3 0
  $\text{\sc Hibert} _S$ ( in - doma i n)        42.1 0      19. 70        38.53
 $\text{\s c H ib ert}_S$             [* *42 .31**]{}   [ **1 9.87** ]{ } [**38 .78 **]{} 
  $\t e xt{\sc  Hibert}_ M$            [ ** 42.3 7**]{}   [**19.95 * *] { }   [**38.83** ]{}

 : Re s u lts  of  various m od els o n  the CN N DM t e sts et using full -length F1( R-1 ), <sp an  st y le="fo nt-va ri a nt: small-caps; ">Ro uge-2</sp an> (R - 2), and <span s tyle=" fon t-v aria n t: sm all -c a ps; " >R oug e -L< /span> ( R- L) .[]{d ata- l a b e l="t bl: cnnd aily" }

Our main r esu ltso n t he CN NDM d atas et  areshownin Ta bl e \[tbl:cnndail y\],  with abs tra ct ive  m odels in the  to p b lock an d extra c tiv em o d el s in the bottom bl oc k .  P ointer+C overag e  [ @s e e:2017:a cl ],Abst r a ct-ML +RL[ @p aulus:20 17:arx i v]  a nd DCA[@ celiky il maz :20 16:na a cl]are al l sequen ce to sequence learn i ng based mode l sw i th copy  an d coveragemode l ing,  rei n fo rce m ent l earni ng an d  deep communicating  a gentsexten sions. SentRe write [@hs u : 2 018:acl]  and [@ c hen:2018:acl]all t ry to deco m pose the  word  by word  summaryg e neration  in tosen ten c e  s election from d ocum en t and “ sen tence”lev elsum mar iz ation (or  compres si on ).  [ @ge hrman n :2018:em nl p]ge ner atess ummari es by  com bi ne s  aword pr e di c t ionmo de l wi thth e dec oder att entionmodel. Th e e x trac ti ve  models  are usuallyba sed on hie ra rch ical e n c oders (S ummaRuNNer; @nallapati: 2 017:aaa i a nd Ne uSum ; @cheng: 201 6:acl) . T h ey hav e been  exte nd edw i th re i n fo rce me nt learnin g (Re fresh ;@Nar ayan:ea :2018 and BanditSu m ; @ dong:2018:emn lp) , Ma x i ma l M a rg i nal  R e lev a n ce (NeuSum-MMR;  @zhou:201 8: a cl ), latentv ari ab le mode ling (L atent S um; @zh ang:2018: emnlp) an dsynt a c tic  compressi on (JECS ; @xu:201 9 :arxi v ).  Lead 3 i s a ba se lin e whi ch sim p lyselec ts the  f irst t hreese ntences.  Our model $\text{\sc H ibert
ERT _ _   _ __ __  _  _   _  __         41.82    __ ___ 19.48   _    _ _38.30
  $\text{\sc Hibert}_S$ (in-domain)   __  _42.10        _  19.70   _  ___  38.53
 _$\text{\sc Hibert}_S$    _     _     [**42.31**]{} _ [**19.87**]{}   [**38.78**]{}
 _$\text{\sc Hibert}_M$   _ _    _  _ _[**42.37**]{}  _[**19.95**]{}   [**38.83**]{}

  :_Results of various_models on the CNNDM test set_using_full-length F1 (R-1),_<span_style="font-variant:small-caps;">Rouge-2</span>_(R-2), and_<span style="font-variant:small-caps;">Rouge-L</span> (R-L).[]{data-label="tbl:cnndaily"}

Our_main_results on_the_CNNDM dataset are shown in Table_\[tbl:cnndaily\],_with abstractive models in the top block_and extractive models in_the_bottom block. Pointer+Coverage [@see:2017:acl],_Abstract-ML+RL [@paulus:2017:arxiv] and DCA [@celikyilmaz:2016:naacl]_are all sequence to sequence learning_based models_with copy_and coverage modeling, reinforcement learning and deep communicating agents extensions. SentRewrite_[@hsu:2018:acl] and [@chen:2018:acl] all try to_decompose the word by_word summary_generation_into sentence selection_from_document and_“sentence” level summarization (or compression). [@gehrmann:2018:emnlp] generates_summaries by_combines a word prediction model with_the decoder attention model._The_extractive models are usually based on_hierarchical encoders (SummaRuNNer; @nallapati:2017:aaai and NeuSum;_@cheng:2016:acl). They have been extended_with_reinforcement_learning (Refresh; @Narayan:ea:2018 and BanditSum;_@dong:2018:emnlp), Maximal Marginal Relevance (NeuSum-MMR; @zhou:2018:acl),_latent variable modeling_(LatentSum; @zhang:2018:emnlp) and syntactic compression (JECS; @xu:2019:arxiv)._Lead3_is a baseline which simply selects_the_first three sentences. Our model $\text{\sc_Hibert