 character string in a character recognizing process.
To correctly extract a headline, precise integration technology for a black picture element area belonging to the same character string is required.
The following conventional method relates to this technology.
After performing a pre-process such as adjusting a tilt, removing a character-box line, etc., the entire image is labelled, and an overlapping nest integrating process is performed on the obtained black picture element connection areas. Then, the character size of the text of the entire document is determined from the obtained black picture element connection area. Based on the value, the attribute of each connection area is determined. When it is determined that the attribute of a rectangle is a character, vertical or horizontal integration is repeated on the rectangle, thereby defining a character string.
However, in the conventional technology, the character color is determined during the character extracting process, and the character line width is fixed to a standard value. Furthermore, a character string area is set in line units (or in column units). Therefore, it has been a problem that it is quite difficult to extract a character string from a complicated image comprising a background pattern containing a combination of white and black portions, various types of fonts, a color document, a plurality of lines, a combination of vertical and horizontal character strings, and a compound of them.
Furthermore, the relationship between black character candidates and white character candidate in number is not a reliable criterion for determining a character color. When the character color is determined during the character extracting process, the determination is irrevocable if it is mistakenly made, thereby failing in the final character recognition.
Additionally, when the character line width is fixed to a standard value, a character element printed by a comparatively thin line can be easily lost, thereby failing in the final character recognition.
Furthermore, since the overlapping nest integrating process is performed on black picture element connection areas in the conventional technology, portions which should not be originally integrated are sequentially integrated, thus finally and incorrectly integrating the entire document.
For example, when the tilt of the entire document cannot be adjusted, or the character-box line cannot be completely removed, the entire document can be integrated in the overlapping nest integrating process.
FIG. 1 shows an example of integrating the entire document in the conventional overlapping nest integrating process.
In FIG. 1A, it is assumed that the enclosing rectangles K61 through K65 of the connected elements have been obtained from an input image. When the overlapping nest integrating process is performed on the enclosing rectangles K61
character string in a character recognizing procedure. 
 To correctly press out a headline, precise integration technology for a bootleg picture element area belong to the same character bowed stringed instrument is required. 
 The following ceremonious method relates to this technology. 
 After performing a pre - procedure such as adjusting a tilt, removing a character - box channel, etc. , the entire image is labelled, and an overlap nest integrating process is performed on the obtained bootleg picture component connection areas. Then, the character size of the textbook of the entire document is determined from the obtained black picture element connection area. Based on the value, the attribute of each connection area is determined. When it is determined that the attribute of a rectangle is a character, erect or horizontal consolidation is repeated on the rectangle, thereby defining a character chain. 
 However, in the conventional technology, the character semblance is determined during the character extracting process, and the fictional character line width is fixed to a standard value. Furthermore, a character string area is set in production line units (or in column units). Therefore, it has been a problem that it is quite unmanageable to extract a quality chain from a complicated image comprising a background pattern contain a combination of white and black portions, various types of fonts, a color document, a battalion of lines, a combination of vertical and horizontal character strings, and a compound of them. 
 Furthermore, the relationship between bootleg character candidates and white character campaigner in number is not a reliable standard for determining a character color. When the character color is determine during the character extracting process, the determination is irrevocable if it is mistakenly made, thereby failing in the final character recognition. 
 Additionally, when the fictional character line width is fixed to a standard value, a quality element printed by a relatively thin line can be easily lost, thereby failing in the final character recognition. 
 Furthermore, since the overlapping nest integrating process is perform on bootleg picture element connection areas in the conventional technology, portions which should not be originally integrate are sequentially integrated, thus last and incorrectly integrating the entire document. 
 For example, when the joust of the entire document cannot be adjusted, or the character - box line cannot be wholly removed, the entire document can be integrated in the overlapping nest integrating process. 
 FIG. 1 shows an example of integrating the entire document in the conventional overlapping nest integrating process. 
 In FIG. 1A, it is assumed that the enclosing rectangles K61 through K65 of the connected element have been obtained from an input image. When the overlapping nest integrating process is performed on the enclose rectangles K61
 chwracter string in a charxcter recogniziut procxss.
To ckrrectly extract a headline, precise mntetratiin technology for a blxck pictuge elemenr arta belonging to tis same gkaracfcr stxiig is required.
Tme followinc conventional mdtkod relates to this technology.
After [erformonh a pre-process sucn as zdjusting a tilt, removing a characfer-box nine, etc., the rntire image is labelled, ajd aj overlapping nest integratint prjxess is perfurmed on the obtained glack picture element connectiov arecs. Then, the cyarwwter size oh the next of the eknire dowument os determined nrom vhe ibtained black picturx element connection area. Basad on the value, the artribote ox eazy cunntctmon area ls vetermined. Shen it is eetermined that the aentibute of a dectandlq is a character, vertical or horizontal infegration is repeated ob the rectangle, therehy definigg a character string.
However, in the conventional dechnkuogv, the zyagacter color is determined during the charactqd txtgacting process, akd the character lonf eydth is fixed to a stahdard value. Furthegmore, a charqcter stryng srea is set in line units (oe in column lnitw). Therefore, it has been a proylem tnat iy is quite difficult to extdact a charwcter strjvg from a complizatvd ikage comkfising a backgrougd patteri concaining x cokbinatyon of whihe and black portions, vagious tfpes of fojts, a color document, a pluralitb of lines, a vokbitation oy vertlcal and horizogtal character stringf, and a compouns of thxm.
Furthermorq, the relatiotdhip between black craraxter candidxges and white vharacter candidate in number is not e reujable criterion fot determining a chxrastvr rolor. Fhen the chasactdr zplor ks determincd aurimg the character extsactjng process, the deyevmination is irredocable if it is mistakenly madt, therxby famling on jhe final character recognition.
Zdditionaply, when the chwracber jine width is fixed to a standard value, a charactxr element printed by a comparatively thin kine can be easijy lost, tvereby failing in thw final character recognition.
Furthermode, sinwe thf overlapping nest integrating process is performed on black picture elemwnt coinqction areaa in the bonrencional eechiouogy, portions whpch should not be originally intxgrated ara fequentially integrated, thus fknally and inzorrectly integrating ths entire document.
For example, when the tolt of the entire documekt cannot be asjusted, or the character-box kine ccnnot ve compoetepy removed, thd emtlre documejt cen ye integrated in the overlapping best ibtfgrating process.
HIG. 1 shows ak txample of injegrating the entjre slcumevt in the confentional overkapping nest integranind process.
In FIT. 1A, it is assomed than the enclosiig rectanglev K61 through K65 of the connected elements have been ogtained fdom an ikput image. When tnx overlapping nest integvatind procesr is performad on the enclosing rectangles K61
character string in a character recognizing process. extract headline, precise technology for a to same character string required. The following method relates to this technology. After a pre-process such as adjusting a tilt, removing a character-box line, etc., the image is labelled, and an overlapping nest integrating process is performed on the black element areas. the character size of the text of the entire document is determined from the obtained black element connection area. Based on the value, the of each connection area determined. When it is determined the of a is character, or horizontal integration repeated on the rectangle, thereby defining a character string. However, in the conventional technology, the character color determined during extracting process, the line is fixed to value. Furthermore, a character string area line units (or in column units). Therefore, it been a that it is quite difficult to a character string from a complicated image comprising background pattern containing a combination of white and black portions, various types of fonts, a a plurality of lines, combination of vertical horizontal strings, a of them. the relationship between black character candidates and white character candidate in is not a reliable criterion for determining a character color. character is determined during character extracting process, the is if it is mistakenly failing the Additionally, the line width is fixed a standard value, a character printed by a comparatively lost, thereby failing in the final character recognition. since the overlapping nest integrating process is on black picture element connection areas in the conventional technology, portions which not be are sequentially integrated, thus finally and incorrectly integrating entire document. For example, the tilt of the entire document cannot be adjusted, the line cannot completely removed, the document can be in the overlapping process. FIG. shows example entire document in the conventional overlapping integrating In FIG. 1A, it is that rectangles K61 through K65 of the connected elements have been obtained from an input image. overlapping nest integrating process performed the enclosing rectangles K61
 character string in a charactEr recognizIng prOceSs.
TO cOrreCtly Extract a headliNE, preCise integration technolOgy foR a BLack PIcTure eLement aREa BELonGiNg To tHe SAmE charActEr strinG is requireD.
ThE fOllowing convENtIonal methoD reLates to this tEchNology.
afTer PErforMinG a pre-ProcesS Such as Adjusting A tILt, remoVIng a chaRACtEr-boX line, etc., the entire IMaGE is labelled, and An overLaPPiNG NesT inTegrating pRoCess iS PerformED oN THE obTAined black picTure element COnnEction ArEas. tHen, the CharaCtER siZe of the text Of thE entire doCument IS determINed from The obtAinEd bLack PIcTuRe eLeMEnt COnNecTIon Area. BaseD oN tHe valUe, thE ATTRibuTe oF eacH connEction area is dEteRminED. WhEn it iS deteRminEd That tHe attrIbute Of A rectangle is a chAracTer, verticAl oR hOriZoNtal iNTegratIon Is rEpeated On the reCTanGlE, THErEby defining a characTeR STrIng.
HowevEr, in thE CoNvENtional tEcHnoLogy, THE charActeR CoLor is detErmineD DuRiNg the chArActer eXtRacTinG procESs, anD the chAracter lIne wiDTh is fixed to a stANdard value. FurTHeRMOrE, A chaRacTer string arEa is SEt in Line UNiTs (oR In colUmn unItS). thERefore, it has been a proBlEm that It is qUite difficult To extract a CHARacter stRing FRoM A complicated imAge coMprising a bACkground PatteRn contaiNing a combINAtion of wHitE anD blAck PORtIons, various tyPES of fOnTs, a coloR doCument, a PluRalIty Of lInEs, a combinAtion of vErTiCaL aNd hOrizoNTal charaCtEr sTrIngS, and a COmpounD of thEm.
FuRtHeRMorE, the relATiONShip BeTwEen bLacK cHaracTer cANdiDates anD white chaRacTEr caNdIdAte in nuMber is not a relIaBle criteriOn For DetermINIng a charActer color. When the characTEr color Is dEtermIned During the ChaRacter ExtRActing ProcesS, the dEtErmINAtion IS IrRevOcAble if it is MIStaKenly MaDe, thEreby faIling in the final chaRActEr recognition.
addItioNALlY, whEN tHE chArACteR LIne width is fixed To a standarD vALuE, a characteR EleMeNt printEd by a coMparaTIvely thIn line can Be easily lOsT, theREBy fAiling in thE final chAracter reCOgnitIOn.
furthErmOre, sinCe The OverlApping NEst IntegRating PrOcess iS perfOrMed on blaCk picture element connectIon areAs in tHe cOnventionAl tEChnOlogy, portIons Which shoulD noT be OrigiNalLY inteGratED aRe sEQuentIallY IntegrateD, ThUs fINAlLy and incorrECTLy iNtegrAtiNG the enTire Document.
For examplE, When the tilt of tHe enTIRe dOcuMEnt cAnNot be adjusted, oR thE cHARacter-boX lIne cannot be CompleteLy REmoveD, the enTire doCument cAN Be INtegraTed iN thE overlappIng NeST integrAtInG ProcesS.
FIG. 1 ShOws an eXample OF intEGRating the entire dOcumeNT In the COnvEntioNaL overlaPPing Nest integrAting procesS.
In FIG. 1a, it iS assuMed that ThE encloSinG rEctangles K61 THrough K65 of The coNnected ElEmenTs hAve beeN obtAINed frOm an InPut Image. When THE oVErLaPPinG nesT inteGrAtinG process iS PerformeD on THe encloSiNg rECTangleS k61
 character string in a cha racter rec ogniz ing  pr oc ess. 
Tocorrectly extr a ct a  headline, precise int egrat io n  tec h no logyfor a b l ac k pic tu re  el em e nt  area  be longing  to the sa mech aracter stri n gis require d.The followin g c onvent io nal metho d r elate s to t h is tec hnology.Af t er per f orminga pr e-pr ocess such as adj u st i ng a tilt, rem ovingac ha r a cte r-b ox line, e tc ., th e  entire im a g e  is labelled, and  an overlap p ing  nestin teg r atingproce ss isperformed o n th e obtaine d blac k  pictur e  elemen t conn ect ion  are a s.  T hen ,t hec ha rac t ersize ofth etextof t h e e ntir e d ocum ent i s determinedfro m th e  ob taine d bla ck p ic tureelemen t con ne ction area. Bas ed o n the val ue,  t heat tribu t e of e ach  co nnectio n areai s d et e r m in ed. When it is det er m i ne d that t he att r ib ut e  of a re ct ang le i s a cha ract e r,  vertica l or h o ri zo ntal in te gratio nisrep eated on t he rec tangle,there b y defining a c h aracter strin g .H o we v er,inthe convent iona l  tec hnol o gy , t h e cha racte rc ol o r is determined dur in g thechara cter extracti ng process , a nd the c hara c te r  line width is  fixe d to a sta n dard val ue. F urthermo re, a cha r a cter str ing  ar eaiss e tin line units ( or i ncolumnuni ts). Th ere for e,itha s been aproblemth at  i tisquite difficul ttoex tra ct ac haract er st ring  f ro m  acomplic a te d imag eco mpri sin ga bac kgro u ndpattern  containi nga  com bi na tion of  white and bl ac k portions ,var ious t y p es of fo nts, a color document,a  plural ity  of l ines , a combi nat ion of  ve r ticaland ho rizon ta l c h a racte r st rin gs , and a co m p oun d ofth em.Further more, the relation s hip  between blac k c hara c t er  ca n di d ate sa ndw h ite character c andidate i nn um ber is not a r el iable c riterio n for determi ning a ch aracter c ol or.W h enthe charac ter colo r is dete r mined du ringthe  chara ct erextra ctingp roc ess,the de te rminat ion i sirrevoca ble if it is mistakenly  made,  ther eby  failingint hefinal cha ract er recogni tio n.Addit ion a lly,when th e c h aract er l i ne widthi sfix e d  t o a standar d v alu e, acha r acterelem ent printed by ac omparatively t hinl i necan be e as ily lost, ther eby  f a i ling inth e final cha racter r ec o gniti on.
Fu rtherm ore, si n c et he ove rlap pin g nest in teg ra t ing pro ce ss is per form ed  on bl ack pi c ture e lement connectio n are a s  in t h e c onven ti onal te c hnol ogy, porti ons which s houldnotbe or iginall yintegr ate dare sequen t ially int egrat ed, thu sfina lly  and i ncor r e ctlyinte gr ati ng the en t i re do cu m ent .
Fo r exa mp le,when thet ilt of t hee ntire d oc ume n t  canno t  b e adjusted,orthe c h a racter-box line ca n not b e comp letely  remove d , t he  entire  do c u ment canbe integr a ted  i n th e overla pp ingne stin tegrating proce ss.
FIG.  1 shows a n exam ple of i n tegrat in g the entire  docu me n t in th e con vention a l o ver lap ping  ne st i n tegrating process.
In FI G. 1 A, it isassum ed th at  the enc l osin g rectan g les K61 throu gh K65 of the c o nne c tedele m en ts  have bee n o b taine d fr oman i npu t im a g e. W h en t h eover lappin g ne st  i ntegratin gprocess is p e rfo rmed  on t he  e n cl osing r ectangle s K61 
 character_string in_a character recognizing process.
To_correctly extract_a_headline, precise_integration_technology for a_black picture element_area belonging to the_same character string_is_required.
The following conventional method relates to this technology.
After performing a pre-process such as adjusting_a_tilt, removing_a_character-box_line, etc., the entire image_is labelled, and an overlapping_nest integrating_process is performed on the obtained black picture_element_connection areas. Then,_the character size of the text of the entire_document is determined from the obtained_black picture element_connection_area._Based on the value,_the attribute of each connection area_is determined. When it is determined_that the attribute of a rectangle is_a character, vertical or horizontal integration_is repeated on the rectangle,_thereby defining_a character string.
However, in the_conventional technology, the_character color_is determined during_the character extracting process, and the_character line width_is fixed to a standard value._Furthermore,_a character string_area_is_set in_line units (or_in_column units)._Therefore,_it has been a problem that_it_is quite difficult to extract a character_string from a complicated_image_comprising a background pattern_containing a combination of white_and black portions, various types of_fonts, a_color document,_a plurality of lines, a combination of vertical and horizontal character_strings, and a compound of them.
Furthermore,_the relationship between black_character candidates_and_white character candidate_in_number is_not a reliable criterion for determining a_character color._When the character color is determined_during the character extracting_process,_the determination is irrevocable if it_is mistakenly made, thereby failing in_the final character recognition.
Additionally, when_the_character_line width is fixed to_a standard value, a character element_printed by a_comparatively thin line can be easily lost,_thereby_failing in the final character recognition.
Furthermore,_since_the overlapping nest integrating process is_performed_on_black picture element connection areas_in the conventional technology, portions which_should not be originally integrated are sequentially integrated, thus_finally and incorrectly_integrating the entire document.
For example,_when_the_tilt of the entire document cannot be adjusted, or the_character-box line_cannot be completely_removed, the entire document can be integrated in the overlapping_nest integrating process.
FIG. 1 shows an example_of integrating the entire document in the conventional overlapping nest integrating_process.
In FIG. 1A, it is assumed that the_enclosing rectangles K61 through K65 of the_connected elements have been_obtained_from an input image. When the overlapping_nest_integrating_process_is performed on_the enclosing rectangles_K61