# [tex-hyphen] String preparation

Arthur Reutenauer arthur.reutenauer at normalesup.org
Wed May 25 21:09:56 CEST 2016

> I think the main point is that it is not treated the same way as œ. For
> instance with right/lefthyphenmin = 2, we have
>
> œ́-di-pus
> œdi-pus

If that’s what the patterns do, they should be fixed, and \left and
\righthyphenmin set to something more useful.  That’s what we have for
Sanskrit, for example, where notionally TeX could break after any
grapheme at the beginning of a word, but we can’t specify that easily,
so \lefthyphenmin is set to 1 and there are patterns of (if I remember
correctly) up to 5 characters to prevent graphemes to be broken up.

> If I understand correctly, you're saying that in order to have œ treated
> as 2 characters (with lefthyphenmin=2), I should have lefthyphenmin=1
> and completely redo the patterns so that all the sequences of two
> characters at the beginning of a word do not get separated... If I
> understood correctly, that just looks terrible...

That’s what should have be done in the first place, of course.  Many
pattern sets have been generated for some specific values of \left and
\righthyphenmin and can’t be used with lower values because that could
cause wrong hyphenation.  This has been the case since Liang created
hyphen.tex.  This is particularly important when using patgen because it
expects a default value for hyphenmins, and will ignore whatever happens
below these thresholds (hence bad breaks could be generated); to be
honest I’m a little surprised that patterns generated by hand aren’t
made to simply work with any values of \left and \righthyphenmins (and
likewise using patgen nowadays should really best be done with all
values set to 0).

Best,

Arthur
{"extraction_info": {"found_math": true, "script_math_tex": 0, "script_math_asciimath": 0, "math_annotations": 0, "math_alttext": 0, "mathml": 0, "mathjax_tag": 0, "mathjax_inline_tex": 0, "mathjax_display_tex": 0, "mathjax_asciimath": 1, "img_math": 0, "codecogs_latex": 0, "wp_latex": 0, "mimetex.cgi": 0, "/images/math/codecogs": 0, "mathtex.cgi": 0, "katex": 0, "math-container": 0, "wp-katex-eq": 0, "align": 0, "equation": 0, "x-ck12": 0, "texerror": 0, "math_score": 0.8484209775924683, "perplexity": 2383.6344017994847}, "config": {"markdown_headings": true, "markdown_code": true, "boilerplate_config": {"ratio_threshold": 0.3, "absolute_threshold": 10, "end_threshold": 15, "enable": true}, "remove_buttons": true, "remove_image_figures": true, "remove_link_clusters": true, "table_config": {"min_rows": 2, "min_cols": 3, "format": "plain"}, "remove_chinese": true, "remove_edit_buttons": true, "extract_latex": true}, "warc_path": "s3://commoncrawl/crawl-data/CC-MAIN-2019-39/segments/1568514573801.14/warc/CC-MAIN-20190920005656-20190920031656-00530.warc.gz"}