wrap: fix wide CJK characters support

Neither Chinese, Japanese nor Korean use spaces as words separators. It
is OK to hard wrap before any symbol (except CJK punctuation which
should probably stay attached to its previous symbol and not be left
alone at the start of a line).

I did not include Japanese Hiragana and Katakana symbols as word breaks
on purpose since these are phonetic alphabets. It didn't make sense to
wrap a line in the middle of a "word" made of these phonetic symbols.

Update the code to allow considering either a space or a CJK known
symbol as a split point for hard wrapping.

Add test case with Chinese, Japanese and Korean generated lorem ipsum
style text.

Signed-off-by: Robin Jarry <robin@jarry.cc>
Tested-by: Runxi Yu <me@runxiyu.org>

0 files changed, 0 insertions, 0 deletions