[STXT Translator] Wrap and use ICU's Character Set Detection feature.

[siarzhuk]

There are set of tickets describing problems with text documents loading:

#3065 [StyledEdit] Bad argument type passed to function #6252 No UTF16 support in StyledEdit or Pe #6447 StyledEdit doesn't check for valid utf-8 #7954 [StyledEdit] shows only small part of file

Documents in some encodings cannot be loaded at all. Current encoding guessing in STXT translator was borrowed from BSD file tool and is not perfect nowadays. From the other side latest version of ICU provides the Character Set Detection support that can be wrapped by our Local Kit and used in STXT translator for more complete support of encodings in Haiku.

PS: This is another post-GCI task that was unfortunately not claimed during GCI 2012.

[siarzhuk]

Those were taken some years ago as potential GCI tasks. Unfortunately no place is available for them in my schedule at this days.

[pulkomandy]

Fixed in hrev50552.

[diver]

Just tried to open text files with cp1251 and KOI8 (after rmattr "be:encoding" file) and StyledEdit can't open them - Unsupported format.

[pulkomandy]

Sample files welcome!