Changeset 16555 for gsdl/trunk/perllib/plugins/ReadTextFile.pm

Timestamp:

2008-07-25T16:54:47+12:00 (16 years ago)

Author:

ak19

Message:

Instead of sub get_language_encoding applying function ensure_utf8 on a copy of the text string to find out if this string is utf8, it uses the new sub check_is_utf8 instead

File:

• gsdl/trunk/perllib/plugins/ReadTextFile.pm (modified) (1 diff)

gsdl/trunk/perllib/plugins/ReadTextFile.pm

@@ -400 +400 @@
     }
 
-    my $text_copy = $text;
-    if ($best_encoding =~ /^iso_8859/ && unicode::ensure_utf8(\$text_copy)==0) {
+    if ($best_encoding =~ /^iso_8859/ && &unicode::check_is_utf8($text)) {
     # the text is valid utf8, so assume that's the real encoding
     # (since textcat is based on probabilities)