Changeset 3248

Timestamp:

2002-07-11T18:11:01+12:00 (22 years ago)

Author:

jrm21

Message:

If we convert to HTML, we post-process to change named entities (eg é)
to utf-8.

File:

• trunk/gsdl/perllib/plugins/ConvertToPlug.pm (modified) (1 diff)

trunk/gsdl/perllib/plugins/ConvertToPlug.pm

@@ -272 +272 @@
     }
 
+    # if we converted to HTML, convert é and etc to utf-8.
+    # this should really happen before language_extraction, but that means
+    # modifying a file on disk...
+    $text =~ s/&([^;]+);/&ghtml::getcharequiv($1,0)/ge;
+
     # create a new document
     my $doc_obj = new doc ($conv_filename, "indexed_doc");