Changeset 1844 for trunk/gsdl/perllib/doc.pm

Timestamp:

2001-01-19T10:35:13+13:00 (23 years ago)

Author:

sjboddie

Message:

Added an 'auto' argument to BasPlug's '-input_encoding' option ('auto' is
now the default instead of 'ascii'). Wihen -input_encoding is 'auto' textcat
is used to work out the language and encoding of each document prior to
processing it. This allows for documents within the same collection to be
in different encodings and all be imported correctly (as long as they're
in an encoding that's supported - notable exceptions at the moment are
Big5 Chinese and any kind of Japanese).
Doing things this way means each document is read in twice at import time,
no doubt slowing things down considerably. You can therefore still set
-input_encoding explicitly if you know that all your documents are a
particular encoding.

File:

• trunk/gsdl/perllib/doc.pm (modified) (1 diff)

trunk/gsdl/perllib/doc.pm

@@ -130 +130 @@
 }
 
+sub set_source_encoding {
+    my $self = shift (@_);
+    my ($source_encoding) = @_;
+
+    $self->set_metadata_element ($self->get_top_section(), 
+                 "gsdlsourceencoding", 
+                 $source_encoding);
+}
+
+# returns the source_encoding as it was provided
+sub get_source_encoding {
+    my $self = shift (@_);
+    
+    return $self->get_metadata_element ($self->get_top_section(), "gsdlsourceencoding");
+}
+
 sub _escape_text {
     my ($text) = @_;