Changeset 6584 for trunk/gsdl/bin/script

Timestamp:

2004-01-22T14:17:30+13:00 (20 years ago)

Author:

kjdon

Message:

Fiddled around with segmenting for chinese text. Haven't changed how the
segmentation is done, or what character ranges are used.
But when its done is now controlled by the collect.cfg. There is a new
option, separate_cjk, values true or false, default false. Segmentation
is only done if this is set to true. This is passed as a global option to
all plugins by the import.pl script, so the user just needs to add it
once to the config file, not as an option to all plugins.
The queryaction uses this option too to determine whether or not to segment
the query.

File:

• trunk/gsdl/bin/script/import.pl (modified) (3 diffs)

trunk/gsdl/bin/script/import.pl

@@ -348 +348 @@
     # options must be known before we read the collect.cfg))
     my $plugins = [];
+    my @global_opts = ();
+    
     $configfilename = &util::filename_cat ($ENV{'GSDLCOLLECTDIR'}, "etc", "collect.cfg");
     if (-e $configfilename) {
@@ -414 +416 @@
         $gli = 1;
     }
+
+    # global plugin stuff
+    if (defined $collectcfg->{'separate_cjk'}&& $collectcfg->{'separate_cjk'} =~ /^true$/i) {
+        push @global_opts, "-separate_cjk";
+    }
+    
 
     } else {
@@ -433 +441 @@
 
     # load all the plugins
-    $pluginfo = &plugin::load_plugins ($plugins, $verbosity, $out, $faillog);
+    $pluginfo = &plugin::load_plugins ($plugins, $verbosity, $out, $faillog, \@global_opts);
     if (scalar(@$pluginfo) == 0) {
     print $out &lookup_string("{import.no_plugins_loaded}") . "\n";