Changeset 17564 for gsdl/trunk/perllib/basebuildproc.pm

Timestamp:

2008-10-20T15:33:25+13:00 (16 years ago)

Author:

kjdon

Message:

fixed up some stuff to do with indexfieldmap. still working on it, but want to commit what I've done

File:

• gsdl/trunk/perllib/basebuildproc.pm (modified) (2 diffs)

gsdl/trunk/perllib/basebuildproc.pm

@@ -144 +144 @@
     $self->{'num_docs'}      = 0;
     $self->{'num_sections'}  = 0;
-    $self->{'num_bytes'}     = 0;
+    # reconstructed docs have no text, just metadata, so we need to 
+    # remember how many bytes we had initially
+    $self->{'num_bytes'}     = $self->{'starting_num_bytes'};
     
     $self->{'num_processed_bytes'} = 0;
@@ -425 +427 @@
     # update a few statistics
     $self->{'num_bytes'} += $doc_obj->get_text_length ($section);
+    print STDERR "num bytes added = ".$doc_obj->get_text_length ($section)."\n";
     $self->{'num_sections'} += 1 unless ($doctype eq "classification");