source: other-projects/nightly-tasks/diffcol/trunk/model-collect/Small-HTML/log/build_log.1369975545163.txt@ 27555

Last change on this file since 27555 was 27555, checked in by ak19, 11 years ago

Redid the Small-HTML collection so it uses the correct name from the ground up now (Small-HTML)
File size: 6.3 KB
Line 
1s
2Command: perl -S /research/ak19/GS2bin_31May2013/bin/script/full-import.pl -gli -language en -collectdir /research/ak19/GS2bin_31May2013/collect -OIDtype hash_on_full_filename smallhtm
3import.pl> Removing current contents of the archives directory...
4import.pl> Global file scan checking directory: /research/ak19/GS2bin_31May2013/collect/smallhtm/import
5import.pl> Global file scan checking directory: /research/ak19/GS2bin_31May2013/collect/smallhtm/import/html_files
6import.pl> Global file scan checking directory: /research/ak19/GS2bin_31May2013/collect/smallhtm/import/html_files/cleves_files
7import.pl> Global file scan checking directory: /research/ak19/GS2bin_31May2013/collect/smallhtm/import/html_files/boleyn_files
8import.pl> Global file scan checking directory: /research/ak19/GS2bin_31May2013/collect/smallhtm/import/html_files/aragon_files
9import.pl> MetadataXMLPlugin: processing metadata.xml
10import.pl> HTMLPlugin processing html_files/cleves.html
11import.pl> util::rm() is deprecated, using FileUtils::removeFiles() instead at /research/ak19/GS2bin_31May2013/perllib/doc.pm line 511
12import.pl> BasePlugout::process couldn't copy the associated file /research/ak19/GS2bin_31May2013/collect/smallhtm/import/html_files/cleves_files/geov2.js to geov2.js
13import.pl> Warning: archiveinf_files_to_field()
14import.pl> /research/ak19/GS2bin_31May2013/collect/smallhtm/import/html_files/cleves_files/geov2.js does not appear to be on the file system
15import.pl> HTMLPlugin processing html_files/boleyn.html
16import.pl> util::rm() is deprecated, using FileUtils::removeFiles() instead at /research/ak19/GS2bin_31May2013/perllib/doc.pm line 511
17import.pl> BasePlugout::process couldn't copy the associated file /research/ak19/GS2bin_31May2013/collect/smallhtm/import/html_files/boleyn_files/geov2.js to geov2.js
18import.pl> Warning: archiveinf_files_to_field()
19import.pl> /research/ak19/GS2bin_31May2013/collect/smallhtm/import/html_files/boleyn_files/geov2.js does not appear to be on the file system
20import.pl> HTMLPlugin processing html_files/aragon.html
21import.pl> util::rm() is deprecated, using FileUtils::removeFiles() instead at /research/ak19/GS2bin_31May2013/perllib/doc.pm line 511
22import.pl> BasePlugout::process couldn't copy the associated file /research/ak19/GS2bin_31May2013/collect/smallhtm/import/html_files/aragon_files/geov2.js to geov2.js
23import.pl> Warning: archiveinf_files_to_field()
24import.pl> /research/ak19/GS2bin_31May2013/collect/smallhtm/import/html_files/aragon_files/geov2.js does not appear to be on the file system
25import.pl> *********************************************
26import.pl> Import complete
27import.pl> *********************************************
28import.pl> * 3 documents were considered for processing
29import.pl> * 3 were processed and included in the collection
30import.pl> Command complete.
31import.pl> Extracting new metadata from archive files.
32import.pl> Archived metadata extraction complete.
33Command: perl -S /research/ak19/GS2bin_31May2013/bin/script/full-buildcol.pl -gli -language en -collectdir /research/ak19/GS2bin_31May2013/collect smallhtm
34buildcol.pl> *** creating the compressed text
35buildcol.pl> collecting text statistics (mgpp_passes -T1)
36buildcol.pl> ArchivesInfPlugin: processing /research/ak19/GS2bin_31May2013/collect/smallhtm/archives/archiveinf-doc.gdb
37buildcol.pl> GreenstoneXMLPlugin: processing HASH01c1e7e6.dir/doc.xml
38buildcol.pl> GreenstoneXMLPlugin: processing HASH017c9afe.dir/doc.xml
39buildcol.pl> GreenstoneXMLPlugin: processing HASHea9284af.dir/doc.xml
40buildcol.pl> Stats (Compressing text from text)
41buildcol.pl> Total bytes in collection: 94761
42buildcol.pl> Total bytes in text: 94764
43buildcol.pl> creating the compression dictionary
44buildcol.pl> compressing the text (mgpp_passes -T2)
45buildcol.pl> ArchivesInfPlugin: processing /research/ak19/GS2bin_31May2013/collect/smallhtm/archives/archiveinf-doc.gdb
46buildcol.pl> GreenstoneXMLPlugin: processing HASH01c1e7e6.dir/doc.xml
47buildcol.pl> GreenstoneXMLPlugin: processing HASH017c9afe.dir/doc.xml
48buildcol.pl> GreenstoneXMLPlugin: processing HASHea9284af.dir/doc.xml
49buildcol.pl> Stats (Compressing text from text)
50buildcol.pl> Total bytes in collection: 94761
51buildcol.pl> Total bytes in text: 94764
52buildcol.pl> *** building index text;dc.Title,ex.dc.Title,Title;Source; in subdirectory idx
53buildcol.pl> creating index dictionary (mgpp_passes -I1)
54buildcol.pl> ArchivesInfPlugin: processing /research/ak19/GS2bin_31May2013/collect/smallhtm/archives/archiveinf-doc.gdb
55buildcol.pl> GreenstoneXMLPlugin: processing HASH01c1e7e6.dir/doc.xml
56buildcol.pl> GreenstoneXMLPlugin: processing HASH017c9afe.dir/doc.xml
57buildcol.pl> GreenstoneXMLPlugin: processing HASHea9284af.dir/doc.xml
58buildcol.pl> Stats (Creating index text;dc.Title,ex.dc.Title,Title;Source;)
59buildcol.pl> Total bytes in collection: 94761
60buildcol.pl> Total bytes in text;dc.Title,ex.dc.Title,Title;Source;: 77744
61buildcol.pl> inverting the text (mgpp_passes -I2)
62buildcol.pl> ArchivesInfPlugin: processing /research/ak19/GS2bin_31May2013/collect/smallhtm/archives/archiveinf-doc.gdb
63buildcol.pl> GreenstoneXMLPlugin: processing HASH01c1e7e6.dir/doc.xml
64buildcol.pl> GreenstoneXMLPlugin: processing HASH017c9afe.dir/doc.xml
65buildcol.pl> GreenstoneXMLPlugin: processing HASHea9284af.dir/doc.xml
66buildcol.pl> Stats (Creating index text;dc.Title,ex.dc.Title,Title;Source;)
67buildcol.pl> Total bytes in collection: 94761
68buildcol.pl> Total bytes in text;dc.Title,ex.dc.Title,Title;Source;: 77744
69buildcol.pl> create the weights file
70buildcol.pl> creating 'on-disk' stemmed dictionary
71buildcol.pl> creating stem indexes
72buildcol.pl> BuildDir: /research/ak19/GS2bin_31May2013/collect/smallhtm/building
73buildcol.pl> *** creating the info database and processing associated files
74buildcol.pl> ArchivesInfPlugin: processing /research/ak19/GS2bin_31May2013/collect/smallhtm/archives/archiveinf-doc.gdb
75buildcol.pl> GreenstoneXMLPlugin: processing HASH01c1e7e6.dir/doc.xml
76buildcol.pl> GreenstoneXMLPlugin: processing HASH017c9afe.dir/doc.xml
77buildcol.pl> GreenstoneXMLPlugin: processing HASHea9284af.dir/doc.xml
78buildcol.pl> *** outputting information for classifier: CL1
79buildcol.pl> *** outputting information for classifier: CL2
80buildcol.pl> *** outputting information for classifier: oai
81buildcol.pl> *** creating auxiliary files
82buildcol.pl> Copying rss-items.rdf file from archives to building (eventually to index)
83buildcol.pl> Command complete.
Note: See TracBrowser for help on using the repository browser.