source: other-projects/nightly-tasks/diffcol/trunk/model-collect/Enhanced-PDF/log/build_log.1372915193210.txt@ 27958

Last change on this file since 27958 was 27958, checked in by ak19, 11 years ago

Adding in the Enhanced-PDF model collection
File size: 13.6 KB
Line 
1s
2Command: perl -S /research/ak19/GS2bin_4Jul2013/bin/script/full-import.pl -gli -language en -collectdir /research/ak19/GS2bin_4Jul2013/collect enhanced
3import.pl> AutoLoadConverters: PDFBox Extension to Greenstone detected for PDFPlugin
4import.pl> Removing current contents of the archives directory...
5import.pl> Removing contents of the collection "tmp" directory...
6import.pl> Global file scan checking directory: /research/ak19/GS2bin_4Jul2013/collect/enhanced/import
7import.pl> MetadataXMLPlugin: processing metadata.xml
8import.pl> EmbeddedMetadataPlugin: processing pdf01.pdf
9import.pl> Extracted 15 pieces of metadata from /research/ak19/GS2bin_4Jul2013/collect/enhanced/import/pdf01.pdf EXIF block
10import.pl> EmbeddedMetadataPlugin: processing pdf03.pdf
11import.pl> Extracted 16 pieces of metadata from /research/ak19/GS2bin_4Jul2013/collect/enhanced/import/pdf03.pdf EXIF block
12import.pl> EmbeddedMetadataPlugin: processing pdf05-notext.pdf
13import.pl> Extracted 34 pieces of metadata from /research/ak19/GS2bin_4Jul2013/collect/enhanced/import/pdf05-notext.pdf EXIF block
14import.pl> EmbeddedMetadataPlugin: processing pdf06-weirdchars.pdf
15import.pl> Extracted 16 pieces of metadata from /research/ak19/GS2bin_4Jul2013/collect/enhanced/import/pdf06-weirdchars.pdf EXIF block
16import.pl> Converting pdf01.pdf to pagedimg_jpg format
17import.pl> calling cmd "/usr/bin/perl" -S gsConvert.pl -verbose 2 -pdf_zoom 2 -errlog "/research/ak19/GS2bin_4Jul2013/collect/enhanced/tmp/1372915195/err.log" -output pagedimg_jpg "/research/ak19/GS2bin_4Jul2013/collect/enhanced/tmp/1372915195/pdf01.pdf"
18import.pl> Error executing pdftoimg.pl
19import.pl> pdfpstoimg error log:
20import.pl> util::mk_dir() is deprecated, using FileUtils::makeDirectory() instead at /research/ak19/GS2bin_4Jul2013/bin/script/pdfpstoimg.pl line 76
21import.pl> convert: memory allocation failed `/tmp/magick-136667R9yc9mQcqYx1' @ error/png.c/ReadOnePNGImage/2160.
22import.pl> convert: corrupt image `/tmp/magick-136667R9yc9mQcqYx1' @ error/png.c/ReadPNGImage/3794.
23import.pl> convert: Postscript delegate failed `/research/ak19/GS2bin_4Jul2013/collect/enhanced/tmp/1372915195/pdf01.pdf': No such file or directory @ error/pdf.c/ReadPDFImage/681.
24import.pl> convert: no images defined `/research/ak19/GS2bin_4Jul2013/collect/enhanced/tmp/1372915195/pdf01/pdf01.jpg' @ error/convert.c/ConvertImageCommand/3068.
25import.pl> Convert error for /research/ak19/GS2bin_4Jul2013/collect/enhanced/tmp/1372915195/pdf01.pdf
26import.pl> Could not convert pdf01.pdf to pagedimg_jpg format
27import.pl> util::mk_dir() is deprecated, using FileUtils::makeDirectory() instead at /research/ak19/GS2bin_4Jul2013/bin/script/pdfpstoimg.pl line 76
28import.pl> convert: memory allocation failed `/tmp/magick-136667R9yc9mQcqYx1' @ error/png.c/ReadOnePNGImage/2160.
29import.pl> convert: corrupt image `/tmp/magick-136667R9yc9mQcqYx1' @ error/png.c/ReadPNGImage/3794.
30import.pl> convert: Postscript delegate failed `/research/ak19/GS2bin_4Jul2013/collect/enhanced/tmp/1372915195/pdf01.pdf': No such file or directory @ error/pdf.c/ReadPDFImage/681.
31import.pl> convert: no images defined `/research/ak19/GS2bin_4Jul2013/collect/enhanced/tmp/1372915195/pdf01/pdf01.jpg' @ error/convert.c/ConvertImageCommand/3068.
32import.pl> Convert error for /research/ak19/GS2bin_4Jul2013/collect/enhanced/tmp/1372915195/pdf01.pdf
33import.pl> WARNING: No plugin could process pdf01.pdf
34import.pl> Converting pdf03.pdf to pagedimg_jpg format
35import.pl> calling cmd "/usr/bin/perl" -S gsConvert.pl -verbose 2 -pdf_zoom 2 -errlog "/research/ak19/GS2bin_4Jul2013/collect/enhanced/tmp/1372915196/err.log" -output pagedimg_jpg "/research/ak19/GS2bin_4Jul2013/collect/enhanced/tmp/1372915196/pdf03.pdf"
36import.pl> Error executing pdftoimg.pl
37import.pl> pdfpstoimg error log:
38import.pl> util::mk_dir() is deprecated, using FileUtils::makeDirectory() instead at /research/ak19/GS2bin_4Jul2013/bin/script/pdfpstoimg.pl line 76
39import.pl> convert: memory allocation failed `/tmp/magick-13676QbA_9lAotsjK1' @ error/png.c/ReadOnePNGImage/2160.
40import.pl> convert: corrupt image `/tmp/magick-13676QbA_9lAotsjK1' @ error/png.c/ReadPNGImage/3794.
41import.pl> convert: Postscript delegate failed `/research/ak19/GS2bin_4Jul2013/collect/enhanced/tmp/1372915196/pdf03.pdf': No such file or directory @ error/pdf.c/ReadPDFImage/681.
42import.pl> convert: no images defined `/research/ak19/GS2bin_4Jul2013/collect/enhanced/tmp/1372915196/pdf03/pdf03.jpg' @ error/convert.c/ConvertImageCommand/3068.
43import.pl> Convert error for /research/ak19/GS2bin_4Jul2013/collect/enhanced/tmp/1372915196/pdf03.pdf
44import.pl> Could not convert pdf03.pdf to pagedimg_jpg format
45import.pl> util::mk_dir() is deprecated, using FileUtils::makeDirectory() instead at /research/ak19/GS2bin_4Jul2013/bin/script/pdfpstoimg.pl line 76
46import.pl> convert: memory allocation failed `/tmp/magick-13676QbA_9lAotsjK1' @ error/png.c/ReadOnePNGImage/2160.
47import.pl> convert: corrupt image `/tmp/magick-13676QbA_9lAotsjK1' @ error/png.c/ReadPNGImage/3794.
48import.pl> convert: Postscript delegate failed `/research/ak19/GS2bin_4Jul2013/collect/enhanced/tmp/1372915196/pdf03.pdf': No such file or directory @ error/pdf.c/ReadPDFImage/681.
49import.pl> convert: no images defined `/research/ak19/GS2bin_4Jul2013/collect/enhanced/tmp/1372915196/pdf03/pdf03.jpg' @ error/convert.c/ConvertImageCommand/3068.
50import.pl> Convert error for /research/ak19/GS2bin_4Jul2013/collect/enhanced/tmp/1372915196/pdf03.pdf
51import.pl> WARNING: No plugin could process pdf03.pdf
52import.pl> Converting pdf05-notext.pdf to pagedimg_jpg format
53import.pl> calling cmd "/usr/bin/perl" -S gsConvert.pl -verbose 2 -pdf_zoom 2 -errlog "/research/ak19/GS2bin_4Jul2013/collect/enhanced/tmp/1372915197/err.log" -output pagedimg_jpg "/research/ak19/GS2bin_4Jul2013/collect/enhanced/tmp/1372915197/pdf05-notext.pdf"
54import.pl> Error executing pdftoimg.pl
55import.pl> pdfpstoimg error log:
56import.pl> util::mk_dir() is deprecated, using FileUtils::makeDirectory() instead at /research/ak19/GS2bin_4Jul2013/bin/script/pdfpstoimg.pl line 76
57import.pl> convert: memory allocation failed `/tmp/magick-13686EttKaUTQUnZ11' @ error/png.c/ReadOnePNGImage/2160.
58import.pl> convert: corrupt image `/tmp/magick-13686EttKaUTQUnZ11' @ error/png.c/ReadPNGImage/3794.
59import.pl> convert: Postscript delegate failed `/research/ak19/GS2bin_4Jul2013/collect/enhanced/tmp/1372915197/pdf05-notext.pdf': No such file or directory @ error/pdf.c/ReadPDFImage/681.
60import.pl> convert: no images defined `/research/ak19/GS2bin_4Jul2013/collect/enhanced/tmp/1372915197/pdf05-notext/pdf05-notext.jpg' @ error/convert.c/ConvertImageCommand/3068.
61import.pl> Convert error for /research/ak19/GS2bin_4Jul2013/collect/enhanced/tmp/1372915197/pdf05-notext.pdf
62import.pl> Could not convert pdf05-notext.pdf to pagedimg_jpg format
63import.pl> util::mk_dir() is deprecated, using FileUtils::makeDirectory() instead at /research/ak19/GS2bin_4Jul2013/bin/script/pdfpstoimg.pl line 76
64import.pl> convert: memory allocation failed `/tmp/magick-13686EttKaUTQUnZ11' @ error/png.c/ReadOnePNGImage/2160.
65import.pl> convert: corrupt image `/tmp/magick-13686EttKaUTQUnZ11' @ error/png.c/ReadPNGImage/3794.
66import.pl> convert: Postscript delegate failed `/research/ak19/GS2bin_4Jul2013/collect/enhanced/tmp/1372915197/pdf05-notext.pdf': No such file or directory @ error/pdf.c/ReadPDFImage/681.
67import.pl> convert: no images defined `/research/ak19/GS2bin_4Jul2013/collect/enhanced/tmp/1372915197/pdf05-notext/pdf05-notext.jpg' @ error/convert.c/ConvertImageCommand/3068.
68import.pl> Convert error for /research/ak19/GS2bin_4Jul2013/collect/enhanced/tmp/1372915197/pdf05-notext.pdf
69import.pl> WARNING: No plugin could process pdf05-notext.pdf
70import.pl> Converting pdf06-weirdchars.pdf to pagedimg_jpg format
71import.pl> calling cmd "/usr/bin/perl" -S gsConvert.pl -verbose 2 -pdf_zoom 2 -errlog "/research/ak19/GS2bin_4Jul2013/collect/enhanced/tmp/1372915198/err.log" -output pagedimg_jpg "/research/ak19/GS2bin_4Jul2013/collect/enhanced/tmp/1372915198/pdf06-weirdchars.pdf"
72import.pl> Error executing pdftoimg.pl
73import.pl> pdfpstoimg error log:
74import.pl> util::mk_dir() is deprecated, using FileUtils::makeDirectory() instead at /research/ak19/GS2bin_4Jul2013/bin/script/pdfpstoimg.pl line 76
75import.pl> convert: memory allocation failed `/tmp/magick-13696f3OyloAHui5i1' @ error/png.c/ReadOnePNGImage/2160.
76import.pl> convert: corrupt image `/tmp/magick-13696f3OyloAHui5i1' @ error/png.c/ReadPNGImage/3794.
77import.pl> convert: Postscript delegate failed `/research/ak19/GS2bin_4Jul2013/collect/enhanced/tmp/1372915198/pdf06-weirdchars.pdf': No such file or directory @ error/pdf.c/ReadPDFImage/681.
78import.pl> convert: no images defined `/research/ak19/GS2bin_4Jul2013/collect/enhanced/tmp/1372915198/pdf06-weirdchars/pdf06-weirdchars.jpg' @ error/convert.c/ConvertImageCommand/3068.
79import.pl> Convert error for /research/ak19/GS2bin_4Jul2013/collect/enhanced/tmp/1372915198/pdf06-weirdchars.pdf
80import.pl> Could not convert pdf06-weirdchars.pdf to pagedimg_jpg format
81import.pl> util::mk_dir() is deprecated, using FileUtils::makeDirectory() instead at /research/ak19/GS2bin_4Jul2013/bin/script/pdfpstoimg.pl line 76
82import.pl> convert: memory allocation failed `/tmp/magick-13696f3OyloAHui5i1' @ error/png.c/ReadOnePNGImage/2160.
83import.pl> convert: corrupt image `/tmp/magick-13696f3OyloAHui5i1' @ error/png.c/ReadPNGImage/3794.
84import.pl> convert: Postscript delegate failed `/research/ak19/GS2bin_4Jul2013/collect/enhanced/tmp/1372915198/pdf06-weirdchars.pdf': No such file or directory @ error/pdf.c/ReadPDFImage/681.
85import.pl> convert: no images defined `/research/ak19/GS2bin_4Jul2013/collect/enhanced/tmp/1372915198/pdf06-weirdchars/pdf06-weirdchars.jpg' @ error/convert.c/ConvertImageCommand/3068.
86import.pl> Convert error for /research/ak19/GS2bin_4Jul2013/collect/enhanced/tmp/1372915198/pdf06-weirdchars.pdf
87import.pl> WARNING: No plugin could process pdf06-weirdchars.pdf
88import.pl> *********************************************
89import.pl> Import complete
90import.pl> *********************************************
91import.pl> * 4 documents were considered for processing
92import.pl> * 0 were processed and included in the collection
93import.pl> * 4 were rejected
94import.pl> See /research/ak19/GS2bin_4Jul2013/collect/enhanced/etc/fail.log for a list of unrecognised and/or rejected documents
95import.pl> Command complete.
96import.pl> Extracting new metadata from archive files.
97import.pl> Archived metadata extraction complete.
98Command: perl -S /research/ak19/GS2bin_4Jul2013/bin/script/full-buildcol.pl -gli -language en -collectdir /research/ak19/GS2bin_4Jul2013/collect enhanced
99buildcol.pl> AutoLoadConverters: PDFBox Extension to Greenstone detected for PDFPlugin
100buildcol.pl> *** creating the compressed text
101buildcol.pl> collecting text statistics (mgpp_passes -T1)
102buildcol.pl> WARNING: No plugin could recognise archiveinf-src.gdb
103buildcol.pl> WARNING: No plugin could recognise earliestDatestamp
104buildcol.pl> Stats (Compressing text from text)
105buildcol.pl> Total bytes in collection: 0
106buildcol.pl> Total bytes in text: 0
107buildcol.pl> ***************
108buildcol.pl> WARNING: There is very little or no text to compress
109buildcol.pl> Was this your intention?
110buildcol.pl> ***************
111buildcol.pl> creating the compression dictionary
112buildcol.pl> compressing the text (mgpp_passes -T2)
113buildcol.pl> WARNING: No plugin could recognise archiveinf-src.gdb
114buildcol.pl> WARNING: No plugin could recognise earliestDatestamp
115buildcol.pl> Stats (Compressing text from text)
116buildcol.pl> Total bytes in collection: 0
117buildcol.pl> Total bytes in text: 0
118buildcol.pl> ***************
119buildcol.pl> WARNING: There is very little or no text to compress
120buildcol.pl> Was this your intention?
121buildcol.pl> ***************
122buildcol.pl> *** building index text;dc.Title,ex.dc.Title,Title;Source; in subdirectory idx
123buildcol.pl> creating index dictionary (mgpp_passes -I1)
124buildcol.pl> WARNING: No plugin could recognise archiveinf-src.gdb
125buildcol.pl> WARNING: No plugin could recognise earliestDatestamp
126buildcol.pl> Stats (Creating index text;dc.Title,ex.dc.Title,Title;Source;)
127buildcol.pl> Total bytes in collection: 0
128buildcol.pl> Total bytes in text;dc.Title,ex.dc.Title,Title;Source;: 0
129buildcol.pl> ***************
130buildcol.pl> WARNING: There is very little or no text to process for text;dc.Title,ex.dc.Title,Title;Source;
131buildcol.pl> Was this your intention?
132buildcol.pl> ***************
133buildcol.pl> inverting the text (mgpp_passes -I2)
134buildcol.pl> WARNING: No plugin could recognise archiveinf-src.gdb
135buildcol.pl> WARNING: No plugin could recognise earliestDatestamp
136buildcol.pl> Stats (Creating index text;dc.Title,ex.dc.Title,Title;Source;)
137buildcol.pl> Total bytes in collection: 0
138buildcol.pl> Total bytes in text;dc.Title,ex.dc.Title,Title;Source;: 0
139buildcol.pl> ***************
140buildcol.pl> WARNING: There is very little or no text to process for text;dc.Title,ex.dc.Title,Title;Source;
141buildcol.pl> Was this your intention?
142buildcol.pl> ***************
143buildcol.pl> create the weights file
144buildcol.pl> creating 'on-disk' stemmed dictionary
145buildcol.pl> creating stem indexes
146buildcol.pl> BuildDir: /research/ak19/GS2bin_4Jul2013/collect/enhanced/building
147buildcol.pl> *** creating the info database and processing associated files
148buildcol.pl> WARNING: No plugin could recognise archiveinf-src.gdb
149buildcol.pl> WARNING: No plugin could recognise earliestDatestamp
150buildcol.pl> Warning: No metadata values assigned to dc.Title;ex.Title.
151buildcol.pl> *** outputting information for classifier: CL1
152buildcol.pl> Warning: No metadata values assigned to ex.Source.
153buildcol.pl> *** outputting information for classifier: CL2
154buildcol.pl> *** outputting information for classifier: oai
155buildcol.pl> *** creating auxiliary files
156buildcol.pl> Command complete.
Note: See TracBrowser for help on using the repository browser.