# # ChangeLog for main/trunk/greenstone2/perllib # # Generated by Trac 1.4.2 # 2024-05-01T18:00:39+12:00 Tue, 17 Aug 2010 00:14:00 GMT kjdon [22641] * main/trunk/greenstone2/perllib/plugins/WordPlugin.pm (modified) now inherits from OOConvertBinaryFile. still a couple of things to ... Mon, 16 Aug 2010 23:55:39 GMT kjdon [22640] * main/trunk/greenstone2/perllib/plugins/PowerPointPlugin.pm (modified) now uses new OOConvertBInaryFile super class Mon, 16 Aug 2010 23:46:43 GMT kjdon [22639] * main/trunk/greenstone2/perllib/plugins/ExcelPlugin.pm (modified) now uses new OOConvertBinaryFile as super class Mon, 16 Aug 2010 23:39:59 GMT kjdon [22638] * main/trunk/greenstone2/perllib/plugins/OOConvertBinaryFile.pm (added) new ConvertBinaryFile plugin that will include OpenOfficeConverter if ... Sun, 15 Aug 2010 23:41:22 GMT davidb [22636] * main/trunk/greenstone2/perllib/plugins/HTMLPlugin.pm (modified) Using -utf8 as options to html-tidy leads to wrong encoding for HTML ... Fri, 13 Aug 2010 04:52:49 GMT mdewsnip [22632] * main/trunk/greenstone2/perllib/plugins/BasePlugin.pm (modified) Changed "use textcat" to a "require textcat", so it is only loaded if ... Thu, 12 Aug 2010 03:59:23 GMT kjdon [22612] * main/trunk/greenstone2/perllib/plugins/ImagePlugin.pm (modified) made the default process exp a bit nicer to read Thu, 12 Aug 2010 03:58:39 GMT kjdon [22611] * main/trunk/greenstone2/perllib/plugins/WordPlugin.pm (modified) now uses OpenOfficeConverter that is not ConvertBinaryFile Tue, 10 Aug 2010 02:31:53 GMT kjdon [22597] * main/trunk/greenstone2/perllib/plugins/CONTENTdmPlugin.pm (modified) * main/trunk/greenstone2/perllib/plugins/ConvertBinaryFile.pm (modified) * main/trunk/greenstone2/perllib/plugins/ExcelPlugin.pm (modified) * main/trunk/greenstone2/perllib/plugins/PDFPlugin.pm (modified) * main/trunk/greenstone2/perllib/plugins/PostScriptPlugin.pm (modified) * main/trunk/greenstone2/perllib/plugins/PowerPointPlugin.pm (modified) * main/trunk/greenstone2/perllib/plugins/RTFPlugin.pm (modified) * main/trunk/greenstone2/perllib/plugins/WordPlugin.pm (modified) code tidy up. rearranged how convertbinaryfile plugins set up their ... Mon, 09 Aug 2010 23:51:17 GMT kjdon [22594] * main/trunk/greenstone2/perllib/plugins/HTMLPlugin.pm (modified) committing for davidb. pipe output of tidy to /dev/null if verbosity ... Mon, 09 Aug 2010 03:18:31 GMT kjdon [22590] * main/trunk/greenstone2/perllib/basebuildproc.pm (modified) perl told me to replace \1 and \2 with $1 and $2 Wed, 04 Aug 2010 03:56:11 GMT kjdon [22567] * main/trunk/greenstone2/perllib/inexport.pm (modified) the last step in mark_docs_for_deletion, only do it in delete mode. ... Wed, 04 Aug 2010 02:01:35 GMT kjdon [22565] * main/trunk/greenstone2/perllib/plugins/PagedImagePlugin.pm (modified) removed block exp. now it scans the item file to work out which files ... Mon, 02 Aug 2010 01:16:37 GMT ak19 [22553] * main/trunk/greenstone2/perllib/Unicode (added) * main/trunk/greenstone2/perllib/Unicode/Collate (added) * main/trunk/greenstone2/perllib/Unicode/Collate/UnicodeLicenseAgreement.txt (added) * main/trunk/greenstone2/perllib/Unicode/Collate/allkeys.txt (added) To turn the sort-using-unicode-collation option of the generic List ... Sun, 01 Aug 2010 23:00:20 GMT kjdon [22552] * main/trunk/greenstone2/perllib/plugins/EmbeddedMetadataPlugin.pm (modified) by default we want this to process all files, so changed default ... Sat, 31 Jul 2010 11:23:32 GMT max [22536] * main/trunk/greenstone2/perllib/basebuildproc.pm (modified) Fix the bug where metadata containing back slashes would endlessly be ... Sat, 31 Jul 2010 11:19:35 GMT max [22535] * main/trunk/greenstone2/perllib/inexport.pm (modified) Minor cleanup Tue, 27 Jul 2010 04:07:18 GMT kjdon [22515] * main/trunk/greenstone2/perllib/plugins/ExcelPlugin.pm (modified) * main/trunk/greenstone2/perllib/plugins/PowerPointPlugin.pm (modified) added open office support for PowerPoint and Excel plugins. followed ... Tue, 27 Jul 2010 04:06:39 GMT kjdon [22514] * main/trunk/greenstone2/perllib/plugins/WordPlugin.pm (modified) small tidyings Mon, 26 Jul 2010 03:43:40 GMT kjdon [22507] * main/trunk/greenstone2/perllib/plugins/WordPlugin.pm (modified) some moving around and tidying up of code Mon, 26 Jul 2010 01:21:37 GMT kjdon [22505] * main/trunk/greenstone2/perllib/plugins/WordPlugin.pm (modified) added the openoffice_scripting arg here instead of in OpenOfficeConverter Mon, 26 Jul 2010 01:02:50 GMT kjdon [22504] * main/trunk/greenstone2/perllib/plugins/ConvertBinaryFile.pm (modified) for WordPLugin, if openoffice_scripting is set, need to use ... Mon, 26 Jul 2010 01:01:45 GMT kjdon [22503] * main/trunk/greenstone2/perllib/plugins/WordPlugin.pm (modified) StructuredHTMLPlugin needs -description tags if office_scripting is ... Thu, 22 Jul 2010 06:55:18 GMT ak19 [22485] * main/trunk/greenstone2/perllib/buildConfigxml.pm (modified) * main/trunk/greenstone2/perllib/collConfigxml.pm (modified) * main/trunk/greenstone2/perllib/dbutil.pm (modified) * main/trunk/greenstone2/perllib/dbutil/gdbmtxtgz.pm (modified) * main/trunk/greenstone2/perllib/dbutil/mssql.pm (modified) * main/trunk/greenstone2/perllib/dbutil/sqlite.pm (modified) 1. Dr Bainbridge fixed the database perl modules to all have the ... Wed, 21 Jul 2010 04:31:34 GMT davidb [22469] * main/trunk/greenstone2/perllib/convertutil.pm (modified) Debugging statement had been left in. Now commented out Wed, 21 Jul 2010 02:05:39 GMT ak19 [22466] * main/trunk/greenstone2/perllib/inexport.pm (modified) Set archivedir to "" in the first instance Wed, 21 Jul 2010 01:51:53 GMT ak19 [22465] * main/trunk/greenstone2/perllib/plugouts/FedoraMETSPlugout.pm (modified) Improved checking of environment variables for Fedora values in BEGIN ... Wed, 21 Jul 2010 01:49:42 GMT ak19 [22464] * main/trunk/greenstone2/perllib/inexport.pm (modified) Added in missing routine that had forgotten to be brought over from ... Wed, 21 Jul 2010 01:37:55 GMT ak19 [22462] * main/trunk/greenstone2/perllib/plugins/WordPlugin.pm (modified) Commented out useful (but no needed in svn commited version) print ... Wed, 21 Jul 2010 01:15:57 GMT ak19 [22460] * main/trunk/greenstone2/bin/script/export.pl (modified) * main/trunk/greenstone2/perllib/inexport.pm (modified) Reverted to using -exportdir with export.pl rather than 'merged' ... Tue, 20 Jul 2010 21:50:35 GMT sjb48 [22456] * main/trunk/greenstone2/perllib/collConfigxml.pm (modified) Modified collConfigxml.pm to read and configure build options for ... Tue, 20 Jul 2010 03:18:11 GMT kjdon [22451] * main/trunk/greenstone2/perllib/plugins/EmbeddedMetadataPlugin.pm (modified) added metadata_field_separator option. if set eg to ;, will split all ... Tue, 20 Jul 2010 03:10:25 GMT kjdon [22450] * main/trunk/greenstone2/perllib/plugins/ImageConverter.pm (modified) missing argument to autorun_general_cmd. oh the trouble that caused, ... Tue, 20 Jul 2010 02:07:33 GMT kjdon [22448] * main/trunk/greenstone2/perllib/plugins/EmbeddedMetadataPlugin.pm (modified) metadata values mught be array type - add each individual item as a ... Tue, 20 Jul 2010 01:58:05 GMT davidb [22445] * main/trunk/greenstone2/perllib/ParallelInexport.pm (added) * main/trunk/greenstone2/perllib/inexport.pm (modified) Incorporation of top-level parallel_import functionality into code base. Mon, 19 Jul 2010 04:00:18 GMT davidb [22438] * main/trunk/greenstone2/perllib/util.pm (modified) Additional flexibility added in to how get_tmp_filename works with ... Mon, 19 Jul 2010 01:59:55 GMT davidb [22431] * main/trunk/greenstone2/perllib/convertutil.pm (modified) * main/trunk/greenstone2/perllib/plugins/BaseMediaConverter.pm (modified) Correction to caching technique to work with input file rather than ... Mon, 19 Jul 2010 01:27:02 GMT davidb [22428] * main/trunk/greenstone2/perllib/plugins/WordPlugin.pm (modified) Restructuring of WordPlugin to dynamically inherit from ... Mon, 19 Jul 2010 01:25:07 GMT davidb [22427] * main/trunk/greenstone2/perllib/plugins/BasePlugin.pm (modified) * main/trunk/greenstone2/perllib/plugins/ConvertBinaryFile.pm (modified) Adjustment of whitespace Sun, 18 Jul 2010 04:36:56 GMT davidb [22421] * main/trunk/greenstone2/bin/script/export.pl (modified) * main/trunk/greenstone2/bin/script/import.pl (modified) * main/trunk/greenstone2/perllib/inexport.pm (modified) Continued work on refactoring code to have better shared support for ... Fri, 16 Jul 2010 02:13:01 GMT davidb [22413] * main/trunk/greenstone2/bin/script/import.pl (modified) * main/trunk/greenstone2/perllib/inexport.pm (modified) Initial pass at getting the main code to import.pl (and the very ... Fri, 16 Jul 2010 02:09:40 GMT davidb [22412] * main/trunk/greenstone2/perllib/plugins/MetadataXMLPlugin.pm (modified) More accurate comment added Wed, 14 Jul 2010 02:56:21 GMT kjdon [22402] * main/trunk/greenstone2/perllib/strings.properties (modified) added a couple of strings for MediainfoOGVPlugin Wed, 14 Jul 2010 02:55:26 GMT kjdon [22401] * main/trunk/greenstone2/perllib/plugins/MediainfoOGVPlugin.pm (modified) tidied up a bit. Removed options that (I think) will always be set ... Tue, 13 Jul 2010 01:42:11 GMT davidb [22386] * main/trunk/greenstone2/perllib/util.pm (modified) Extra check added to avoid appending/prepending an environment ... Tue, 13 Jul 2010 01:18:34 GMT kjdon [22382] * main/trunk/greenstone2/perllib/classify/Phind.pm (modified) if language is ar for phind, then we set textorientation parameter to ... Fri, 09 Jul 2010 06:30:29 GMT ak19 [22372] * main/trunk/greenstone2/perllib/plugouts/FedoraMETSPlugout.pm (modified) None of Fedora, the GS3 democlient and Greenstone seem to require the ... Wed, 07 Jul 2010 02:04:40 GMT ak19 [22364] * main/trunk/greenstone2/perllib/plugins/MediainfoOGVPlugin.pm (modified) MediainfoOGVPlugin now includes the final changes Arnaud made to his ... Wed, 07 Jul 2010 01:56:37 GMT ak19 [22363] * main/trunk/greenstone2/perllib/plugins/MediainfoOGVPlugin.pm (modified) Adding in the adjustments to the mediainfoogv plugin that were mailed ... Wed, 07 Jul 2010 01:43:30 GMT ak19 [22362] * main/trunk/greenstone2/perllib/plugins/MediainfoOGVPlugin.pm (added) Committing Arnaud Yvan's MediainfoOGVPlugin.pm for the next release ... Tue, 06 Jul 2010 02:52:40 GMT kjdon [22355] * main/trunk/greenstone2/perllib/plugins/HTMLPlugin.pm (modified) previously, when use_realistic_book was set, all files listed in ... Tue, 06 Jul 2010 01:00:40 GMT kjdon [22352] * main/trunk/greenstone2/perllib/mgbuilder.pm (modified) * main/trunk/greenstone2/perllib/mgppbuilder.pm (modified) remove ex. when generating index lists. Don't want any ex. in ... Mon, 05 Jul 2010 22:17:08 GMT davidb [22351] * main/trunk/greenstone2/perllib/plugins/BaseMediaConverter.pm (modified) White-space tidy up Mon, 05 Jul 2010 22:16:47 GMT davidb [22350] * main/trunk/greenstone2/perllib/convertutil.pm (modified) Testing for newer version of cached file had the 'sign' incorrect. ... Mon, 05 Jul 2010 03:46:54 GMT kjdon [22349] * main/trunk/greenstone2/perllib/plugins/PagedImagePlugin.pm (modified) if metadata extracted from item file has a namespace, then prefix it ... Mon, 05 Jul 2010 03:01:12 GMT kjdon [22348] * main/trunk/greenstone2/perllib/plugins/HTMLPlugin.pm (modified) store any extracted metadata that has a namespace as ex.ns.meta Fri, 02 Jul 2010 00:57:33 GMT ak19 [22338] * main/trunk/greenstone2/bin/script/g2f-import.pl (modified) * main/trunk/greenstone2/perllib/plugouts/FedoraMETSPlugout.pm (modified) Image URLs are adjusted to refer to their location in Fedora. Wed, 30 Jun 2010 01:41:37 GMT ak19 [22331] * main/trunk/greenstone2/bin/script/csv-usernames-to-db.pl (modified) * main/trunk/greenstone2/bin/script/export.pl (modified) * main/trunk/greenstone2/bin/script/pluginfo.pl (modified) * main/trunk/greenstone2/perllib/cgiactions/metadataaction.pm (modified) Goes with the changes made in revision 21822: fixed several ... Wed, 30 Jun 2010 01:31:14 GMT kjdon [22330] * main/trunk/greenstone2/perllib/plugins/HTMLPlugin.pm (modified) we want to store the original file name not the tidy filename as the ... Wed, 30 Jun 2010 01:29:33 GMT kjdon [22329] * main/trunk/greenstone2/perllib/plugins/MP3Plugin.pm (modified) changed mp3:meta to ex.id3.meta. apparently id3 isa better name for ... Wed, 30 Jun 2010 00:57:29 GMT kjdon [22328] * main/trunk/greenstone2/perllib/plugouts/BasePlugout.pm (modified) store the path to doc.xml with unix / slashes so that the collection ... Wed, 30 Jun 2010 00:53:11 GMT kjdon [22327] * main/trunk/greenstone2/perllib/inexport.pm (modified) if a file and all its associated files is deleted from import, then ... Mon, 28 Jun 2010 03:24:56 GMT kjdon [22316] * main/trunk/greenstone2/perllib/plugins/OAIPlugin.pm (modified) store extracted namespaced metadata as ex.metadata, eg ex.dc.Title, ... Wed, 23 Jun 2010 02:49:26 GMT kjdon [22296] * main/trunk/greenstone2/perllib/basebuildproc.pm (modified) remove ex. from any metadata before writing it to gdbm file. ... Wed, 23 Jun 2010 02:48:46 GMT kjdon [22294] * main/trunk/greenstone2/perllib/doc.pm (modified) when asking for a piece of metadata, want to remove ex. from the ones ... Wed, 23 Jun 2010 02:47:01 GMT kjdon [22293] * main/trunk/greenstone2/perllib/plugins/EmbeddedMetadataPlugin.pm (modified) extracted metadata is now going to be added as ex.meta, then GLI will ... Tue, 15 Jun 2010 02:40:59 GMT kjdon [22267] * main/trunk/greenstone2/perllib/plugins/OggVorbisPlugin.pm (modified) fixed a mistake in a method name Mon, 14 Jun 2010 03:37:40 GMT kjdon [22264] * main/trunk/greenstone2/perllib/basebuilder.pm (modified) greenstone doesn't like digit only macros when they appear inside ... Thu, 03 Jun 2010 23:36:07 GMT mdewsnip [22232] * main/trunk/greenstone2/perllib/plugins/OAIMetadataXMLPlugin.pm (added) * main/trunk/greenstone2/perllib/plugouts/BasePlugout.pm (modified) * main/trunk/greenstone2/perllib/strings.properties (modified) New OAIMetadataXMLPlugin.pm for extracting information from OAI ... Wed, 02 Jun 2010 03:59:57 GMT kjdon [22222] * main/trunk/greenstone2/perllib/basebuildproc.pm (modified) half way through the process of tidying up incremental stuff. When ... Wed, 02 Jun 2010 03:56:57 GMT kjdon [22221] * main/trunk/greenstone2/perllib/plugin.pm (modified) added commented quote to make emacs colouring proper Wed, 02 Jun 2010 01:41:53 GMT kjdon [22220] * main/trunk/greenstone2/perllib/classify/AllList.pm (modified) in classify, don't readd the document if edit mode is update - all we ... Tue, 01 Jun 2010 03:56:01 GMT kjdon [22216] * main/trunk/greenstone2/perllib/strings.properties (modified) added BasePlugin.store_original_file Tue, 01 Jun 2010 03:54:17 GMT kjdon [22215] * main/trunk/greenstone2/perllib/plugins/BasePlugin.pm (modified) added store_original_file option, used for eg Text, HTML plugins to ... Tue, 25 May 2010 22:56:52 GMT kjdon [22175] * main/trunk/greenstone2/perllib/classify/List.pm (modified) remove prefix and suffix are defined per metadata group, not per ... Wed, 19 May 2010 05:55:59 GMT max [22121] * main/trunk/greenstone2/perllib/dbutil.pm (modified) Test added to insure that there is a valid string to convert into the ... Wed, 19 May 2010 05:52:30 GMT max [22120] * main/trunk/greenstone2/perllib/manifest.pm (modified) Extra check added to allow for documents that do not have any ... Wed, 19 May 2010 05:50:32 GMT max [22119] * main/trunk/greenstone2/perllib/util.pm (modified) Don't check for NTFS anymore because link should take care of saying ... Fri, 14 May 2010 00:34:32 GMT sjm84 [22087] * main/trunk/greenstone2/perllib/plugin.pm (modified) Corrected an error with escaping Fri, 14 May 2010 00:33:34 GMT sjm84 [22086] * main/trunk/greenstone2/perllib/downloaders/OAIDownload.pm (modified) Corrected a small error in the leading comment of OAIDownload.pm: ... Tue, 11 May 2010 22:29:16 GMT sjm84 [22076] * main/trunk/greenstone2/perllib/dbutil/gdbm.pm (modified) * main/trunk/greenstone2/perllib/dbutil/gdbmtxtgz.pm (modified) * main/trunk/greenstone2/perllib/dbutil/jdbm.pm (modified) * main/trunk/greenstone2/perllib/dbutil/sqlite.pm (modified) Added error messages to these files that are printed when a write ... Tue, 11 May 2010 03:13:50 GMT kjdon [22074] * main/trunk/greenstone2/perllib/plugins/EmbeddedMetadataPlugin.pm (modified) extrametadata needs the filename with no subfolder as that is added ... Wed, 05 May 2010 02:54:37 GMT davidb [22038] * main/trunk/greenstone2/perllib/classify/AZCompactList.pm (modified) Tweaked print statment to be more consistent with other classifier ... Wed, 05 May 2010 02:53:53 GMT davidb [22037] * main/trunk/greenstone2/bin/script/export.pl (modified) * main/trunk/greenstone2/bin/script/import.pl (modified) * main/trunk/greenstone2/perllib/manifest.pm (modified) * main/trunk/greenstone2/perllib/plugin.pm (modified) Manifest file processing upgraded to support OIDs. The code then ... Tue, 04 May 2010 04:14:12 GMT davidb [22032] * main/trunk/greenstone2/bin/script/mkcol.pl (modified) * main/trunk/greenstone2/collect/modelcol/etc/collect.cfg (modified) * main/trunk/greenstone2/perllib/strings.properties (modified) Options supported by mkcol.pl expanding to include -buildtype and ... Mon, 03 May 2010 00:06:46 GMT davidb [22010] * main/trunk/greenstone2/perllib/inexport.pm (modified) GDBM reader/writer conflict resulted from swithcing from the (now ... Wed, 28 Apr 2010 03:53:16 GMT kjdon [21981] * main/trunk/greenstone2/perllib/plugins/ConvertBinaryFile.pm (modified) fix for ticket #676. Conversion of pdf to html where two pdfs had the ... Tue, 27 Apr 2010 04:00:59 GMT kjdon [21969] * main/trunk/greenstone2/perllib/classify/List.pm (modified) store the offsets in add_vlist for all the cases, not just for when ... Mon, 26 Apr 2010 23:18:22 GMT kjdon [21958] * main/trunk/greenstone2/perllib/plugins/ExcelPlugin.pm (modified) * main/trunk/greenstone2/perllib/plugins/PowerPointPlugin.pm (modified) ppthtml and xslhtml don't seem to output utf8, so remove the ... Tue, 20 Apr 2010 01:10:05 GMT kjdon [21916] * main/trunk/greenstone2/perllib/plugins/MetadataXMLPlugin.pm (modified) made this work with a user specified process_exp so that your ... Mon, 19 Apr 2010 02:05:50 GMT mdewsnip [21905] * main/trunk/greenstone2/perllib/plugins/MetadataXMLPlugin.pm (modified) Changes made by Jeffrey Ke at DL Consulting Ltd to remove the global ... Tue, 13 Apr 2010 03:29:42 GMT kjdon [21876] * main/trunk/greenstone2/perllib/classify/Phind.pm (modified) only process into english clauses if english is the only language, ... Mon, 12 Apr 2010 05:45:35 GMT davidb [21872] * main/trunk/greenstone2/perllib/dbutil/sqlite.pm (modified) sqlite3 can take an sql statement as an extra parameter. Better to ... Mon, 12 Apr 2010 02:54:17 GMT kjdon [21866] * main/trunk/greenstone2/perllib/plugins/ImageConverter.pm (modified) added some code for if identify returns size in mb. Thu, 08 Apr 2010 04:05:31 GMT davidb [21862] * main/trunk/greenstone2/perllib/doc.pm (modified) Documents now have 'lastmodifieddate' added as metadata in yyyymmdd ... Wed, 31 Mar 2010 10:10:19 GMT davidb [21857] * main/trunk/greenstone2/perllib/arcinfo.pm (modified) Removal of GDBM specific code in favour of write_infodb_rawentry() ... Wed, 31 Mar 2010 10:08:43 GMT davidb [21856] * main/trunk/greenstone2/perllib/dbutil.pm (modified) * main/trunk/greenstone2/perllib/dbutil/gdbm.pm (modified) * main/trunk/greenstone2/perllib/dbutil/gdbmtxtgz.pm (modified) * main/trunk/greenstone2/perllib/dbutil/jdbm.pm (modified) * main/trunk/greenstone2/perllib/dbutil/mssql.pm (modified) * main/trunk/greenstone2/perllib/dbutil/sqlite.pm (modified) read_infodb_entry() implemented for sqlite. new ... Thu, 25 Mar 2010 08:09:50 GMT ak19 [21822] * main/trunk/greenstone2/bin/script/buildcol.pl (modified) * main/trunk/greenstone2/bin/script/import.pl (modified) * main/trunk/greenstone2/perllib/XMLParser.pm (modified) * main/trunk/greenstone2/perllib/buildConfigxml.pm (modified) * main/trunk/greenstone2/perllib/collConfigxml.pm (modified) Dr Bainbridge has fixed several perl files that depended on perl 5.8 ... Wed, 17 Mar 2010 02:48:44 GMT kjdon [21803] * main/trunk/greenstone2/perllib/plugins/GreenstoneMETSPlugin.pm (modified) set file_id to null if ID doesn't match FILE.* (previously it was ... Wed, 17 Mar 2010 00:01:20 GMT kjdon [21801] * main/trunk/greenstone2/perllib/plugins/StructuredHTMLPlugin.pm (modified) * main/trunk/greenstone2/perllib/plugins/WordPlugin.pm (modified) extended HTMLPlugin's metadata_field_separator option to Word and ...