# # ChangeLog for gsdl/trunk/perllib # # Generated by Trac 1.4.2 # 2024-05-05T19:45:41+12:00 Wed, 14 Oct 2009 00:34:04 GMT kjdon [20814] * gsdl/trunk/perllib/plugouts/BasePlugout.pm (modified) added a test for meta files list to be defined before using it Mon, 12 Oct 2009 00:33:47 GMT kjdon [20806] * gsdl/trunk/perllib/GDBMUtils.pm (modified) added new line to end of a debug print statement Mon, 12 Oct 2009 00:12:00 GMT kjdon [20804] * gsdl/trunk/perllib/plugins/MetadataCSVPlugin.pm (modified) adding back in the code to store which file metaata came from. used ... Mon, 12 Oct 2009 00:09:18 GMT kjdon [20803] * gsdl/trunk/perllib/plugins/MetadataXMLPlugin.pm (modified) adding back in the code to store which file metaata came from. used ... Mon, 12 Oct 2009 00:07:18 GMT kjdon [20802] * gsdl/trunk/perllib/arcinfo.pm (modified) added set_meta_file_flag method, to mark a metadata file as one in ... Mon, 12 Oct 2009 00:06:40 GMT kjdon [20801] * gsdl/trunk/perllib/plugouts/BasePlugout.pm (modified) meta files go into reverse lookups in a different way - store a flag ... Wed, 07 Oct 2009 02:59:56 GMT kjdon [20795] * gsdl/trunk/perllib/strings.properties (modified) added BasePlugin.processing_tmp_files Wed, 07 Oct 2009 02:59:20 GMT kjdon [20794] * gsdl/trunk/perllib/plugins/MetadataCSVPlugin.pm (modified) don't need to set extrametafile as when a metadata file changes, we ... Wed, 07 Oct 2009 02:57:26 GMT kjdon [20793] * gsdl/trunk/perllib/plugins/MetadataXMLPlugin.pm (modified) don't need to set extrametafile as when a metadata file changes, we ... Wed, 07 Oct 2009 02:55:15 GMT kjdon [20792] * gsdl/trunk/perllib/plugins/OAIPlugin.pm (modified) store the oai file as a metadata fiels for the source doc if is ... Wed, 07 Oct 2009 02:54:37 GMT kjdon [20791] * gsdl/trunk/perllib/plugins/HTMLPlugin.pm (modified) * gsdl/trunk/perllib/plugins/PagedImagePlugin.pm (modified) new option -processing_tmp_files - if set, then don't store the ... Wed, 07 Oct 2009 02:53:19 GMT kjdon [20790] * gsdl/trunk/perllib/plugins/CONTENTdmPlugin.pm (modified) * gsdl/trunk/perllib/plugins/ExcelPlugin.pm (modified) * gsdl/trunk/perllib/plugins/PDFPlugin.pm (modified) * gsdl/trunk/perllib/plugins/PostScriptPlugin.pm (modified) * gsdl/trunk/perllib/plugins/PowerPointPlugin.pm (modified) * gsdl/trunk/perllib/plugins/RTFPlugin.pm (modified) * gsdl/trunk/perllib/plugins/WordPlugin.pm (modified) set -processing_tmp_files option to secondary HTML and PagedImage ... Wed, 07 Oct 2009 02:23:22 GMT kjdon [20788] * gsdl/trunk/perllib/inexport.pm (modified) rewrote _mark_docs_for_deletion. I think the cases for assoc fiel and ... Wed, 07 Oct 2009 00:57:17 GMT kjdon [20787] * gsdl/trunk/perllib/plugins/OAIPlugin.pm (modified) don't overwrite namespace for gi metadata - eg we get gi.Sourcedoc ... Mon, 05 Oct 2009 02:53:42 GMT kjdon [20778] * gsdl/trunk/perllib/plugins/BasePlugin.pm (modified) * gsdl/trunk/perllib/plugins/HTMLPlugin.pm (modified) * gsdl/trunk/perllib/plugins/ISISPlugin.pm (modified) * gsdl/trunk/perllib/plugins/PagedImagePlugin.pm (modified) plugins now need to add any auxiliary source files as source assoc ... Mon, 05 Oct 2009 02:51:12 GMT kjdon [20777] * gsdl/trunk/perllib/plugouts/BasePlugout.pm (modified) save source assoc files as assoc-file in archiveinf instead of using ... Mon, 05 Oct 2009 02:50:20 GMT kjdon [20776] * gsdl/trunk/perllib/inexport.pm (modified) in the middle of fixing small bugs in incremental build. lots of ... Mon, 05 Oct 2009 02:48:44 GMT kjdon [20775] * gsdl/trunk/perllib/doc.pm (modified) we need to store a list of original extra associated files, for ... Mon, 05 Oct 2009 02:43:00 GMT kjdon [20774] * gsdl/trunk/perllib/plugins/HTMLPlugin.pm (modified) moved some of the horrible old methods to the end of the file so that ... Mon, 05 Oct 2009 01:14:20 GMT kjdon [20771] * gsdl/trunk/perllib/plugins/MetadataCSVPlugin.pm (modified) set some things to help with incremental building - ... Thu, 01 Oct 2009 05:58:17 GMT ak19 [20769] * gsdl/trunk/perllib/inexport.pm (modified) Does need to protect windows-style slashes after all. Wed, 30 Sep 2009 02:39:39 GMT kjdon [20766] * gsdl/trunk/perllib/plugins/ConvertBinaryFile.pm (modified) need to set source_path to be the original, not just the source filename Wed, 30 Sep 2009 00:52:07 GMT kjdon [20764] * gsdl/trunk/perllib/inexport.pm (modified) making the reverse lookup contain full paths not relative ones Wed, 30 Sep 2009 00:49:54 GMT kjdon [20763] * gsdl/trunk/perllib/plugouts/BasePlugout.pm (modified) making the reverse lookup contain full paths not relative ones Tue, 29 Sep 2009 22:01:48 GMT kjdon [20760] * gsdl/trunk/perllib/plugins/ArchivesInfPlugin.pm (modified) need to add args to options to get the args to show up in pluginfo.pl Tue, 29 Sep 2009 21:55:27 GMT kjdon [20759] * gsdl/trunk/perllib/strings.properties (modified) removed import.reversesort, added ArchivesInfPlugin.reversesort Tue, 29 Sep 2009 21:54:55 GMT kjdon [20758] * gsdl/trunk/perllib/plugins/ArchivesInfPlugin.pm (modified) moved the reversesort option from import.pl to ArchivesInfPLugin - ... Tue, 29 Sep 2009 06:41:56 GMT kjdon [20747] * gsdl/trunk/perllib/arcinfo.pm (modified) * gsdl/trunk/perllib/plugouts/BasePlugout.pm (modified) sorting the build was broken. arcinfo was storing a sort order, but ... Mon, 28 Sep 2009 03:13:19 GMT kjdon [20732] * gsdl/trunk/perllib/lucenebuildproc.pm (modified) no longer write out gs2:id in a lucenedocument. Always use gs2:docOID ... Mon, 28 Sep 2009 02:00:31 GMT kjdon [20728] * gsdl/trunk/perllib/strings.properties (modified) added a cu2db.desc Mon, 28 Sep 2009 00:12:33 GMT kjdon [20723] * gsdl/trunk/perllib/printusage.pm (modified) changed print_txt_usage to output the description if its defined in ... Wed, 23 Sep 2009 02:47:51 GMT ak19 [20689] * gsdl/trunk/perllib/plugins/HTMLPlugin.pm (modified) Bug fix to metadata_fields that are given rename-values. Wed, 23 Sep 2009 02:17:50 GMT kjdon [20686] * gsdl/trunk/perllib/basebuilder.pm (modified) use incremental instead of keepold to determine whether we are ... Wed, 23 Sep 2009 01:44:10 GMT kjdon [20684] * gsdl/trunk/perllib/strings.properties (modified) modified text for a couple of List options Wed, 23 Sep 2009 01:37:53 GMT kjdon [20683] * gsdl/trunk/perllib/lucenebuilder.pm (modified) use incremental instead of keepold to decide whether to pass ... Wed, 23 Sep 2009 01:35:59 GMT kjdon [20682] * gsdl/trunk/perllib/plugins/PrintInfo.pm (modified) in set_incremental, we want incremental to be 0 if incremental_mode ... Wed, 23 Sep 2009 01:35:00 GMT kjdon [20681] * gsdl/trunk/perllib/basebuilder.pm (modified) only check incremental against is_incremental_capable. keepold may be ... Wed, 23 Sep 2009 00:04:55 GMT mdewsnip [20679] * gsdl/trunk/perllib/classify/List.pm (modified) Fixed up types of partition_type_within_level and ... Mon, 21 Sep 2009 01:56:01 GMT kjdon [20654] * gsdl/trunk/perllib/classify/SimpleList.pm (modified) removed an old debug statement Mon, 21 Sep 2009 01:41:38 GMT kjdon [20653] * gsdl/trunk/perllib/classify/List.pm (modified) if we are updating the classifier ie a document is being ... Mon, 21 Sep 2009 01:35:55 GMT davidb [20651] * gsdl/trunk/perllib/expinfo.pm (modified) * gsdl/trunk/perllib/plugouts/BasePlugout.pm (modified) * gsdl/trunk/perllib/plugouts/MARCXMLPlugout.pm (modified) Updated to support incremental exporting Mon, 21 Sep 2009 00:06:23 GMT kjdon [20647] * gsdl/trunk/perllib/basebuilder.pm (modified) now pass incremental_mode to new method. check keepold/incremental ... Mon, 21 Sep 2009 00:04:28 GMT kjdon [20646] * gsdl/trunk/perllib/scriptutil.pm (modified) if keepold is true, set incremental_mode to onlyadd Mon, 21 Sep 2009 00:03:48 GMT kjdon [20645] * gsdl/trunk/perllib/lucenebuilder.pm (modified) added is_incremental_capable method Sun, 20 Sep 2009 23:59:42 GMT davidb [20643] * gsdl/trunk/perllib/plugouts/METSPlugout.pm (modified) Updated to include meta-files information in 'saveas' Sun, 20 Sep 2009 23:56:49 GMT davidb [20642] * gsdl/trunk/perllib/plugouts/DSpacePlugout.pm (modified) Updated to include meta-files information in 'saveas' Wed, 16 Sep 2009 03:06:14 GMT kjdon [20613] * gsdl/trunk/perllib/plugin.pm (modified) escape backslashes in plugin options before passing to the eval (new ... Wed, 16 Sep 2009 02:25:03 GMT davidb [20610] * gsdl/trunk/perllib/GDBMUtils.pm (modified) parseStringToHash brought out as a useful subroutine in its own right Wed, 16 Sep 2009 02:05:23 GMT kjdon [20609] * gsdl/trunk/perllib/plugins/MARCXMLPlugin.pm (modified) added process_exp arg explicitly to this plugin. Otherwise, due to ... Tue, 15 Sep 2009 22:31:23 GMT kjdon [20605] * gsdl/trunk/perllib/plugins/BasePlugin.pm (modified) check OIDmetadata defined before modifying it - it may not be defined ... Wed, 09 Sep 2009 22:52:26 GMT davidb [20579] * gsdl/trunk/perllib/multiread.pm (modified) Unicode encoding broken down into two steps. Wed, 09 Sep 2009 22:51:48 GMT davidb [20578] * gsdl/trunk/perllib/inexport.pm (modified) * gsdl/trunk/perllib/plugin.pm (modified) * gsdl/trunk/perllib/scriptutil.pm (modified) Changes to support new incremental_mode variable, and to track ... Wed, 09 Sep 2009 22:50:05 GMT davidb [20577] * gsdl/trunk/perllib/plugins/ArchivesInfPlugin.pm (modified) * gsdl/trunk/perllib/plugins/BasePlugin.pm (modified) * gsdl/trunk/perllib/plugins/DirectoryPlugin.pm (modified) * gsdl/trunk/perllib/plugins/MetadataXMLPlugin.pm (modified) * gsdl/trunk/perllib/plugins/PrintInfo.pm (modified) Changes to support new incremental_mode variable, and to track ... Wed, 09 Sep 2009 22:47:48 GMT davidb [20576] * gsdl/trunk/perllib/plugins/HTMLPlugin.pm (modified) Links can now also be to Microsofts's Multimedia Streaming protocol MMS. Wed, 09 Sep 2009 22:46:36 GMT davidb [20575] * gsdl/trunk/perllib/basebuilder.pm (modified) * gsdl/trunk/perllib/classify.pm (modified) Opening of txt2db moved to earlier in the buildcol process. This was ... Sun, 06 Sep 2009 23:45:47 GMT davidb [20541] * gsdl/trunk/perllib/strings.properties (modified) Dictionary strings for new csv-usernames-to-db.pl Sun, 06 Sep 2009 23:44:10 GMT davidb [20540] * gsdl/trunk/perllib/plugins/ImageConverter.pm (modified) Support for cache mode in image converter (currently used in Video ... Sun, 06 Sep 2009 23:42:58 GMT davidb [20539] * gsdl/trunk/perllib/convertutil.pm (modified) Couple of tweaks to do with when caching is run for the very first time Sun, 06 Sep 2009 23:42:04 GMT davidb [20538] * gsdl/trunk/perllib/cgiactions/metadataaction.pm (modified) further development of metadata action Sun, 06 Sep 2009 23:37:15 GMT davidb [20537] * gsdl/trunk/perllib/arcinfo.pm (modified) Minor tweak to DSpace exporting so file handle correctly determined Sun, 06 Sep 2009 23:36:50 GMT davidb [20536] * gsdl/trunk/perllib/plugouts/DSpacePlugout.pm (modified) Minor tweak to DSpace exporting so file handle correctly determined Mon, 31 Aug 2009 03:36:05 GMT kjdon [20454] * gsdl/trunk/perllib/classify/DateList.pm (modified) * gsdl/trunk/perllib/classify/Phind.pm (modified) * gsdl/trunk/perllib/classify/RecentDocumentsList.pm (modified) strip ex from metadata type args Mon, 31 Aug 2009 03:35:42 GMT kjdon [20453] * gsdl/trunk/perllib/classify/BaseClassifier.pm (modified) Phind has things like section:ex.Title in its text field, so added : ... Mon, 31 Aug 2009 03:12:57 GMT kjdon [20451] * gsdl/trunk/perllib/plugins/BasePlugin.pm (modified) * gsdl/trunk/perllib/plugins/OAIPlugin.pm (modified) metadata args may have ex. now. Trim ex. from values Fri, 28 Aug 2009 01:37:36 GMT kjdon [20429] * gsdl/trunk/perllib/classify/AZCompactList.pm (modified) strip ex from metadata and sort arguments Fri, 28 Aug 2009 01:32:12 GMT kjdon [20428] * gsdl/trunk/perllib/classify/AZList.pm (modified) strip ex from metadata argument before using it Fri, 28 Aug 2009 01:28:48 GMT kjdon [20427] * gsdl/trunk/perllib/classify/SimpleList.pm (modified) strip off ex. from metadata and sort arguments Fri, 28 Aug 2009 01:28:26 GMT kjdon [20426] * gsdl/trunk/perllib/classify/BaseClassifier.pm (modified) new strip_ex_from_metadata routine Fri, 28 Aug 2009 01:28:04 GMT kjdon [20425] * gsdl/trunk/perllib/classify/HFileHierarchy.pm (modified) made a subroutine for removing ex. Call this instead of doing it ... Fri, 28 Aug 2009 01:27:46 GMT kjdon [20424] * gsdl/trunk/perllib/classify/List.pm (modified) made a subroutine for removing ex. Call this instead of doing it ... Fri, 28 Aug 2009 00:51:24 GMT kjdon [20422] * gsdl/trunk/perllib/classify/HFileHierarchy.pm (modified) removed some commented out code. strip ex off metadata and sort arguments Fri, 28 Aug 2009 00:48:46 GMT kjdon [20421] * gsdl/trunk/perllib/classify/List.pm (modified) strip off any ex. before getting metadata from doc_obj Fri, 28 Aug 2009 00:06:34 GMT kjdon [20420] * gsdl/trunk/perllib/basebuildproc.pm (modified) strip ex. off languagemetadata, and subcollection field Fri, 28 Aug 2009 00:05:38 GMT kjdon [20419] * gsdl/trunk/perllib/lucenebuildproc.pm (modified) * gsdl/trunk/perllib/mgbuildproc.pm (modified) * gsdl/trunk/perllib/mgppbuildproc.pm (modified) strip off ex. before retrieving metadata for indexing. ex. now valid ... Fri, 28 Aug 2009 00:03:52 GMT kjdon [20418] * gsdl/trunk/perllib/lucenebuilder.pm (modified) * gsdl/trunk/perllib/mgbuilder.pm (modified) * gsdl/trunk/perllib/mgppbuilder.pm (modified) language_metadata was sometimes with an underscore, and sometimes ... Fri, 28 Aug 2009 00:03:03 GMT kjdon [20417] * gsdl/trunk/perllib/doc.pm (modified) changed a typo in comment Fri, 28 Aug 2009 00:02:33 GMT kjdon [20416] * gsdl/trunk/perllib/colcfg.pm (modified) language_metadata was sometimes with an underscore, and sometimes ... Thu, 27 Aug 2009 21:58:05 GMT kjdon [20414] * gsdl/trunk/perllib/plugouts/FedoraMETSPlugout.pm (modified) check whether fedora_version is defined before using it, to avoid an ... Thu, 27 Aug 2009 21:57:18 GMT kjdon [20413] * gsdl/trunk/perllib/util.pm (modified) modifed rename_file to make a bit more efficient when rename_method ... Thu, 27 Aug 2009 21:56:19 GMT kjdon [20412] * gsdl/trunk/perllib/doc.pm (modified) added a couple of comments Tue, 25 Aug 2009 02:43:41 GMT mdewsnip [20390] * gsdl/trunk/perllib/cfgread.pm (modified) Improved cfgread::read_cfg_line() so it doesn't take forever to parse ... Thu, 20 Aug 2009 04:47:23 GMT max [20343] * gsdl/trunk/perllib/convertutil.pm (modified) Update some indentation Tue, 18 Aug 2009 04:50:01 GMT kjdon [20321] * gsdl/trunk/perllib/plugouts/MARCXMLPlugout.pm (modified) use util::locate_config_file instead of hard coding linux paths, for ... Tue, 18 Aug 2009 04:42:28 GMT kjdon [20320] * gsdl/trunk/perllib/plugouts/BasePlugout.pm (modified) some changes to get MARCXML exporting working on windows Wed, 29 Jul 2009 02:57:54 GMT kjdon [20105] * gsdl/trunk/perllib/buildConfigxml.pm (modified) got rid of all stuff not currently usesd (left over from ... Wed, 29 Jul 2009 02:54:56 GMT kjdon [20104] * gsdl/trunk/perllib/collConfigxml.pm (modified) added back the assigned variable, modified DocType Wed, 29 Jul 2009 01:32:12 GMT kjdon [20102] * gsdl/trunk/perllib/buildConfigxml.pm (modified) * gsdl/trunk/perllib/collConfigxml.pm (modified) xiaofeng says that all the flax stuff here is old and not needed any ... Wed, 29 Jul 2009 01:24:48 GMT kjdon [20101] * gsdl/trunk/perllib/colcfg.pm (modified) tidied up the file Wed, 29 Jul 2009 01:24:17 GMT kjdon [20100] * gsdl/trunk/perllib/basebuilder.pm (modified) small changes to do with calls to colcfg methods Wed, 29 Jul 2009 01:23:33 GMT kjdon [20099] * gsdl/trunk/perllib/collConfigxml.pm (modified) removed the buildConfig stuff Wed, 29 Jul 2009 00:13:12 GMT kjdon [20097] * gsdl/trunk/perllib/colcfg.pm (modified) changes for cfgread4gs3 rename Wed, 29 Jul 2009 00:12:47 GMT kjdon [20096] * gsdl/trunk/perllib/buildConfigxml.pm (modified) * gsdl/trunk/perllib/collConfigxml.pm (modified) package name changes Wed, 29 Jul 2009 00:12:24 GMT kjdon [20095] * gsdl/trunk/perllib/basebuilder.pm (modified) changes for cfgread4gs3 renaming, and to make this look for ... Wed, 29 Jul 2009 00:05:42 GMT kjdon [20094] * gsdl/trunk/perllib/buildConfigxml.pm (copied) * gsdl/trunk/perllib/collConfigxml.pm (moved) renamed and copied cfgread4gs3.pm into two files: collConfigxml.pm ... Tue, 21 Jul 2009 23:17:39 GMT kjdon [20065] * gsdl/trunk/perllib/cfgread4gs3.pm (modified) add the default index line for all indexers - currently the runtime ... Fri, 17 Jul 2009 07:05:24 GMT ak19 [20008] * gsdl/trunk/perllib/classify/AZCompactList.pm (modified) * gsdl/trunk/perllib/classify/BaseClassifier.pm (modified) * gsdl/trunk/perllib/classify/List.pm (modified) * gsdl/trunk/perllib/classify/SimpleList.pm (modified) * gsdl/trunk/perllib/strings.properties (modified) Adjusted the code to deal with 1. semicolons and commas separating ... Thu, 16 Jul 2009 22:15:31 GMT davidb [20001] * gsdl/trunk/perllib/plugins/BaseMediaConverter.pm (modified) When testing on Windows, discovered drive letter at start of filename ... Thu, 16 Jul 2009 22:14:23 GMT davidb [20000] * gsdl/trunk/perllib/plugins/MetadataCSVPlugin.pm (modified) CSV filename needs to be make regular-expression 'safe' before it is ... Thu, 16 Jul 2009 22:12:29 GMT davidb [19999] * gsdl/trunk/perllib/plugins/PagedImagePlugin.pm (modified) An empty item file caused the code to loop forever. Offending loop ... Tue, 14 Jul 2009 01:19:37 GMT ak19 [19993] * gsdl/trunk/perllib/plugins/StructuredHTMLPlugin.pm (modified) Dr Bainbridge's fix to deal with spaces in metadata_fields option ...