# # ChangeLog for gsdl/trunk/perllib # # Generated by Trac 1.4.2 # 2024-05-19T20:51:19+12:00 Thu, 12 Nov 2009 21:02:48 GMT davidb [20935] * gsdl/trunk/perllib/cgiactions/metadataaction.pm (modified) import_file now comes back as full pathname (not just local name ... Wed, 11 Nov 2009 00:26:20 GMT kjdon [20927] * gsdl/trunk/perllib/plugins/EmbeddedMetadataPlugin.pm (modified) added process exp back in but made it empty so that we don't get a ... Tue, 10 Nov 2009 22:28:33 GMT kjdon [20926] * gsdl/trunk/perllib/downloaders/OAIDownload.pm (modified) if can't download a source doc for some reason, move on to the next ... Wed, 04 Nov 2009 02:22:05 GMT kjdon [20904] * gsdl/trunk/perllib/classify/List.pm (modified) approximate size partition, don't do it if too few items Wed, 04 Nov 2009 00:54:05 GMT kjdon [20903] * gsdl/trunk/perllib/plugouts/DSpacePlugout.pm (modified) unix path separator makes this invalid on windows Wed, 04 Nov 2009 00:46:05 GMT kjdon [20902] * gsdl/trunk/perllib/plugouts/BasePlugout.pm (modified) added some missing quotes to filename in applyxslt command Mon, 02 Nov 2009 02:30:47 GMT kjdon [20883] * gsdl/trunk/perllib/strings.properties (modified) modified the EmbeddedMetadataPlugin description, thanks David B Sun, 01 Nov 2009 23:57:30 GMT kjdon [20874] * gsdl/trunk/perllib/plugouts/BasePlugout.pm (modified) applyxslt classes now in a jar file Thu, 29 Oct 2009 21:55:28 GMT kjdon [20865] * gsdl/trunk/perllib/classify/List.pm (modified) changed per_letter_fixed_size to approximate_size, allow the former ... Thu, 29 Oct 2009 21:53:48 GMT kjdon [20864] * gsdl/trunk/perllib/strings.properties (modified) List partition_type options rename Thu, 29 Oct 2009 17:42:12 GMT kjdon [20863] * gsdl/trunk/perllib/strings.properties (modified) MetadataExif changed to EmbeddedMetadata, and description changed ... Thu, 29 Oct 2009 05:59:34 GMT kjdon [20862] * gsdl/trunk/perllib/plugins/EmbeddedMetadataPlugin.pm (modified) plugin name change in file contents. Also, commented out process and ... Thu, 29 Oct 2009 05:32:38 GMT kjdon [20860] * gsdl/trunk/perllib/plugins/EmbeddedMetadataPlugin.pm (moved) file rename for MetadataEXIFPlugin -> EmbeddedMetadataPlugin Wed, 21 Oct 2009 03:11:13 GMT kjdon [20831] * gsdl/trunk/perllib/plugins/OpenDocumentPlugin.pm (modified) added can_process_this_file sub - want to base test on filename, not ... Wed, 21 Oct 2009 03:10:29 GMT kjdon [20830] * gsdl/trunk/perllib/plugins/ReadXMLFile.pm (modified) save filename_no_path and use it to call set_Source_metadata for ... Wed, 21 Oct 2009 02:06:47 GMT kjdon [20828] * gsdl/trunk/perllib/classify/DateList.pm (modified) fixed a bug where when compacting, if the last bucket was retained as ... Mon, 19 Oct 2009 02:25:35 GMT kjdon [20825] * gsdl/trunk/perllib/classify/List.pm (modified) check that the values of the partition_types_within_level option are ... Wed, 14 Oct 2009 23:31:32 GMT mdewsnip [20820] * gsdl/trunk/perllib/cgiactions/baseaction.pm (modified) Fixed a couple of sloppy sloppy bugs in the parameter handling -- ... Wed, 14 Oct 2009 00:34:04 GMT kjdon [20814] * gsdl/trunk/perllib/plugouts/BasePlugout.pm (modified) added a test for meta files list to be defined before using it Mon, 12 Oct 2009 00:33:47 GMT kjdon [20806] * gsdl/trunk/perllib/GDBMUtils.pm (modified) added new line to end of a debug print statement Mon, 12 Oct 2009 00:12:00 GMT kjdon [20804] * gsdl/trunk/perllib/plugins/MetadataCSVPlugin.pm (modified) adding back in the code to store which file metaata came from. used ... Mon, 12 Oct 2009 00:09:18 GMT kjdon [20803] * gsdl/trunk/perllib/plugins/MetadataXMLPlugin.pm (modified) adding back in the code to store which file metaata came from. used ... Mon, 12 Oct 2009 00:07:18 GMT kjdon [20802] * gsdl/trunk/perllib/arcinfo.pm (modified) added set_meta_file_flag method, to mark a metadata file as one in ... Mon, 12 Oct 2009 00:06:40 GMT kjdon [20801] * gsdl/trunk/perllib/plugouts/BasePlugout.pm (modified) meta files go into reverse lookups in a different way - store a flag ... Wed, 07 Oct 2009 02:59:56 GMT kjdon [20795] * gsdl/trunk/perllib/strings.properties (modified) added BasePlugin.processing_tmp_files Wed, 07 Oct 2009 02:59:20 GMT kjdon [20794] * gsdl/trunk/perllib/plugins/MetadataCSVPlugin.pm (modified) don't need to set extrametafile as when a metadata file changes, we ... Wed, 07 Oct 2009 02:57:26 GMT kjdon [20793] * gsdl/trunk/perllib/plugins/MetadataXMLPlugin.pm (modified) don't need to set extrametafile as when a metadata file changes, we ... Wed, 07 Oct 2009 02:55:15 GMT kjdon [20792] * gsdl/trunk/perllib/plugins/OAIPlugin.pm (modified) store the oai file as a metadata fiels for the source doc if is ... Wed, 07 Oct 2009 02:54:37 GMT kjdon [20791] * gsdl/trunk/perllib/plugins/HTMLPlugin.pm (modified) * gsdl/trunk/perllib/plugins/PagedImagePlugin.pm (modified) new option -processing_tmp_files - if set, then don't store the ... Wed, 07 Oct 2009 02:53:19 GMT kjdon [20790] * gsdl/trunk/perllib/plugins/CONTENTdmPlugin.pm (modified) * gsdl/trunk/perllib/plugins/ExcelPlugin.pm (modified) * gsdl/trunk/perllib/plugins/PDFPlugin.pm (modified) * gsdl/trunk/perllib/plugins/PostScriptPlugin.pm (modified) * gsdl/trunk/perllib/plugins/PowerPointPlugin.pm (modified) * gsdl/trunk/perllib/plugins/RTFPlugin.pm (modified) * gsdl/trunk/perllib/plugins/WordPlugin.pm (modified) set -processing_tmp_files option to secondary HTML and PagedImage ... Wed, 07 Oct 2009 02:23:22 GMT kjdon [20788] * gsdl/trunk/perllib/inexport.pm (modified) rewrote _mark_docs_for_deletion. I think the cases for assoc fiel and ... Wed, 07 Oct 2009 00:57:17 GMT kjdon [20787] * gsdl/trunk/perllib/plugins/OAIPlugin.pm (modified) don't overwrite namespace for gi metadata - eg we get gi.Sourcedoc ... Mon, 05 Oct 2009 02:53:42 GMT kjdon [20778] * gsdl/trunk/perllib/plugins/BasePlugin.pm (modified) * gsdl/trunk/perllib/plugins/HTMLPlugin.pm (modified) * gsdl/trunk/perllib/plugins/ISISPlugin.pm (modified) * gsdl/trunk/perllib/plugins/PagedImagePlugin.pm (modified) plugins now need to add any auxiliary source files as source assoc ... Mon, 05 Oct 2009 02:51:12 GMT kjdon [20777] * gsdl/trunk/perllib/plugouts/BasePlugout.pm (modified) save source assoc files as assoc-file in archiveinf instead of using ... Mon, 05 Oct 2009 02:50:20 GMT kjdon [20776] * gsdl/trunk/perllib/inexport.pm (modified) in the middle of fixing small bugs in incremental build. lots of ... Mon, 05 Oct 2009 02:48:44 GMT kjdon [20775] * gsdl/trunk/perllib/doc.pm (modified) we need to store a list of original extra associated files, for ... Mon, 05 Oct 2009 02:43:00 GMT kjdon [20774] * gsdl/trunk/perllib/plugins/HTMLPlugin.pm (modified) moved some of the horrible old methods to the end of the file so that ... Mon, 05 Oct 2009 01:14:20 GMT kjdon [20771] * gsdl/trunk/perllib/plugins/MetadataCSVPlugin.pm (modified) set some things to help with incremental building - ... Thu, 01 Oct 2009 05:58:17 GMT ak19 [20769] * gsdl/trunk/perllib/inexport.pm (modified) Does need to protect windows-style slashes after all. Wed, 30 Sep 2009 02:39:39 GMT kjdon [20766] * gsdl/trunk/perllib/plugins/ConvertBinaryFile.pm (modified) need to set source_path to be the original, not just the source filename Wed, 30 Sep 2009 00:52:07 GMT kjdon [20764] * gsdl/trunk/perllib/inexport.pm (modified) making the reverse lookup contain full paths not relative ones Wed, 30 Sep 2009 00:49:54 GMT kjdon [20763] * gsdl/trunk/perllib/plugouts/BasePlugout.pm (modified) making the reverse lookup contain full paths not relative ones Tue, 29 Sep 2009 22:01:48 GMT kjdon [20760] * gsdl/trunk/perllib/plugins/ArchivesInfPlugin.pm (modified) need to add args to options to get the args to show up in pluginfo.pl Tue, 29 Sep 2009 21:55:27 GMT kjdon [20759] * gsdl/trunk/perllib/strings.properties (modified) removed import.reversesort, added ArchivesInfPlugin.reversesort Tue, 29 Sep 2009 21:54:55 GMT kjdon [20758] * gsdl/trunk/perllib/plugins/ArchivesInfPlugin.pm (modified) moved the reversesort option from import.pl to ArchivesInfPLugin - ... Tue, 29 Sep 2009 06:41:56 GMT kjdon [20747] * gsdl/trunk/perllib/arcinfo.pm (modified) * gsdl/trunk/perllib/plugouts/BasePlugout.pm (modified) sorting the build was broken. arcinfo was storing a sort order, but ... Mon, 28 Sep 2009 03:13:19 GMT kjdon [20732] * gsdl/trunk/perllib/lucenebuildproc.pm (modified) no longer write out gs2:id in a lucenedocument. Always use gs2:docOID ... Mon, 28 Sep 2009 02:00:31 GMT kjdon [20728] * gsdl/trunk/perllib/strings.properties (modified) added a cu2db.desc Mon, 28 Sep 2009 00:12:33 GMT kjdon [20723] * gsdl/trunk/perllib/printusage.pm (modified) changed print_txt_usage to output the description if its defined in ... Wed, 23 Sep 2009 02:47:51 GMT ak19 [20689] * gsdl/trunk/perllib/plugins/HTMLPlugin.pm (modified) Bug fix to metadata_fields that are given rename-values. Wed, 23 Sep 2009 02:17:50 GMT kjdon [20686] * gsdl/trunk/perllib/basebuilder.pm (modified) use incremental instead of keepold to determine whether we are ... Wed, 23 Sep 2009 01:44:10 GMT kjdon [20684] * gsdl/trunk/perllib/strings.properties (modified) modified text for a couple of List options Wed, 23 Sep 2009 01:37:53 GMT kjdon [20683] * gsdl/trunk/perllib/lucenebuilder.pm (modified) use incremental instead of keepold to decide whether to pass ... Wed, 23 Sep 2009 01:35:59 GMT kjdon [20682] * gsdl/trunk/perllib/plugins/PrintInfo.pm (modified) in set_incremental, we want incremental to be 0 if incremental_mode ... Wed, 23 Sep 2009 01:35:00 GMT kjdon [20681] * gsdl/trunk/perllib/basebuilder.pm (modified) only check incremental against is_incremental_capable. keepold may be ... Wed, 23 Sep 2009 00:04:55 GMT mdewsnip [20679] * gsdl/trunk/perllib/classify/List.pm (modified) Fixed up types of partition_type_within_level and ... Mon, 21 Sep 2009 01:56:01 GMT kjdon [20654] * gsdl/trunk/perllib/classify/SimpleList.pm (modified) removed an old debug statement Mon, 21 Sep 2009 01:41:38 GMT kjdon [20653] * gsdl/trunk/perllib/classify/List.pm (modified) if we are updating the classifier ie a document is being ... Mon, 21 Sep 2009 01:35:55 GMT davidb [20651] * gsdl/trunk/perllib/expinfo.pm (modified) * gsdl/trunk/perllib/plugouts/BasePlugout.pm (modified) * gsdl/trunk/perllib/plugouts/MARCXMLPlugout.pm (modified) Updated to support incremental exporting Mon, 21 Sep 2009 00:06:23 GMT kjdon [20647] * gsdl/trunk/perllib/basebuilder.pm (modified) now pass incremental_mode to new method. check keepold/incremental ... Mon, 21 Sep 2009 00:04:28 GMT kjdon [20646] * gsdl/trunk/perllib/scriptutil.pm (modified) if keepold is true, set incremental_mode to onlyadd Mon, 21 Sep 2009 00:03:48 GMT kjdon [20645] * gsdl/trunk/perllib/lucenebuilder.pm (modified) added is_incremental_capable method Sun, 20 Sep 2009 23:59:42 GMT davidb [20643] * gsdl/trunk/perllib/plugouts/METSPlugout.pm (modified) Updated to include meta-files information in 'saveas' Sun, 20 Sep 2009 23:56:49 GMT davidb [20642] * gsdl/trunk/perllib/plugouts/DSpacePlugout.pm (modified) Updated to include meta-files information in 'saveas' Wed, 16 Sep 2009 03:06:14 GMT kjdon [20613] * gsdl/trunk/perllib/plugin.pm (modified) escape backslashes in plugin options before passing to the eval (new ... Wed, 16 Sep 2009 02:25:03 GMT davidb [20610] * gsdl/trunk/perllib/GDBMUtils.pm (modified) parseStringToHash brought out as a useful subroutine in its own right Wed, 16 Sep 2009 02:05:23 GMT kjdon [20609] * gsdl/trunk/perllib/plugins/MARCXMLPlugin.pm (modified) added process_exp arg explicitly to this plugin. Otherwise, due to ... Tue, 15 Sep 2009 22:31:23 GMT kjdon [20605] * gsdl/trunk/perllib/plugins/BasePlugin.pm (modified) check OIDmetadata defined before modifying it - it may not be defined ... Wed, 09 Sep 2009 22:52:26 GMT davidb [20579] * gsdl/trunk/perllib/multiread.pm (modified) Unicode encoding broken down into two steps. Wed, 09 Sep 2009 22:51:48 GMT davidb [20578] * gsdl/trunk/perllib/inexport.pm (modified) * gsdl/trunk/perllib/plugin.pm (modified) * gsdl/trunk/perllib/scriptutil.pm (modified) Changes to support new incremental_mode variable, and to track ... Wed, 09 Sep 2009 22:50:05 GMT davidb [20577] * gsdl/trunk/perllib/plugins/ArchivesInfPlugin.pm (modified) * gsdl/trunk/perllib/plugins/BasePlugin.pm (modified) * gsdl/trunk/perllib/plugins/DirectoryPlugin.pm (modified) * gsdl/trunk/perllib/plugins/MetadataXMLPlugin.pm (modified) * gsdl/trunk/perllib/plugins/PrintInfo.pm (modified) Changes to support new incremental_mode variable, and to track ... Wed, 09 Sep 2009 22:47:48 GMT davidb [20576] * gsdl/trunk/perllib/plugins/HTMLPlugin.pm (modified) Links can now also be to Microsofts's Multimedia Streaming protocol MMS. Wed, 09 Sep 2009 22:46:36 GMT davidb [20575] * gsdl/trunk/perllib/basebuilder.pm (modified) * gsdl/trunk/perllib/classify.pm (modified) Opening of txt2db moved to earlier in the buildcol process. This was ... Sun, 06 Sep 2009 23:45:47 GMT davidb [20541] * gsdl/trunk/perllib/strings.properties (modified) Dictionary strings for new csv-usernames-to-db.pl Sun, 06 Sep 2009 23:44:10 GMT davidb [20540] * gsdl/trunk/perllib/plugins/ImageConverter.pm (modified) Support for cache mode in image converter (currently used in Video ... Sun, 06 Sep 2009 23:42:58 GMT davidb [20539] * gsdl/trunk/perllib/convertutil.pm (modified) Couple of tweaks to do with when caching is run for the very first time Sun, 06 Sep 2009 23:42:04 GMT davidb [20538] * gsdl/trunk/perllib/cgiactions/metadataaction.pm (modified) further development of metadata action Sun, 06 Sep 2009 23:37:15 GMT davidb [20537] * gsdl/trunk/perllib/arcinfo.pm (modified) Minor tweak to DSpace exporting so file handle correctly determined Sun, 06 Sep 2009 23:36:50 GMT davidb [20536] * gsdl/trunk/perllib/plugouts/DSpacePlugout.pm (modified) Minor tweak to DSpace exporting so file handle correctly determined Mon, 31 Aug 2009 03:36:05 GMT kjdon [20454] * gsdl/trunk/perllib/classify/DateList.pm (modified) * gsdl/trunk/perllib/classify/Phind.pm (modified) * gsdl/trunk/perllib/classify/RecentDocumentsList.pm (modified) strip ex from metadata type args Mon, 31 Aug 2009 03:35:42 GMT kjdon [20453] * gsdl/trunk/perllib/classify/BaseClassifier.pm (modified) Phind has things like section:ex.Title in its text field, so added : ... Mon, 31 Aug 2009 03:12:57 GMT kjdon [20451] * gsdl/trunk/perllib/plugins/BasePlugin.pm (modified) * gsdl/trunk/perllib/plugins/OAIPlugin.pm (modified) metadata args may have ex. now. Trim ex. from values Fri, 28 Aug 2009 01:37:36 GMT kjdon [20429] * gsdl/trunk/perllib/classify/AZCompactList.pm (modified) strip ex from metadata and sort arguments Fri, 28 Aug 2009 01:32:12 GMT kjdon [20428] * gsdl/trunk/perllib/classify/AZList.pm (modified) strip ex from metadata argument before using it Fri, 28 Aug 2009 01:28:48 GMT kjdon [20427] * gsdl/trunk/perllib/classify/SimpleList.pm (modified) strip off ex. from metadata and sort arguments Fri, 28 Aug 2009 01:28:26 GMT kjdon [20426] * gsdl/trunk/perllib/classify/BaseClassifier.pm (modified) new strip_ex_from_metadata routine Fri, 28 Aug 2009 01:28:04 GMT kjdon [20425] * gsdl/trunk/perllib/classify/HFileHierarchy.pm (modified) made a subroutine for removing ex. Call this instead of doing it ... Fri, 28 Aug 2009 01:27:46 GMT kjdon [20424] * gsdl/trunk/perllib/classify/List.pm (modified) made a subroutine for removing ex. Call this instead of doing it ... Fri, 28 Aug 2009 00:51:24 GMT kjdon [20422] * gsdl/trunk/perllib/classify/HFileHierarchy.pm (modified) removed some commented out code. strip ex off metadata and sort arguments Fri, 28 Aug 2009 00:48:46 GMT kjdon [20421] * gsdl/trunk/perllib/classify/List.pm (modified) strip off any ex. before getting metadata from doc_obj Fri, 28 Aug 2009 00:06:34 GMT kjdon [20420] * gsdl/trunk/perllib/basebuildproc.pm (modified) strip ex. off languagemetadata, and subcollection field Fri, 28 Aug 2009 00:05:38 GMT kjdon [20419] * gsdl/trunk/perllib/lucenebuildproc.pm (modified) * gsdl/trunk/perllib/mgbuildproc.pm (modified) * gsdl/trunk/perllib/mgppbuildproc.pm (modified) strip off ex. before retrieving metadata for indexing. ex. now valid ... Fri, 28 Aug 2009 00:03:52 GMT kjdon [20418] * gsdl/trunk/perllib/lucenebuilder.pm (modified) * gsdl/trunk/perllib/mgbuilder.pm (modified) * gsdl/trunk/perllib/mgppbuilder.pm (modified) language_metadata was sometimes with an underscore, and sometimes ... Fri, 28 Aug 2009 00:03:03 GMT kjdon [20417] * gsdl/trunk/perllib/doc.pm (modified) changed a typo in comment Fri, 28 Aug 2009 00:02:33 GMT kjdon [20416] * gsdl/trunk/perllib/colcfg.pm (modified) language_metadata was sometimes with an underscore, and sometimes ... Thu, 27 Aug 2009 21:58:05 GMT kjdon [20414] * gsdl/trunk/perllib/plugouts/FedoraMETSPlugout.pm (modified) check whether fedora_version is defined before using it, to avoid an ... Thu, 27 Aug 2009 21:57:18 GMT kjdon [20413] * gsdl/trunk/perllib/util.pm (modified) modifed rename_file to make a bit more efficient when rename_method ... Thu, 27 Aug 2009 21:56:19 GMT kjdon [20412] * gsdl/trunk/perllib/doc.pm (modified) added a couple of comments Tue, 25 Aug 2009 02:43:41 GMT mdewsnip [20390] * gsdl/trunk/perllib/cfgread.pm (modified) Improved cfgread::read_cfg_line() so it doesn't take forever to parse ... Thu, 20 Aug 2009 04:47:23 GMT max [20343] * gsdl/trunk/perllib/convertutil.pm (modified) Update some indentation