source: trunk/gsdl/perllib

Revision Log Mode:


Legend:

Added
Modified
Copied or renamed
Diff Rev Age Author Log Message
(edit) @4429   21 years jrm21 new plugin for importing data from perl's DBI database interface - eg …
(edit) @4284   21 years jrm21 the sysfuncs.h header file confuses our gcc, and we don't really need …
(edit) @4283   21 years jrm21 main() must return int.
(edit) @4282   21 years jrm21 not much point storing a binary executable here, especially since it …
(edit) @4281   21 years jrm21 1) use Getopts::Std instead of getopts.pl 2) Only print informative …
(edit) @4229   21 years mdewsnip Replaced unicode2koi8r with a more generic version: …
(edit) @4225   21 years jrm21 if the "removeprefix" option makes the metadata value empty, we skip …
(edit) @4224   21 years jrm21 fixed regexp for when we have a content type without a charset
(edit) @4192   21 years sjboddie Added maxnumeric build time configuration option. This is useful for …
(edit) @4103   21 years sjboddie Added a -nohidden PDFPlug option and made it pass the -hidden option …
(edit) @4089   21 years jrm21 added "\n" to headers as we weren't picking up messages that were only …
(edit) @3932   21 years jrm21 need to escape _ chars.
(edit) @3919   21 years jrm21 tidy and fix reg-exps when looking for #includes... it got stuck in a …
(edit) @3856   21 years davidb General improvement to the translator facility.
(edit) @3834   21 years sjboddie Prevent "use bytes" from causing errors for older perls
(edit) @3833   21 years jrm21 fixed up parsing the use_sections argument.
(edit) @3805   21 years sjboddie Bug fix so mgpp works properly for windows installations installed to …
(edit) @3772   21 years sjboddie Added utf-8 textcat models for french, spanish, and italian
(edit) @3767   21 years sjboddie Scattered some "use bytes" pragmas around to try to prevent perl-5.8 …
(edit) @3737   21 years davidb Used to support music-centent based collections
(edit) @3732   21 years jrm21 need to escape ",", "<", and ">" in title metadata
(edit) @3731   21 years jrm21 If textcat returns too many possibilities, use the default language …
(edit) @3728   21 years sjboddie Prevent "undefined variable" warnings for documents that have no …
(edit) @3727   21 years sjboddie Reverted back last change to AZList.pm. Attempting to make it work …
(edit) @3726   21 years jrm21 minor fix for "_" chars in urls... escape them after, not before. …
(edit) @3724   21 years kde2 Submission of Interface Translation Agency
(edit) @3721   21 years jrm21 bug where some text/plain messages weren't having < > & properly …
(edit) @3720   21 years sjboddie Added options to PDFPlug to take advantage of the improvements in …
(edit) @3719   21 years sjboddie Prevent dodgy format_string_english() functions from destroying any …
(edit) @3718   21 years sjboddie Added new language model so textcat can detect UTF-8 encoded Russian
(edit) @3708   21 years sjboddie Fixed a bug where HTMLPlug failed to associate files whose filenames …
(edit) @3665   21 years sjboddie Prevent occurances of 70 or more hyphens in metadata values from …
(edit) @3639   21 years kjdon modified the default sorting element, and fixed a bug.
(edit) @3630   21 years jrm21 1) Correct typo in print_usage(): process_exp -> split_exp 2) Fixed …
(edit) @3629   21 years jrm21 need to look for associated files in the assocfilepath, if this …
(edit) @3628   21 years jrm21 hard_link returns 1 on error. (But not if it attempts to copy - always …
(edit) @3627   21 years jrm21 added less-obfuscated quote-printable parsing in qp_decode()
(edit) @3614   21 years jrm21 modified section-handling stuff to work with output from v.0.34 of …
(edit) @3590   21 years jrm21 modified the split regular expression so it works with newer versions …
(edit) @3587   21 years jrm21 removed comments about storing "BibTex" metadata as we don't do that …
(edit) @3542   21 years jrm21 ghtml returns utf8, not iso-8859-1, so any html entities were being …
(edit) @3540   21 years kjdon added John T's changes into CVS - added info to enable retrieval of …
(edit) @3539   21 years kjdon added jpe to the process and block expressions
(edit) @3537   22 years jrm21 if process() returns undef, then the plugin couldn't process that …
(edit) @3536   22 years jrm21 set doc title to "" if it is undefined
(edit) @3529   22 years jrm21 fixed oversight where alpha_numeric_cmp was no longer being called …
(edit) @3524   22 years kjdon added the help message for the previous change
(edit) @3523   22 years kjdon now EMAILplug accepts the split_exp option - a regular expression that …
(edit) @3520   22 years jrm21 wrong variable name meant we were throwing away the first line of each …
(edit) @3517   22 years davidb ImagePlug modified so 'Source' metadata set to be consistent with …
(edit) @3515   22 years jrm21 call a plugin's set_OID() method if one exists, otherwise use the …
(edit) @3510   22 years jrm21 need to check that remove_prefix is defined before checking its length
(edit) @3508   22 years jrm21 modified copyright statement
(edit) @3507   22 years jrm21 updated to also allow '..."foo" ...' as the enclosing quotes (for …
(edit) @3506   22 years jrm21 need to allow escaped \" inside a multiline "...". Eg …
(edit) @3472   22 years kjdon renamed phind.pm to Phind.pm in keeping with the names of the other …
(edit) @3433   22 years jrm21 If a metadata value becomes empty (because of the removeprefix option) …
(edit) @3430   22 years jrm21 Added MARCPlug, mostly done by David Bainbridge. It needs a …
(edit) @3427   22 years sjboddie The input encoding will now default to utf8 instead of iso-8859-1. …
(edit) @3426   22 years jrm21 Don't add \n to the end of each metadata value.
(edit) @3418   22 years jrm21 Allow fields to stretch over multiple lines if enclosed in double …
(edit) @3416   22 years jrm21 Fix up problem if no documents were processed and accepted.
(edit) @3415   22 years jrm21 don't try to write to and close an archive file if one wasn't opened …
(edit) @3414   22 years jrm21 Need to escape "_" characters so that greenstone doesn't interprete them…
(edit) @3413   22 years jrm21 Added "\" to the characters we need to escape for classifying.
(edit) @3411   22 years jrm21 Now takes a "-use_sections" option to make a section per page.
(edit) @3402   22 years sjboddie import.pl now tells user where the fail.log lives
(edit) @3400   22 years sjboddie WordPlug now handles .dot files as well as .doc files.
(edit) @3398   22 years jrm21 Oops... the last change to the regex was too permissive... fixed up to …
(edit) @3397   22 years jrm21 minor change to the regex for marking up urls (to allow #anchor at the end)
(edit) @3369   22 years sjboddie HTMLPlug will no longer prevent metadata extraction when the …
(edit) @3352   22 years jrm21 We can now properly handle messages with a content type of …
(edit) @3351   22 years jrm21 If a message is in an unsupported encoding, we assume iso8859-1. …
(edit) @3350   22 years sjboddie Added -use_strings option to ConvertToPlug. The default behaviour for …
(edit) @3349   22 years sjboddie Bug fix.
(edit) @3329   22 years jrm21 Oops, removed debugging statement!
(edit) @3328   22 years jrm21 Make sure that sender's name is more than 0 chars long, otherwise use …
(edit) @3307   22 years davidb Some minor modifications to Image Plugin: filenames can now include …
(edit) @3306   22 years davidb Removed some debugging print statements
(edit) @3303   22 years davidb Classifier extented to support frequency sort option through -freqsort …
(edit) @3302   22 years davidb Classifier modified so it does not include A-Z letters at top of page …
(edit) @3249   22 years jrm21 1) add a space when joining consecutive lines, just in case. 2) Don't …
(edit) @3248   22 years jrm21 If we convert to HTML, we post-process to change named entities (eg …
(edit) @3247   22 years jrm21 Modified automatic title extraction to also recognise utf-8 nbsp as …
(edit) @3244   22 years jrm21 we no longer exit with an error if the suffix program failed to create …
(edit) @3226   22 years jrm21 Don't allow fields Encoding or Language for search - these are internal?!?
(edit) @3215   22 years jrm21 Fixed up some regexs for mime header encodings - eg people with …
(edit) @3206   22 years jrm21 Oops! Bad things were happening when the headers said utf-8 encoding, …
(edit) @3196   22 years sjboddie Added &nbsp; to the list of entities that HTMLPlug doesn't convert to utf-8
(edit) @3195   22 years kjdon create_shortname (turns a long metadata name into 2 char name) changed …
(edit) @3181   22 years sjboddie Altered the getcharequiv() function so it now converts entities to raw …
(edit) @3158   22 years kjdon the indexfieldmap list is now in sorted order with TextOnly at the …
(edit) @3156   22 years jrm21 Added a few extra accented characters, and recognise some …
(edit) @3148   22 years jrm21 If a document has associated files that are also given a subdirectory, …
(edit) @3146   22 years sjboddie textcat now returns "id" for Indonesian instead of "in"
(edit) @3144   22 years kjdon added mgpp's metadata field map to the gdbm file For metadata, it uses …
(edit) @3143   22 years jrm21 Minor tweak for badly formatted dates. We now use a window, so …
(edit) @3142   22 years jrm21 1) We can't use "Date" for the year metadata, as greenstone assumes …
(edit) @3137   22 years paynter Changed the way Width, Height, Size and Type metadata is calculated. …
(edit) @3136   22 years paynter Reconciled John's version of my changes to EMAILPlug with my version …
Note: See TracRevisionLog for help on using the revision log.