Changeset 29793 for main/trunk/gli/src/org/greenstone/gatherer/metadata/FilenameEncoding.java

Timestamp:

2015-03-19T13:53:24+13:00 (9 years ago)

Author:

ak19

Message:

some more changes to make adding metadata to filenames with non latin1 characters work. previously, any char above 127 was being output as %XX. this doesn't work as higher values can end up like %101. but when you decode you only ever look for 2 digits after the %. so higher values we'll use entities like ā then had to modify the xml writing to not escape the text in hte filename element - otherwise get ā

File:

• main/trunk/gli/src/org/greenstone/gatherer/metadata/FilenameEncoding.java (modified) (6 diffs)

main/trunk/gli/src/org/greenstone/gatherer/metadata/FilenameEncoding.java

@@ -32 +32 @@
 import java.util.*;
 import org.greenstone.gatherer.collection.CollectionManager;
-
+import org.greenstone.gatherer.DebugStream;
 
 /** Static access class that contains many of the methods used to work with filename encodings. 
@@ -347 +347 @@
             
             String filename_ascii = filename_uri.toASCIIString();
+            DebugStream.println("ascii = "+filename_ascii);
             String filename_raw_bytes = URLDecoder.decode(filename_ascii,"ISO-8859-1");
+            DebugStream.println("raw = "+filename_raw_bytes);
             filename_url_encoded = iso_8859_1_filename_to_url_encoded(filename_raw_bytes);
+            
         }
         catch (Exception e) {
@@ -355 +358 @@
             filename_url_encoded = file.getAbsolutePath(); 
         }
+            DebugStream.println("returning "+filename_url_encoded);
         return filename_url_encoded;
     }
@@ -368 +372 @@
     {
         String urlEncoded = "";
-
+DebugStream.println("in iso 8859 to url encoded, "+raw_bytes_filename);
         try {
             // By this point we have a UTF-8 encoded string that captures
@@ -386 +390 @@
             String unicode_filename = new String(raw_bytes,"UTF-8");
             
+                //urlEncoded = URLEncoder.encode(unicode_filename, "UTF-8");
             for(int i = 0; i < unicode_filename.length(); i++) {
             char charVal = unicode_filename.charAt(i);
-            if((int)charVal > 127) {
+            if ((int)charVal > 255) {
+                urlEncoded += String.format("&#x%02X;", (int)charVal);
+                    //urlEncoded += String.format("\\u%04X", (int)charVal);
+            }
+            else if((int)charVal > 127) {
                 urlEncoded += String.format("%%%02X", (int)charVal);
+                    //urlEncoded += Integer.toHexString((int)charVal);
             } else {
                 urlEncoded += String.format("%c", (char)charVal);
@@ -399 +409 @@
             throw(e);
         }
-
+DebugStream.println("returning "+urlEncoded);
         return urlEncoded;
     }