| 1 | <html>
|
|---|
| 2 | <head>
|
|---|
| 3 | <meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
|
|---|
| 4 | <title>The Gatherer - Help Pages</title>
|
|---|
| 5 | </head>
|
|---|
| 6 | <body bgcolor="#E0F0E0" link="#000000" vlink="#000000">
|
|---|
| 7 | <table border="2" bgcolor="#B0D0B0" cellpadding="5" cellspacing="0" width="100%">
|
|---|
| 8 | <tr>
|
|---|
| 9 | <td align="center" width="15%">
|
|---|
| 10 | <img height="45" src="gatherer_medium.gif" width="45">
|
|---|
| 11 | </td>
|
|---|
| 12 | <td align="center" width="*">
|
|---|
| 13 | <font face="Verdana" size="5">
|
|---|
| 14 | <strong>
|
|---|
| 15 | 4.1 The 'Mirror' view
|
|---|
| 16 | </strong>
|
|---|
| 17 | </font>
|
|---|
| 18 | </td>
|
|---|
| 19 | <td align="center" width="15%">
|
|---|
| 20 | <img height="45" src="gatherer_medium.gif" width="45">
|
|---|
| 21 | </td>
|
|---|
| 22 | </tr>
|
|---|
| 23 | <tr bgcolor="#E0F0E0">
|
|---|
| 24 | <td colspan="3" width="100%">
|
|---|
| 25 | <font face="Verdana" size="3">
|
|---|
| 26 | <p style="text-align:justify">
|
|---|
| 27 | This section describes how to configure a download task, and how to control the downloading process.
|
|---|
| 28 | </p>
|
|---|
| 29 |
|
|---|
| 30 | </font>
|
|---|
| 31 | </td>
|
|---|
| 32 | </tr>
|
|---|
| 33 | <tr bgcolor="#E0F0E0">
|
|---|
| 34 | <td align="center" colspan="3" width="100%">
|
|---|
| 35 | <table border="2" cellpadding="2" width="480" bgcolor="#B0D0B0">
|
|---|
| 36 | <tr>
|
|---|
| 37 | <td align="center">
|
|---|
| 38 | <font face="Verdana" size="4">
|
|---|
| 39 | <strong>
|
|---|
| 40 | Contents
|
|---|
| 41 | </strong>
|
|---|
| 42 | </font>
|
|---|
| 43 | </td>
|
|---|
| 44 | </tr>
|
|---|
| 45 | <tr>
|
|---|
| 46 | <td>
|
|---|
| 47 | <table background="gatherer.gif" bgcolor="#FFFFFF" border="0" cellpadding="2" width="100%">
|
|---|
| 48 | <tr>
|
|---|
| 49 | <td colspan="3">
|
|---|
| 50 | <font face="Verdana" size="4">
|
|---|
| 51 | <strong>
|
|---|
| 52 | <a href="#SI">Simple instructions</a>
|
|---|
| 53 | </strong>
|
|---|
| 54 | </a>
|
|---|
| 55 | </font>
|
|---|
| 56 | </td>
|
|---|
| 57 | </tr>
|
|---|
| 58 | <tr>
|
|---|
| 59 | <td>
|
|---|
| 60 |
|
|---|
| 61 | </td>
|
|---|
| 62 | <td colspan="2">
|
|---|
| 63 | <font face="Verdana" size="4">
|
|---|
| 64 | The workspace tree
|
|---|
| 65 | </font>
|
|---|
| 66 | </a>
|
|---|
| 67 | </td>
|
|---|
| 68 | </tr>
|
|---|
| 69 | <tr>
|
|---|
| 70 | <td>
|
|---|
| 71 |
|
|---|
| 72 | </td>
|
|---|
| 73 | <td colspan="2">
|
|---|
| 74 | <font face="Verdana" size="4">
|
|---|
| 75 | Download configuration
|
|---|
| 76 | </font>
|
|---|
| 77 | </a>
|
|---|
| 78 | </td>
|
|---|
| 79 | </tr>
|
|---|
| 80 | <tr>
|
|---|
| 81 | <td>
|
|---|
| 82 |
|
|---|
| 83 | </td>
|
|---|
| 84 | <td colspan="2">
|
|---|
| 85 | <font face="Verdana" size="4">
|
|---|
| 86 | The download list
|
|---|
| 87 | </font>
|
|---|
| 88 | </a>
|
|---|
| 89 | </td>
|
|---|
| 90 | </tr>
|
|---|
| 91 | <tr>
|
|---|
| 92 | <td colspan="3">
|
|---|
| 93 | <font face="Verdana" size="4">
|
|---|
| 94 | <strong>
|
|---|
| 95 | <a href="#AI">Advanced instructions</a>
|
|---|
| 96 | </strong>
|
|---|
| 97 | </a>
|
|---|
| 98 | </font>
|
|---|
| 99 | </td>
|
|---|
| 100 | </tr>
|
|---|
| 101 | <tr>
|
|---|
| 102 | <td>
|
|---|
| 103 |
|
|---|
| 104 | </td>
|
|---|
| 105 | <td colspan="2">
|
|---|
| 106 | <font face="Verdana" size="4">
|
|---|
| 107 | Enabling web proxies
|
|---|
| 108 | </font>
|
|---|
| 109 | </a>
|
|---|
| 110 | </td>
|
|---|
| 111 | </tr>
|
|---|
| 112 | <tr>
|
|---|
| 113 | <td>
|
|---|
| 114 |
|
|---|
| 115 | </td>
|
|---|
| 116 | <td colspan="2">
|
|---|
| 117 | <font face="Verdana" size="4">
|
|---|
| 118 | Advanced mode
|
|---|
| 119 | </font>
|
|---|
| 120 | </a>
|
|---|
| 121 | </td>
|
|---|
| 122 | </tr>
|
|---|
| 123 | </font>
|
|---|
| 124 | </table>
|
|---|
| 125 | </td>
|
|---|
| 126 | </tr>
|
|---|
| 127 | </table>
|
|---|
| 128 | </td>
|
|---|
| 129 | </tr>
|
|---|
| 130 | <tr bgcolor="#E0F0E0">
|
|---|
| 131 | <td colspan="3" width="100%">
|
|---|
| 132 | <img height="20" src="gatherer_small.gif" width="20">
|
|---|
| 133 | <font face="Verdana" size="4">
|
|---|
| 134 | <u>
|
|---|
| 135 | <a name="SI">Simple Instructions:</a>
|
|---|
| 136 | </u>
|
|---|
| 137 | <font size="3">
|
|---|
| 138 | <p style="text-align:justify">
|
|---|
| 139 | The 'Mirror' view is accessed by clicking on its tab within the row of tabs. Unfortunately the mirroring view is probably the most complex in the Librarian Interface. To the left of the screen is the workspace tree which is the same as the one shown on the left of the 'Gather' view. The bottom of the screen is initially blank, but will later contain a list of pending download jobs. Finally the right of the screen is covered with the controls used to configure a new download job.
|
|---|
| 140 | </p>
|
|---|
| 141 | <p style="text-align:justify">
|
|---|
| 142 | The workspace tree will be discussed in detail in later sections. But for now notice the appearance of one or two new base level folders. The first of these, 'Public Workspace', is always present when mirroring is enabled, and can be thought of as the shared cache of files. Any files downloaded here will be availble to any other collections built with this copy of the Librarian Interface. The second folder, 'Private Workspace', only appears once a collection has been opened. This file cache is stored with the collection, so only this collection has access to it. In either case, files will be stored into these areas using their full path names as determined from the url of these source page. Thus a new folder will be created for the url host name, then more as necessary as the path specifies. This ensures that each file is distinct, so that you can download several index.htm pages from different urls, without overwriting the previous ones.
|
|---|
| 143 | </p>
|
|---|
| 144 | <p style="text-align:justify">
|
|---|
| 145 | Now for the new download task configuration controls. The very top field is used to enter the url to the target resource you wish to retrieve. If you have been browsing using the 'Hunt' view, this field will automatically be filled with the url of the last page visited. The next control, labelled 'Download depth' informs the Librarian Interface how many times you wish to follow hyperlinks and download the resources found there as well. A depth of 0 means no hyperlinks will be followed and only the target resource will be retrieved, while ticking the infinite box could possibly cause you to mirror <strong>the entire internet!</strong> The depth is ignored when downloading media other than html pages. The next control lets you choose the destination for the files downloaded, by clicking on the appropriate toggle button. The selected destination is denoted by a large tick. The next control, when ticked, causes any hyperlinked objects needed to render the page properly to be downloaded. Note that this is independant of the download depth setting as it only considers embedded objects (i.e. internal not external hyperlinks). The next control lets you determine if the Librarian Interface can mirror files from paths above the target url (this is determined from the path, which is the portion of the url after the hostname). The 'Only mirror within the same site' control restricts the mirroring to files with the same host name when ticked. The next control determines whether local files should ever be overwritten during download and the second to last control, within the 'Download List Options' group, allows you to specify what should happen to download tasks if they fail for some reason. Note that changes to this control are immediate, rather than part of a specific download job. The final control to discuss is the 'Download' button which creates a new job by looking at the configuration settings above, then adds it to the download list.
|
|---|
| 146 | </p>
|
|---|
| 147 | <p style="text-align:justify">
|
|---|
| 148 | Whil blank initially the download list will eventually contain several entries, each representing a download task, and each with the same general appearance. You can scroll the list to see further tasks. Looking at a single task, you will notice two buttons to the left and right, and a central region with several lines of text and a progress bar. The text gives details of the task, and will update as the task progresses, while the progress bar gives an indicating of activity. The button to the left, with the blue 'play' triangle on it, will begin the current task. Once it has been pressed the downloading will begin, and its icon will change to double vertical bars or 'pause'. Pressing pause will pause the current download. The button to the right, with the blue 'stop' square, will cause the current download task to be removed from the list. If a download task completes successfully it will automatically be removed from the download list, while whether it is removed on failure is controlled by the download list option.
|
|---|
| 149 | </p>
|
|---|
| 150 |
|
|---|
| 151 | </font>
|
|---|
| 152 | </p>
|
|---|
| 153 | </td>
|
|---|
| 154 | </tr>
|
|---|
| 155 | <tr bgcolor="#E0F0E0">
|
|---|
| 156 | <td colspan="3" width="100%">
|
|---|
| 157 | <img height="20" src="gatherer_small.gif" width="20">
|
|---|
| 158 | <font face="Verdana" size="4">
|
|---|
| 159 | <u>
|
|---|
| 160 | <a name="AI">Advanced Instructions:</a>
|
|---|
| 161 | </u>
|
|---|
| 162 | <font size="3">
|
|---|
| 163 | <p style="text-align:justify">
|
|---|
| 164 | You may have noticed that there is a label at the bottom of the download configuration controls that states you should see the preferences page for more options. This is available for those users who must access the internet via a proxy web server. If you open the preference prompt, found under the File menu, and change to the 'Connection' tab, you will be presented with controls for setting the proxy. First tick the box if it is appropriate, then enter the name and port of the proxy server. Finally you can press the 'Establish Connection' button to attempt to connect to the proxy immediately, otherwise the Librarian Interface will connect the next time it is started. The reason these options are provded here, and not on the 'Mirror' view, is that they are persistant between sessions, and are automatically re-established whenever the Librarian Interface starts. Also note that if authentication is needed for connection to the proxy server you should be prompted for a login and password (you may infact be prompted twice due to a bug in how Java connects to proxies). A valid login/password is persistant for the remainder of that Librarian Interface session, but is not stored between sessions due to security considerations.
|
|---|
| 165 | </p>
|
|---|
| 166 | <p style="text-align:justify">
|
|---|
| 167 | Again you may have noticed that the feedback during downloading is poor at the very best, with the progress bar only showing that something is happening, and the status text sometimes very vague about what is actually happening (you are told last file downloaded, not what is downloading at this time). This is due to limitations of running Wget as an external process to the Librarian Interface. There is a more advance mode of running the mirroring part of the Librarian Interface which integrate WGet functionality directly using special java libraries called the JNI. This provides exact details of what is happening including an accurate progress bar for each file. However this mode is currently disabled due to its platform specific nature. Watch for this ability in the future.
|
|---|
| 168 | </p>
|
|---|
| 169 |
|
|---|
| 170 | </font>
|
|---|
| 171 | </p>
|
|---|
| 172 | </td>
|
|---|
| 173 | </tr>
|
|---|
| 174 | </table>
|
|---|
| 175 | <br>
|
|---|
| 176 | <br>
|
|---|
| 177 | <br>
|
|---|
| 178 | <br>
|
|---|
| 179 | <br>
|
|---|
| 180 | <br>
|
|---|
| 181 | <br>
|
|---|
| 182 | <br>
|
|---|
| 183 | <br>
|
|---|
| 184 | <br>
|
|---|
| 185 | <br>
|
|---|
| 186 | <br>
|
|---|
| 187 | <br>
|
|---|
| 188 | <br>
|
|---|
| 189 | <br>
|
|---|
| 190 | <br>
|
|---|
| 191 | <br>
|
|---|
| 192 | <br>
|
|---|
| 193 | <br>
|
|---|
| 194 | <br>
|
|---|
| 195 | <br>
|
|---|
| 196 | <br>
|
|---|
| 197 | <br>
|
|---|
| 198 | <br>
|
|---|
| 199 | <br>
|
|---|
| 200 | <br>
|
|---|
| 201 | <br>
|
|---|
| 202 | <br>
|
|---|
| 203 | <br>
|
|---|
| 204 | <br>
|
|---|
| 205 | <br>
|
|---|
| 206 | <br>
|
|---|
| 207 | </body>
|
|---|
| 208 | </html>
|
|---|
