| Line | |
|---|
| 1 | ===== Overview =====
|
|---|
| 2 |
|
|---|
| 3 | Building tools (matching the import and buildcol phases of Greenstone) that make use of the OpenMPI library to provide flexible parallel processing capabilities to Greenstone.
|
|---|
| 4 |
|
|---|
| 5 | ==== Import ====
|
|---|
| 6 |
|
|---|
| 7 | Currently the import tool is quite basic and essentially splits the collection up into fixed sized batches, processing each with a separate processor.
|
|---|
| 8 |
|
|---|
| 9 | ==== Buildcol ====
|
|---|
| 10 |
|
|---|
| 11 | Meanwhile the buildcol tool is slightly more complex, as it lets Greenstone Perl code create a XML 'recipe' describing the collection build process and any precedence requirements, and then obeys this recipe farming out parallizable parts of the collection build to separate processes as possible.
|
|---|
| 12 |
|
|---|
| 13 | ===== Requirements =====
|
|---|
| 14 |
|
|---|
| 15 | Requires the GS2-Extension "tdb-edit" to be installed, compiled and enabled, in order to allow multiple parallel readers/writers to access key datastore/base files (such as the archive-inf databases).
|
|---|
Note:
See
TracBrowser
for help on using the repository browser.
