Changeset 33940

Timestamp:

2020-02-17T22:16:40+13:00 (4 years ago)

Author:

ak19

Message:

1. In order to make it easier to do the manual work of inspecting 260 web pages, there's now a new class ManualURLInspection.java that will automate the part where I have to paste a URL into mongo db and press Find to locate the matching web page's record and then view the record. The new class takes the input CSV file and for each of the 260 web page URLs of the random sample, it gets the full text from mongodb and displays it on the console and let's me enter Y/N/? for whether I think the overall page is in MRI or not. Then the updated records are written into a tmp file, as well as any remainiing ones I haven't gone through yet. If I'm satisfied, I'll replace the original sample csv file with the new one and can continue from where I left off later. Responds to Ctrl-D for end of input. Some handling of Ctrl-C: each processed line is written out, but user is instructed to manually append the unprocessed records to the end of the temp output file before replacing original csv input file with output file to continue working later. 2. Needed to update commons-csv jar file to have access to additional method. 3. Needed a new utility method in MongodbQueryer. 4. Minor changes to SummaryTool.java. 5. Processed first 190 of 260 random sample web urls using my helpful new class ManualURLInspection.java. The first 15 URLs were done totally manually, the remainder with my new class. The new class made the work very much faster and far less tedious.

Location:

other-projects/maori-lang-detection

Files:

• lib/commons-csv-1.7.jar (deleted)
• lib/commons-csv-1.8.jar (added)
• mongodb-data/random260_manualList_globalDomains_whereAPageContainsMRI.txt (modified) (1 diff)
• src/org/greenstone/atea/ManualURLInspection.java (added)
• src/org/greenstone/atea/MongoDBQueryer.java (modified) (2 diffs)
• src/org/greenstone/atea/SummaryTool.java (modified) (3 diffs)

other-projects/maori-lang-detection/mongodb-data/random260_manualList_globalDomains_whereAPageContainsMRI.txt

@@ -1 @@
-https://paekupu.co.nz/word/apa,NZ
-http://m.biblepub.com/bibles/mb/19/67,US
-https://paekupu.co.nz/word/awatea,NZ
-http://pukoro.co.nz/mi/vocab-with-kori/twigs/,NZ
-http://tiritiowaitangi.govt.nz/maps/landconfiscations.php,NZ
-http://www.tmoa.tki.org.nz/Karere-Hou/Hine-Takurua-raua-ko-Hine-Raumati-ma-te-pouako,NZ
-https://tetaurawhiri.govt.nz/rauemi-a-ipurangi/rauemi/takaro-raumati/,NZ
-https://tetaurawhiri.govt.nz/rauemi-a-ipurangi/rauemi/fridge-kai-poster/,NZ
-http://www.tmoa.tki.org.nz/Karere-Hou/He-hotaka-whakangungu,NZ
-https://tetaurawhiri.govt.nz/kaupapa/panui-papaho/kaua-e-whiua-whanaia-dont-pass-it-kick-it/,NZ
-http://www.pakanae.maori.nz/ng257-wai-o-hokianga.html,NZ
-http://www.tmoa.tki.org.nz/Karere-Hou/He-purongo-TMoA-me-NWRM,NZ
-http://www.tkkmmokopuna.school.nz/1/easy_pages/3-mana-kura-tahi-tkkm-o-nga-mokopuna,NZ
-http://www.tmoa.tki.org.nz/Rauemi-Whanui/He-Whakamaramatanga-mo-Te-Marautanga-o-Aotearoa,NZ
-https://ttw1.cwp.govt.nz/he-muka/kainga/he-oranga-reo-he-oranga-tangata/,NZ
-http://tmoa.tki.org.nz/Karere-Hou/Hine-Takurua-raua-ko-Hine-Raumati-ma-te-pouako,NZ
-http://tiritiowaitangi.govt.nz/people/,NZ
-http://www.tmoa.tki.org.nz/Mataiako/Aromatawai/Rauemi,NZ
-https://tiritiowaitangi.govt.nz/story/leaduptotreaty.php,NZ
-http://www.waiata.maori.nz/index.php/browse/genre,NZ
-https://csunplugged.org/mi/topics/,US
-http://www.teipukarea.maori.nz/research-mi-nz/nga-kaupapa-rangahau-o-mua/,NZ
-https://www.tetaurawhiri.govt.nz/kaupapa/tatai-korero-2/1800/,NZ
-http://tiritiowaitangi.govt.nz/story/textdifferences.php,NZ
-http://www.tmoa.tki.org.nz/Taumata-Matauranga-a-Motu-Ka-Taea/Hangarau/1.4-Te-whakaputa-i-tetahi-hua-hangarau-no-roto-mai-i-te-matauranga-Maori-hei-whakaea-i-tetahi-tauaki,NZ
-http://www.waiata.maori.nz/en/song/kua-eke-raa-ngaa-tuumanako,NZ
-http://animations.tewhanake.maori.nz/te-kohure/te-wahanga-tuarua/380,NZ
-http://www.tmoa.tki.org.nz/Pakiwaitara-Marau/Tutarawananga-Kia-hangai-ki-nga-tamariki,NZ
-http://firstworldwar.tki.org.nz/mi/nga-kaupapa/tuakiri-me-te-tuku-ihotanga/,NZ
-http://tmoa.tki.org.nz/Pakiwaitara-Marau/Tawhiuau-1,NZ
-http://tiritiowaitangi.govt.nz/,NZ
-http://www.kura-porirua.school.nz/194/profile_areas/5-te-rarangi-kaimahi-staff-directory/categories/25-poutuarongo/profiles/26-meranea-turei,NZ
-http://animations.tewhanake.maori.nz/te-mahuri/te-whanga-tuatoru/364,NZ
-http://www.tmoa.tki.org.nz/Mataiako/Hai-whakamarama/Te-whakangungu,NZ
-http://tiritiowaitangi.govt.nz/timeline/flash/index.php,NZ
-http://pukoro.co.nz/mi/computer-games/game-3-skiing-game,NZ
-https://www.tekura.school.nz/dual-providers-mi-nz/first-steps-mi-nz/online-learning-mi-nz/,NZ
-http://www.tmoa.tki.org.nz/Mataiako/Wahanga-Aromatawai/Te-Reo-Maori/Korero/Takapiringa,NZ
-https://kupengahao.co.nz/items/he-tautoko-i-te-marautanga-pangarau-te-tauira-me-te-panga/,NZ
-https://paekupu.co.nz/word/aputa-rarangi,NZ
-http://www.tmoa.tki.org.nz/Mataiako/Te-Waharoa-Ararau/Te-Waharoa-Ararau-Modules,NZ
-https://www.twttoa.com/future-events--contact-details.html,US
-https://biblehub.com/mao/1_kings/6.htm,US
-http://m.biblepub.com/bibles/mb/19/23,US
-https://www.tetaurawhiri.govt.nz/ratonga/,NZ
-http://www.tkkmmokopuna.school.nz/1/image_galleries/3-2018-whakaahua,NZ
-http://www.tmoa.tki.org.nz/Pakiwaitara-Marau/Te-Kura-o-Takaro,NZ
-http://www.tmoa.tki.org.nz/Taumata-Matauranga-a-Motu-Ka-Taea/Hauora,NZ
-http://www.waiata.maori.nz/mri/song/te-haakii-o-wiremu-taamehana,NZ
-http://kuraaiwi.maori.nz/m333-ng257-tumuaki.html,NZ
-https://biblehub.com/mao/ezekiel/13.htm,US
-https://www.tetaurawhiri.govt.nz/rauemi-a-ipurangi/rauemi/nga-rerenga-korero-phrases/,NZ
-https://www.tetaurawhiri.govt.nz/kaupapa/panui-papaho/he-whakaari-pukuhohe-reo-maori-hou/,NZ
-https://ngatiporoukiponeke.org.nz/hikurangi-maunga-kati-ra/,NZ
-http://www.tmoa.tki.org.nz/Mataiako/Te-Waharoa-Ararau/Nga-rauemi-mo-TWA,NZ
-http://www.tereowrap.nz/tmwo_upoko04.html,NZ
-https://www.kiwiproperty.com/westgate-lifestyle/mi/ngaa-toa/,US
-http://tmoa.tki.org.nz/Nga-Whanaketanga-Rumaki-Maori/He-Korero-mo-nga-Kura-me-nga-Akomanga-Rumaki,NZ
-https://teara.govt.nz/mi/biographies/2b35/bracken-thomas/media,NZ
-https://www.tetaurawhiri.govt.nz/rauemi-a-ipurangi/rauemi/kiakaha/,NZ
-http://www.teipukarea.maori.nz/the-team-mi-nz/tania-smith-mi-nz/,NZ
-http://m.biblepub.com/bibles/mb/1/20,US
-https://www.tetaurawhiri.govt.nz/assets/Resources/2017/b675466d64/Kia-ora-te-reo-Graphic-Novel.pdf,NZ
-http://www.twtop.school.nz/1/pages/2-nau-mai,NZ
-https://www.tetaurawhiri.govt.nz/kaupapa/tanga-rangatopu/te-tauaki-whakamaunga-atu/,NZ
-http://www.tmoa.tki.org.nz/Karere-Hou/Toi-Te-Kupu-102-Te-Putanga-2-2016,NZ
-https://biblehub.com/mao/genesis/24.htm,US
-http://kuraaiwi.maori.nz/te-p333-whakam257nawa.html,NZ
-http://kuraproductions.co.nz/mi/shows/taniwha-rau,NZ
-http://www.firstworldwar.tki.org.nz/mi/rauemi/he-tohu-pakanga-he-tohu-kapa/,NZ
-https://ngatiporoukiponeke.org.nz/karangatia-ra/,NZ
-http://kurakokiri.maori.nz/students.html,NZ
-http://tmoa.tki.org.nz/Mataiako/Wahanga-Aromatawai/Te-Reo-Maori/Korero/Kawea-te-Rongo-Ki-Mai-He-Whakamatau-Reo-Korero-JOST,NZ
-https://kupengahao.co.nz/items/tihei-pangarau-te-tau-me-te-taurangi-te-pukapuka-aratohu-ma-te-pouako-taumata-3/,NZ
-http://pukoro.co.nz/mi/vocab-with-kori/bib/,NZ
-http://www.tmoa.tki.org.nz/Mataiako/Wahanga-Aromatawai/Pangarau/Apitihanga-Uiui-Rautaki-GloSS,NZ
-http://tmoa.tki.org.nz/Pakiwaitara-Marau/Te-Kura-Kaupapa-Maori-o-Ngati-Ruanui,NZ
-https://tehiku.nz/archives/te-tai-tokerau-kapa-haka-regionals-2011/4463/kaitaia-college-seniors,NZ
-http://teaohou.natlib.govt.nz/journals/teaohou/issue/Mao01TeA/c19-1.html,NZ
-http://www.tmoa.tki.org.nz/Taumata-Matauranga-a-Motu-Ka-Taea/NCEA-Resource-Comments,NZ
-http://tmoa.tki.org.nz/Te-Marautanga-o-Aotearoa/Te-Anga/Te-Ahua-o-a-Tatou-Akonga,NZ
-http://www.waiata.maori.nz/en/song,NZ
-http://www.tmoa.tki.org.nz/Karere-Hou/Manu-Korihi-He-Tuhinga-Mihi-Mo-te-Pakanga-Tuatahi-o-te-Ao,NZ
-http://tiritiowaitangi.govt.nz/treaty/tokelauan.php,NZ
-http://m.biblepub.com/bibles/mb/19/126,US
-http://www.tmoa.tki.org.nz/Rauemi-Whanui/Te-Hono-i-te-Ahua-o-a-Tatou-Akonga,NZ
-https://www.tetaurawhiri.govt.nz/rauemi-a-ipurangi/rauemi/christmas/,NZ
-http://tiritiowaitangi.govt.nz/maps/maoriland1939.php,NZ
-http://tmoa.tki.org.nz/Pakiwaitara-Marau/Tutarawananga-Nga-pumanawa-matua,NZ
-https://mi.wikipedia.org/wiki/Katea,US
-http://www.livingheritage.org.nz/schools/secondary/te-ara-whanui/toku-kura/index.php,NZ
-http://www.twtop.school.nz/66/blogs/1-te-ohinga-panui/posts/12-term-2-week-1,NZ
-http://www.tmoa.tki.org.nz/Taumata-Matauranga-a-Motu-Ka-Taea/Putaiao/AS-3.3-v1-Te-tatari-i-nga-taukumekume-mo-te-whakamahi-i-nga-rawa-o-Papatuanuku-Tauira,NZ
-https://www.tetaurawhiri.govt.nz/rauemi-a-ipurangi/rauemi/kia-ora-general-phrases/,NZ
-http://pukapuka.nz/portfolio/purerehua/,NZ
-http://www.tmoa.tki.org.nz/Karere-Hou/He-Anga-Ako-ma-te-Pouako,NZ
-http://tmoa.tki.org.nz/Mataiako/Whiriwhiria-tetahi-rauemi-aromatawai/(area)/858/(sub_area)/867,NZ
-http://kiaorahola.blogspot.com/2009/09/ko-nga-turuhi-maori-no-rotorua.html,US
-http://tmoa.tki.org.nz/Taumata-Matauranga-a-Motu-Ka-Taea/Hangarau/1.1B-Pihi-kau-ake-te-whakaaro-pai-hauhake-tonu-iho,NZ
-http://pukoro.co.nz/mi/learning-points/autumn/,NZ
-http://tiritiowaitangi.govt.nz/quotes/1920.php,NZ
-https://kupengahao.co.nz/portfolio-filter/putaiao/,NZ
-http://m.biblepub.com/bibles/mb/15/3,US
-http://www.twtop.school.nz/62/learning_cave_sets/22-tuwharetoatanga,NZ
-http://www.tmoa.tki.org.nz/Te-Marautanga-o-Aotearoa/Te-Anga/Nga-Ahuatanga-Ako,NZ
-https://teara.govt.nz/mi/biographies/2t46/tomoana-henare,NZ
-https://sexualviolence.victimsinfo.govt.nz/mi/glossary/showterm/te+k%c4%ab/,NZ
-https://www.twttoa.com/rangatira-pita-sharples-5.html,US
-http://www.tmoa.tki.org.nz/Mataiako/Whiriwhiria-tetahi-rauemi-aromatawai,NZ
-http://www.tmoa.tki.org.nz/Taumata-Matauranga-a-Motu-Ka-Taea/Nga-whainga-paetae-o-TMoA,NZ
-http://pukoro.co.nz/mi/crafts/making-animation,NZ
-http://pukoro.co.nz/mi/crafts/making-scones/,NZ
-https://mi.wikipedia.org/wiki/1896,US
-https://www.tetaurawhiri.govt.nz/kaupapa/panui-papaho/te-mahi-tahi-a-te-taura-whiri-i-te-reo-maori-a-te-papa-atawhai-mo-te-wiki-o-te-reo-maori/,NZ
-http://manateina.blogspot.com/2016/05/oku-hoa.html,US
-http://www.firstworldwar.tki.org.nz/mi/rauemi/te-tuku-ihotanga-me-te-tuakiri-dr-monty-soutar/,NZ
-http://www.waiata.maori.nz/song/kia-kaha-ngaa-iwi,NZ
-http://tmoa.tki.org.nz/Te-Marautanga-o-Aotearoa/Te-Anga/Nga-Tikanga-hei-Whai-ma-nga-Poari,NZ
-http://pukoro.co.nz/mi/kohanga-of-the-week/te-wharekura-o-tauranga-moana/,NZ
-http://tmoa.tki.org.nz/Karere-Hou/Wanangatia-te-Putanga-Tauira,NZ
-https://kupengahao.co.nz/items/te-poutama-tau-pukapuka-tuarima-te-tapiritanga-te-tangohanga-me-te-uara-tu/,NZ
-http://www.tmoa.tki.org.nz/Kura/Te-Reo-a-Waha/Nga-ataata/Te-Reo-a-Waha-Tau-7-8,NZ
-http://www.firstworldwar.tki.org.nz/mi/rauemi/mano-reo-mano-whakaaro/,NZ
-http://tiritiowaitangi.govt.nz/timeline/treaty1950.php,NZ
-http://m.biblepub.com/bibles/mb/1/36,US
-http://m.biblepub.com/bibles/mb/1/42,US
-http://www.tmoa.tki.org.nz/Nga-Whanaketanga-Rumaki-Maori/Nga-Whanaketanga-Rumaki-Maori-me-Ka-Hikitia-Accelerating-Success-2013-2017,NZ
-http://tmoa.tki.org.nz/Karere-Hou/Matariki,NZ
-https://www.terito.school.nz/2017-3/,NZ
-https://mi.m.wikipedia.org/wiki/1788,US
-http://tiritiowaitangi.govt.nz/people/maorileaders1840.php,NZ
-http://www.tmoa.tki.org.nz/Te-Marautanga-o-Aotearoa/Nga-Wahanga-Ako/Putaiao,NZ
-http://www.pakanae.maori.nz/,NZ
-http://pukoro.co.nz/kohanga-of-the-week/ng-p-manu-ngunguru-school/,NZ
-https://ttw1.cwp.govt.nz/a-matou-mahi/te-matapuna-language-advice/language-advice-for-private-sector/,NZ
-http://www.tmoa.tki.org.nz/content/advancedsearch,NZ
-http://www.tmoa.tki.org.nz/Kura/He-Anga-Ako-ma-te-Pouako/Revere-McGregor,NZ
-http://tiritiowaitangi.govt.nz/sitemap/,NZ
-https://www.tetaurawhiri.govt.nz/rauemi-a-ipurangi/rauemi/ko-au/,NZ
-https://sexualviolence.victimsinfo.govt.nz/mi/home/have-you-been-affected/,NZ
-http://m.biblepub.com/bibles/mb/19/102,US
-http://tmoa.tki.org.nz/Taumata-Matauranga-a-Motu-Ka-Taea/Tikanga-A-Iwi/1.2-Te-whakaatu-maramatanga-mo-tetahi-wahi-tapu-ki-te-Maori,NZ
-https://tiritiowaitangi.govt.nz/casestudies/ngaitahu.php,NZ
-http://tmoa.tki.org.nz/Mataiako/Whiriwhiria-tetahi-rauemi-aromatawai/(area)/858/(sub_area)/867,NZ
-http://pukoro.co.nz/mi/printables/super-hero/,NZ
-http://pukoro.co.nz/mi/vocab-with-kori/steering-wheel/,NZ
-https://admin.teara.govt.nz/mi/biographies/3t22/te-waharoa-tupu-atanatiu-taingakawa,NZ
-https://www.tetaurawhiri.govt.nz/ratonga/licensing-of-translators-and-interpreters/,NZ
-https://hepatakakupu.nz/comprehension,NZ
-https://www.kiwiproperty.com/westgate-lifestyle/mi/kia-moohio-noa/,US
-http://kuraaiwi.maori.nz/ng257-ringa-wera.html,NZ
-http://www.twtop.school.nz/65/image_galleries/48-mauri-oho/categories/38-haerenga-ki-kanata-2017.rss,NZ
-http://www.huri-translations.pf/rarotongan/tangi-manu.html,NZ
-http://pukoro.co.nz/mi/crafts/making-a-shelter,NZ
-https://mi.m.wikipedia.org/wiki/1726,US
-http://www.tmoa.tki.org.nz/Taumata-Matauranga-a-Motu-Ka-Taea/He-Karere-Hou,NZ
-http://www.waiata.maori.nz/en/song/aku-kanohi-kau,NZ
-http://tmoa.tki.org.nz/Karere-Hou/Te-Tautoko-76,NZ
-http://www.tmoa.tki.org.nz/Karere-Hou/Te-whakahounga-o-Te-Waharoa-Ararau,NZ
-http://pukoro.co.nz/mi/stories/the-disheartened-possum/,NZ
-https://tetaurawhiri.govt.nz/rauemi-a-ipurangi/rauemi/nga-rerenga-korero-phrases/,NZ
-http://tiritiowaitangi.govt.nz/story/earlytwentiethcentury.php,NZ
-http://www.tmoa.tki.org.nz/Taumata-Matauranga-a-Motu-Ka-Taea/Hangarau/1.5-Te-whakamahi-rawa-te-whakamahi-tukanga-ranei-no-roto-mai-i-te-matauranga-Maori-hei-hanga-i-tetahi-hua-hangarau-mo-te-ao-hurihuri-nei,NZ
-http://tmoa.tki.org.nz/Taumata-Matauranga-a-Motu-Ka-Taea/He-Karere-Hou,NZ
-http://www.tmoa.tki.org.nz/Pakiwaitara-Marau/Te-Kaupapa-o-Tukaikaha,NZ
-https://kupengahao.co.nz/items/tihei-pangarau-te-tauanga-taumata-4/,NZ
-https://paekupu.co.nz/word/arani,NZ
-https://www.tetaurawhiri.govt.nz/assets/Corporate-publications/SPE/5cec96f373/TTWh-He-Ara-Whaia-He-Ara-Hou-2016-17-Mi.pdf,NZ
-http://www.twtop.school.nz/66/blogs/1-te-ohinga-panui/posts/7-term-1-week-8,NZ
-http://www.tmoa.tki.org.nz/Te-Marautanga-o-Aotearoa/Te-Anga/Nga-Wahanga-o-Te-Marautanga-o-Aotearoa/Diagram,NZ
-https://ttw1.cwp.govt.nz/assets/Corporate-publications/He-Muka/2010/Putanga-23-3-Koanga-2010.pdf,NZ
-http://animations.tewhanake.maori.nz/te-mahuri/te-whanga-tuatoru/418,NZ
-https://mi.m.wikipedia.org/wiki/1796,US
-http://www.tmoa.tki.org.nz/content/download/2241/17084/file/91659-sam-2014.doc,NZ
-http://tmoa.tki.org.nz/Puna-Mahara/Nga-Whanaketanga-Rumaki-Maori/Te-Hotaka,NZ
-https://tetaurawhiri.govt.nz/rauemi-a-ipurangi/rauemi/hangarau/,NZ
-https://www.tetaurawhiri.govt.nz/rauemi-a-ipurangi/rauemi/aotearoa/,NZ
-http://tmoa.tki.org.nz/Pakiwaitara-Marau/Te-Kura-Kaupapa-Maori-o-Kaikohe-Pouherenga-Tai,NZ
-https://paekupu.co.nz/word/ahunga-koaro,NZ
-http://www.waiata.maori.nz/mri/song/whakarongo,NZ
-http://www.wcl.govt.nz/mawhaituhi/,NZ
-http://tmoa.tki.org.nz/Te-Marautanga-o-Aotearoa/Nga-Wahanga-Ako/Te-Reo-Maori/Te-Reo-Maori-Nga-Whakamarama,NZ
-https://www.tetaurawhiri.govt.nz/kaupapa/tanga-rangatopu/he-kupu-whakamarama-ki-te-minita-hou/,NZ
-http://tmoa.tki.org.nz/Kura/He-Reo-Moteatea-Tirohanga-whanui/Ruaumoko-Maori/Ruaumoko-Taumata-1-2,NZ
-http://www.tmoa.tki.org.nz/Mataiako/Wahanga-Aromatawai/Te-Reo-Maori/Panui/He-Matai-Matatupu-2-Te-Tautu-Reta,NZ
-http://maori.livingheritage.org.nz/Pae-mahere/Te-Whai-wahitanga,NZ
-https://tetaurawhiri.govt.nz/rauemi-a-ipurangi/rauemi/akina-te-reo-maramataka/,NZ
-http://tmoa.tki.org.nz/Te-Marautanga-o-Aotearoa/Te-Anga/Te-Putake-o-Te-Marautanga-o-Aotearoa,NZ
-http://ngatipahauwera.co.nz/nga-konae/,NZ
-https://mi.m.wikipedia.org/wiki/1748,US
-http://tmoa.tki.org.nz/Mataiako/Ako/Ka-arotahi-te-aromatawai-ki-te-akonga,NZ
-http://www.waiata.maori.nz/mri/song/aku-kanohi-kau,NZ
-https://sexualviolence.victimsinfo.govt.nz/mi/glossary/showterm/kaitohutohu+p%c4%81rurenga+koeretanga/,NZ
-http://tmoa.tki.org.nz/Kura/He-Reo-Moteatea-Tirohanga-whanui/Ka-Eke-ki-Wairaka-Maori/Ka-Eke-ki-Wairaka,NZ
-http://www.waiata.maori.nz/en/song/mahara,NZ
-https://mi.m.wikipedia.org/wiki/1886,US
-http://m.biblepub.com/bibles/mb/11/16,US
-https://mi.wikipedia.org/wiki/1779,US
-https://www.tetaurawhiri.govt.nz/rauemi-a-ipurangi/rauemi/te-reo-i-te-kainga/,NZ
-http://pukoro.co.nz/mi/crafts/making-chocolate/,NZ
-http://www.kurakokiri.maori.nz/about.html,NZ
-https://www.tetaurawhiri.govt.nz/rauemi-a-ipurangi/rauemi/kia-ora-hakinakina-booklet/,NZ
-https://www.tetaurawhiri.govt.nz/rauemi-a-ipurangi/rauemi/everyday-labels/,NZ
-https://tiritiowaitangi.govt.nz/maps/maoriland1910.php,NZ
-https://tetaurawhiri.govt.nz/kaupapa/panui-papaho/ka-tuwhera-te-tono-putea-ma-te-reo-mo-nga-tau-2016/,NZ
-https://mi.m.wikipedia.org/wiki/1855,US
-https://tiritiowaitangi.govt.nz/story/growinginterest.php,NZ
-http://www.tmoa.tki.org.nz/Pakiwaitara-Marau/Te-Waharoa-Ararau,NZ
-http://piripi.blogspot.com/,US
-http://www.tmoa.tki.org.nz/Rangahau/He-Uiui-Kaiako-mo-NWRM2,NZ
-http://www.tmoa.tki.org.nz/Mataiako/Wahanga-Aromatawai/Pangarau/Te-Poutama-Tau-Uiui-Aromatawai,NZ
-https://www.tetaurawhiri.govt.nz/rauemi-a-ipurangi/rauemi/te-tini-a-tane/,NZ
-http://www.tmoa.tki.org.nz/Rauemi-Whanui/Te-Arotake-i-te-Marau-a-Kura,NZ
-http://www.livingheritage.org.nz/layout/set/print/Schools-Stories/Ko-Hongoeka-te-Marae/Ko-to-Matou-Ropu-Rangahau,NZ
-http://www.tmoa.tki.org.nz/Kura/Te-Reo-a-Waha/Te-whakaako-reo-a-waha/Nga-rautaki-whakaako-reo-tuarua,NZ
-http://www.tmoa.tki.org.nz/Karere-Hou/He-Rau-Taki-Korero,NZ
-http://www.tmoa.tki.org.nz/Karere-Hou,NZ
-https://mi.m.wikipedia.org/wiki/1867,US
-https://mi.m.wikipedia.org/wiki/1813,US
-http://tmoa.tki.org.nz/Te-Marautanga-o-Aotearoa/Te-Anga/Nga-Wahanga-o-Te-Marautanga-o-Aotearoa,NZ
-http://www.tmoa.tki.org.nz/Pakiwaitara-Marau/Tutarawananga-Nga-uara-Maori,NZ
-http://www.tmoa.tki.org.nz/Karere-Hou/Nga-Tauaromahi,NZ
-https://csunplugged.org/mi/computational-thinking/,US
-http://tmoa.tki.org.nz/Mataiako/Ako/He-tino-auaha-te-mahi-ako,NZ
-http://m.biblepub.com/bibles/mb/1/47,US
-http://tmoa.tki.org.nz/Karere-Hou/Ka-Hikitia,NZ
-https://tetaurawhiri.govt.nz/rauemi-a-ipurangi/rauemi/kiakaha/,NZ
-https://ttw1.cwp.govt.nz/he-muka/he-muka-archive/2015-2019/,NZ
-https://ttw1.cwp.govt.nz/assets/Corporate-publications/He-Muka/2014/Putanga-27-2-Ngahuru-2014.pdf,NZ
-http://tiritiowaitangi.govt.nz/casestudies/ngaitahu.php,NZ
-http://m.biblepub.com/bibles/mb/16/6,US
-http://www.twtop.school.nz/774/pages/57-nga-tikanga-whakanui-o-aotearoa,NZ
-http://tmoa.tki.org.nz/Taumata-Matauranga-a-Motu-Ka-Taea/Pangarau/1.9-Te-whakamahi-ahuahanga-panoni-hei-whakaoti-rapanga,NZ
-http://www.tkkmmokopuna.school.nz/1/profile_areas/1-nga-kaimahi-o-nga-mokopuna/categories/3-wharekura/profiles/9-barbara-zerzouri,NZ
-https://tetaurawhiri.govt.nz/kaupapa/panui-papaho/katahi-te-pai-o-te-whakaako-reo-maori-e-haere-nei-kia-kaha-ake-ra/,NZ
-http://www.tkkmmokopuna.school.nz/1/image_galleries/3-2018-whakaahua/categories/12-2018-puna-kaukau,NZ
-https://www.tetaurawhiri.govt.nz/kaupapa/panui-papaho/te-reo-maori-revitalisation-celebrated/,NZ
-http://tmoa.tki.org.nz/Pakiwaitara-Marau/Te-Kura-o-Titahi-ki-te-Raki,NZ
-http://kuraproductions.co.nz/mi/shows/only-in-aotearoa,NZ
-http://www.tmoa.tki.org.nz/Akonga,NZ
-http://www.tmoa.tki.org.nz/Pakiwaitara-Marau/Tatari-Tautoko-Tauawhi-Nawton-School,NZ
-http://tmoa.tki.org.nz/Karere-Hou/He-rauemi-arataki-i-te-pouako,NZ
-http://www.tmoa.tki.org.nz/Karere-Hou/Mataiako,NZ
-http://www.tmoa.tki.org.nz/Pakiwaitara-Marau/Wai-Study-Help,NZ
-http://tmoa.tki.org.nz/Kura/He-Reo-Moteatea-Overview/Ruaumoko-English,NZ
-https://maorinews.com/writings/papers/newsltrs/hokjan63.html,US
-http://tmoa.tki.org.nz/Taumata-Matauranga-a-Motu-Ka-Taea/Te-Reo-Rangatira/TRR-1.11-Te-whakaatu-i-nga-putanga-rangahau,NZ
-https://tetaurawhiri.govt.nz/kaupapa/panui-papaho/nga-tohu-reo-maori/,NZ
-http://pukoro.co.nz/mi/songs-and-lyrics/at-school/,NZ
-http://pukoro.co.nz/mi/learning-points/test-learning-points/,NZ
-http://www.kura-porirua.school.nz/194/profile_areas/5-te-rarangi-kaimahi-staff-directory,NZ
-http://www.tmoa.tki.org.nz/Pakiwaitara-Marau,NZ
-http://www.tmoa.tki.org.nz/Taumata-Matauranga-a-Motu-Ka-Taea/He-Maherehere-Paerewa-Paetae2,NZ
-http://tmoa.tki.org.nz/Kura/He-Reo-Moteatea-Overview/Tirotiro-Kau-Au-English,NZ
-https://paekupu.co.nz/word/arahau,NZ
-http://www.twtop.school.nz/869/pages/84-tangaroa,NZ
-http://www.tmoa.tki.org.nz/Karere-Hou/Toi-Te-Kupu-102-Te-Putanga-2-2016,NZ
-https://www.sporty.co.nz/kuratakitimu/Akomanga/Akomanga-tuarua,NZ
-https://www.sporty.co.nz/kuratakitimu/Mahi/Kapa-Haka,NZ
-https://www.tetaurawhiri.govt.nz/events/maramataka/mobilising-te-reo-dunedin/,NZ
+https://paekupu.co.nz/word/apa,NZ,Y
+http://m.biblepub.com/bibles/mb/19/67,US,Y
+https://paekupu.co.nz/word/awatea,NZ,Y
+http://pukoro.co.nz/mi/vocab-with-kori/twigs/,NZ,Y
+http://tiritiowaitangi.govt.nz/maps/landconfiscations.php,NZ,Y
+http://www.tmoa.tki.org.nz/Karere-Hou/Hine-Takurua-raua-ko-Hine-Raumati-ma-te-pouako,NZ,Y
+https://tetaurawhiri.govt.nz/rauemi-a-ipurangi/rauemi/takaro-raumati/,NZ,Y
+https://tetaurawhiri.govt.nz/rauemi-a-ipurangi/rauemi/fridge-kai-poster/,NZ,Y
+http://www.tmoa.tki.org.nz/Karere-Hou/He-hotaka-whakangungu,NZ,Y
+https://tetaurawhiri.govt.nz/kaupapa/panui-papaho/kaua-e-whiua-whanaia-dont-pass-it-kick-it/,NZ,Y
+http://www.pakanae.maori.nz/ng257-wai-o-hokianga.html,NZ,Y
+http://www.tmoa.tki.org.nz/Karere-Hou/He-purongo-TMoA-me-NWRM,NZ,Y
+http://www.tkkmmokopuna.school.nz/1/easy_pages/3-mana-kura-tahi-tkkm-o-nga-mokopuna,NZ,Y
+http://www.tmoa.tki.org.nz/Rauemi-Whanui/He-Whakamaramatanga-mo-Te-Marautanga-o-Aotearoa,NZ,Y
+https://ttw1.cwp.govt.nz/he-muka/kainga/he-oranga-reo-he-oranga-tangata/,NZ,Y
+http://tmoa.tki.org.nz/Karere-Hou/Hine-Takurua-raua-ko-Hine-Raumati-ma-te-pouako,NZ,Y
+http://tiritiowaitangi.govt.nz/people/,NZ,Y
+http://www.tmoa.tki.org.nz/Mataiako/Aromatawai/Rauemi,NZ,Y
+https://tiritiowaitangi.govt.nz/story/leaduptotreaty.php,NZ,Y
+http://www.waiata.maori.nz/index.php/browse/genre,NZ,Y
+https://csunplugged.org/mi/topics/,US,Y
+http://www.teipukarea.maori.nz/research-mi-nz/nga-kaupapa-rangahau-o-mua/,NZ,Y
+https://www.tetaurawhiri.govt.nz/kaupapa/tatai-korero-2/1800/,NZ,Y
+http://tiritiowaitangi.govt.nz/story/textdifferences.php,NZ,Y
+http://www.tmoa.tki.org.nz/Taumata-Matauranga-a-Motu-Ka-Taea/Hangarau/1.4-Te-whakaputa-i-tetahi-hua-hangarau-no-roto-mai-i-te-matauranga-Maori-hei-whakaea-i-tetahi-tauaki,NZ,Y
+http://www.waiata.maori.nz/en/song/kua-eke-raa-ngaa-tuumanako,NZ,?
+http://animations.tewhanake.maori.nz/te-kohure/te-wahanga-tuarua/380,NZ,Y
+http://www.tmoa.tki.org.nz/Pakiwaitara-Marau/Tutarawananga-Kia-hangai-ki-nga-tamariki,NZ,Y
+http://firstworldwar.tki.org.nz/mi/nga-kaupapa/tuakiri-me-te-tuku-ihotanga/,NZ,Y
+http://tmoa.tki.org.nz/Pakiwaitara-Marau/Tawhiuau-1,NZ,Y
+http://tiritiowaitangi.govt.nz/,NZ,Y
+http://www.kura-porirua.school.nz/194/profile_areas/5-te-rarangi-kaimahi-staff-directory/categories/25-poutuarongo/profiles/26-meranea-turei,NZ,Y
+http://animations.tewhanake.maori.nz/te-mahuri/te-whanga-tuatoru/364,NZ,?
+http://www.tmoa.tki.org.nz/Mataiako/Hai-whakamarama/Te-whakangungu,NZ,Y
+http://tiritiowaitangi.govt.nz/timeline/flash/index.php,NZ,Y
+http://pukoro.co.nz/mi/computer-games/game-3-skiing-game,NZ,Y
+https://www.tekura.school.nz/dual-providers-mi-nz/first-steps-mi-nz/online-learning-mi-nz/,NZ,Y
+http://www.tmoa.tki.org.nz/Mataiako/Wahanga-Aromatawai/Te-Reo-Maori/Korero/Takapiringa,NZ,Y
+https://kupengahao.co.nz/items/he-tautoko-i-te-marautanga-pangarau-te-tauira-me-te-panga/,NZ,Y
+https://paekupu.co.nz/word/aputa-rarangi,NZ,?
+http://www.tmoa.tki.org.nz/Mataiako/Te-Waharoa-Ararau/Te-Waharoa-Ararau-Modules,NZ,?
+https://www.twttoa.com/future-events--contact-details.html,US,?
+https://biblehub.com/mao/1_kings/6.htm,US,Y
+http://m.biblepub.com/bibles/mb/19/23,US,Y
+https://www.tetaurawhiri.govt.nz/ratonga/,NZ,Y
+http://www.tkkmmokopuna.school.nz/1/image_galleries/3-2018-whakaahua,NZ,Y
+http://www.tmoa.tki.org.nz/Pakiwaitara-Marau/Te-Kura-o-Takaro,NZ,Y
+http://www.tmoa.tki.org.nz/Taumata-Matauranga-a-Motu-Ka-Taea/Hauora,NZ,Y
+http://www.waiata.maori.nz/mri/song/te-haakii-o-wiremu-taamehana,NZ,Y
+http://kuraaiwi.maori.nz/m333-ng257-tumuaki.html,NZ,Y
+https://biblehub.com/mao/ezekiel/13.htm,US,Y
+https://www.tetaurawhiri.govt.nz/rauemi-a-ipurangi/rauemi/nga-rerenga-korero-phrases/,NZ,Y
+https://www.tetaurawhiri.govt.nz/kaupapa/panui-papaho/he-whakaari-pukuhohe-reo-maori-hou/,NZ,Y
+https://ngatiporoukiponeke.org.nz/hikurangi-maunga-kati-ra/,NZ,Y
+http://www.tmoa.tki.org.nz/Mataiako/Te-Waharoa-Ararau/Nga-rauemi-mo-TWA,NZ,?
+http://www.tereowrap.nz/tmwo_upoko04.html,NZ,Y
+https://www.kiwiproperty.com/westgate-lifestyle/mi/ngaa-toa/,US,Y
+http://tmoa.tki.org.nz/Nga-Whanaketanga-Rumaki-Maori/He-Korero-mo-nga-Kura-me-nga-Akomanga-Rumaki,NZ,Y
+https://teara.govt.nz/mi/biographies/2b35/bracken-thomas/media,NZ,Y
+https://www.tetaurawhiri.govt.nz/rauemi-a-ipurangi/rauemi/kiakaha/,NZ,Y
+http://www.teipukarea.maori.nz/the-team-mi-nz/tania-smith-mi-nz/,NZ,?
+http://m.biblepub.com/bibles/mb/1/20,US,Y
+https://www.tetaurawhiri.govt.nz/assets/Resources/2017/b675466d64/Kia-ora-te-reo-Graphic-Novel.pdf,NZ,Y
+http://www.twtop.school.nz/1/pages/2-nau-mai,NZ,Y
+https://www.tetaurawhiri.govt.nz/kaupapa/tanga-rangatopu/te-tauaki-whakamaunga-atu/,NZ,Y
+http://www.tmoa.tki.org.nz/Karere-Hou/Toi-Te-Kupu-102-Te-Putanga-2-2016,NZ,?
+https://biblehub.com/mao/genesis/24.htm,US,Y
+http://kuraaiwi.maori.nz/te-p333-whakam257nawa.html,NZ,Y
+http://kuraproductions.co.nz/mi/shows/taniwha-rau,NZ,Y
+http://www.firstworldwar.tki.org.nz/mi/rauemi/he-tohu-pakanga-he-tohu-kapa/,NZ,Y
+https://ngatiporoukiponeke.org.nz/karangatia-ra/,NZ,Y
+http://kurakokiri.maori.nz/students.html,NZ,Y
+http://tmoa.tki.org.nz/Mataiako/Wahanga-Aromatawai/Te-Reo-Maori/Korero/Kawea-te-Rongo-Ki-Mai-He-Whakamatau-Reo-Korero-JOST,NZ,Y
+https://kupengahao.co.nz/items/tihei-pangarau-te-tau-me-te-taurangi-te-pukapuka-aratohu-ma-te-pouako-taumata-3/,NZ,Y
+http://pukoro.co.nz/mi/vocab-with-kori/bib/,NZ,Y
+http://www.tmoa.tki.org.nz/Mataiako/Wahanga-Aromatawai/Pangarau/Apitihanga-Uiui-Rautaki-GloSS,NZ,Y
+http://tmoa.tki.org.nz/Pakiwaitara-Marau/Te-Kura-Kaupapa-Maori-o-Ngati-Ruanui,NZ,Y
+https://tehiku.nz/archives/te-tai-tokerau-kapa-haka-regionals-2011/4463/kaitaia-college-seniors,NZ,Y
+http://teaohou.natlib.govt.nz/journals/teaohou/issue/Mao01TeA/c19-1.html,NZ,Y
+http://www.tmoa.tki.org.nz/Taumata-Matauranga-a-Motu-Ka-Taea/NCEA-Resource-Comments,NZ,Y
+http://tmoa.tki.org.nz/Te-Marautanga-o-Aotearoa/Te-Anga/Te-Ahua-o-a-Tatou-Akonga,NZ,Y
+http://www.waiata.maori.nz/en/song,NZ,Y
+http://www.tmoa.tki.org.nz/Karere-Hou/Manu-Korihi-He-Tuhinga-Mihi-Mo-te-Pakanga-Tuatahi-o-te-Ao,NZ,Y
+http://tiritiowaitangi.govt.nz/treaty/tokelauan.php,NZ,N
+http://m.biblepub.com/bibles/mb/19/126,US,Y
+http://www.tmoa.tki.org.nz/Rauemi-Whanui/Te-Hono-i-te-Ahua-o-a-Tatou-Akonga,NZ,Y
+https://www.tetaurawhiri.govt.nz/rauemi-a-ipurangi/rauemi/christmas/,NZ,?
+http://tiritiowaitangi.govt.nz/maps/maoriland1939.php,NZ,Y
+http://tmoa.tki.org.nz/Pakiwaitara-Marau/Tutarawananga-Nga-pumanawa-matua,NZ,Y
+https://mi.wikipedia.org/wiki/Katea,US,Y
+http://www.livingheritage.org.nz/schools/secondary/te-ara-whanui/toku-kura/index.php,NZ,Y
+http://www.twtop.school.nz/66/blogs/1-te-ohinga-panui/posts/12-term-2-week-1,NZ,Y
+http://www.tmoa.tki.org.nz/Taumata-Matauranga-a-Motu-Ka-Taea/Putaiao/AS-3.3-v1-Te-tatari-i-nga-taukumekume-mo-te-whakamahi-i-nga-rawa-o-Papatuanuku-Tauira,NZ,Y
+https://www.tetaurawhiri.govt.nz/rauemi-a-ipurangi/rauemi/kia-ora-general-phrases/,NZ,Y
+http://pukapuka.nz/portfolio/purerehua/,NZ,Y
+http://www.tmoa.tki.org.nz/Karere-Hou/He-Anga-Ako-ma-te-Pouako,NZ,Y
+http://tmoa.tki.org.nz/Mataiako/Whiriwhiria-tetahi-rauemi-aromatawai/(area)/858/(sub_area)/867,NZ,Y
+http://kiaorahola.blogspot.com/2009/09/ko-nga-turuhi-maori-no-rotorua.html,US,Y
+http://tmoa.tki.org.nz/Taumata-Matauranga-a-Motu-Ka-Taea/Hangarau/1.1B-Pihi-kau-ake-te-whakaaro-pai-hauhake-tonu-iho,NZ,Y
+http://pukoro.co.nz/mi/learning-points/autumn/,NZ,Y
+http://tiritiowaitangi.govt.nz/quotes/1920.php,NZ,Y
+https://kupengahao.co.nz/portfolio-filter/putaiao/,NZ,Y
+http://m.biblepub.com/bibles/mb/15/3,US,Y
+http://www.twtop.school.nz/62/learning_cave_sets/22-tuwharetoatanga,NZ,Y
+http://www.tmoa.tki.org.nz/Te-Marautanga-o-Aotearoa/Te-Anga/Nga-Ahuatanga-Ako,NZ,Y
+https://teara.govt.nz/mi/biographies/2t46/tomoana-henare,NZ,Y
+https://sexualviolence.victimsinfo.govt.nz/mi/glossary/showterm/te+k%c4%ab/,NZ,Y
+https://www.twttoa.com/rangatira-pita-sharples-5.html,US,Y
+http://www.tmoa.tki.org.nz/Mataiako/Whiriwhiria-tetahi-rauemi-aromatawai,NZ,Y
+http://www.tmoa.tki.org.nz/Taumata-Matauranga-a-Motu-Ka-Taea/Nga-whainga-paetae-o-TMoA,NZ,Y
+http://pukoro.co.nz/mi/crafts/making-animation,NZ,Y
+http://pukoro.co.nz/mi/crafts/making-scones/,NZ,Y
+https://mi.wikipedia.org/wiki/1896,US,Y
+https://www.tetaurawhiri.govt.nz/kaupapa/panui-papaho/te-mahi-tahi-a-te-taura-whiri-i-te-reo-maori-a-te-papa-atawhai-mo-te-wiki-o-te-reo-maori/,NZ,Y
+http://manateina.blogspot.com/2016/05/oku-hoa.html,US,Y
+http://www.firstworldwar.tki.org.nz/mi/rauemi/te-tuku-ihotanga-me-te-tuakiri-dr-monty-soutar/,NZ,Y
+http://www.waiata.maori.nz/song/kia-kaha-ngaa-iwi,NZ,Y
+http://tmoa.tki.org.nz/Te-Marautanga-o-Aotearoa/Te-Anga/Nga-Tikanga-hei-Whai-ma-nga-Poari,NZ,Y
+http://pukoro.co.nz/mi/kohanga-of-the-week/te-wharekura-o-tauranga-moana/,NZ,Y
+http://tmoa.tki.org.nz/Karere-Hou/Wanangatia-te-Putanga-Tauira,NZ,Y
+https://kupengahao.co.nz/items/te-poutama-tau-pukapuka-tuarima-te-tapiritanga-te-tangohanga-me-te-uara-tu/,NZ,Y
+http://www.tmoa.tki.org.nz/Kura/Te-Reo-a-Waha/Nga-ataata/Te-Reo-a-Waha-Tau-7-8,NZ,Y
+http://www.firstworldwar.tki.org.nz/mi/rauemi/mano-reo-mano-whakaaro/,NZ,Y
+http://tiritiowaitangi.govt.nz/timeline/treaty1950.php,NZ,Y
+http://m.biblepub.com/bibles/mb/1/36,US,Y
+http://m.biblepub.com/bibles/mb/1/42,US,Y
+http://www.tmoa.tki.org.nz/Nga-Whanaketanga-Rumaki-Maori/Nga-Whanaketanga-Rumaki-Maori-me-Ka-Hikitia-Accelerating-Success-2013-2017,NZ,Y
+http://tmoa.tki.org.nz/Karere-Hou/Matariki,NZ,?
+https://www.terito.school.nz/2017-3/,NZ,Y
+https://mi.m.wikipedia.org/wiki/1788,US,Y
+http://tiritiowaitangi.govt.nz/people/maorileaders1840.php,NZ,Y
+http://www.tmoa.tki.org.nz/Te-Marautanga-o-Aotearoa/Nga-Wahanga-Ako/Putaiao,NZ,Y
+http://www.pakanae.maori.nz/,NZ,Y
+http://pukoro.co.nz/kohanga-of-the-week/ng-p-manu-ngunguru-school/,NZ,Y
+https://ttw1.cwp.govt.nz/a-matou-mahi/te-matapuna-language-advice/language-advice-for-private-sector/,NZ,Y
+http://www.tmoa.tki.org.nz/content/advancedsearch,NZ,?
+http://www.tmoa.tki.org.nz/Kura/He-Anga-Ako-ma-te-Pouako/Revere-McGregor,NZ,Y
+http://tiritiowaitangi.govt.nz/sitemap/,NZ,Y
+https://www.tetaurawhiri.govt.nz/rauemi-a-ipurangi/rauemi/ko-au/,NZ,?
+https://sexualviolence.victimsinfo.govt.nz/mi/home/have-you-been-affected/,NZ,Y
+http://m.biblepub.com/bibles/mb/19/102,US,Y
+http://tmoa.tki.org.nz/Taumata-Matauranga-a-Motu-Ka-Taea/Tikanga-A-Iwi/1.2-Te-whakaatu-maramatanga-mo-tetahi-wahi-tapu-ki-te-Maori,NZ,Y
+https://tiritiowaitangi.govt.nz/casestudies/ngaitahu.php,NZ,Y
+http://tmoa.tki.org.nz/Mataiako/Whiriwhiria-tetahi-rauemi-aromatawai/(area)/858/(sub_area)/867,NZ,Y
+http://pukoro.co.nz/mi/printables/super-hero/,NZ,Y
+http://pukoro.co.nz/mi/vocab-with-kori/steering-wheel/,NZ,Y
+https://admin.teara.govt.nz/mi/biographies/3t22/te-waharoa-tupu-atanatiu-taingakawa,NZ,Y
+https://www.tetaurawhiri.govt.nz/ratonga/licensing-of-translators-and-interpreters/,NZ,Y
+https://hepatakakupu.nz/comprehension,NZ,Y
+https://www.kiwiproperty.com/westgate-lifestyle/mi/kia-moohio-noa/,US,?
+http://kuraaiwi.maori.nz/ng257-ringa-wera.html,NZ,?
+http://www.twtop.school.nz/65/image_galleries/48-mauri-oho/categories/38-haerenga-ki-kanata-2017.rss,NZ,?
+http://www.huri-translations.pf/rarotongan/tangi-manu.html,NZ,?
+http://pukoro.co.nz/mi/crafts/making-a-shelter,NZ,Y
+https://mi.m.wikipedia.org/wiki/1726,US,?
+http://www.tmoa.tki.org.nz/Taumata-Matauranga-a-Motu-Ka-Taea/He-Karere-Hou,NZ,Y
+http://www.waiata.maori.nz/en/song/aku-kanohi-kau,NZ,Y
+http://tmoa.tki.org.nz/Karere-Hou/Te-Tautoko-76,NZ,Y
+http://www.tmoa.tki.org.nz/Karere-Hou/Te-whakahounga-o-Te-Waharoa-Ararau,NZ,Y
+http://pukoro.co.nz/mi/stories/the-disheartened-possum/,NZ,Y
+https://tetaurawhiri.govt.nz/rauemi-a-ipurangi/rauemi/nga-rerenga-korero-phrases/,NZ,Y
+http://tiritiowaitangi.govt.nz/story/earlytwentiethcentury.php,NZ,Y
+http://www.tmoa.tki.org.nz/Taumata-Matauranga-a-Motu-Ka-Taea/Hangarau/1.5-Te-whakamahi-rawa-te-whakamahi-tukanga-ranei-no-roto-mai-i-te-matauranga-Maori-hei-hanga-i-tetahi-hua-hangarau-mo-te-ao-hurihuri-nei,NZ,Y
+http://tmoa.tki.org.nz/Taumata-Matauranga-a-Motu-Ka-Taea/He-Karere-Hou,NZ,Y
+http://www.tmoa.tki.org.nz/Pakiwaitara-Marau/Te-Kaupapa-o-Tukaikaha,NZ,Y
+https://kupengahao.co.nz/items/tihei-pangarau-te-tauanga-taumata-4/,NZ,Y
+https://paekupu.co.nz/word/arani,NZ,?
+https://www.tetaurawhiri.govt.nz/assets/Corporate-publications/SPE/5cec96f373/TTWh-He-Ara-Whaia-He-Ara-Hou-2016-17-Mi.pdf,NZ,Y
+http://www.twtop.school.nz/66/blogs/1-te-ohinga-panui/posts/7-term-1-week-8,NZ,Y
+http://www.tmoa.tki.org.nz/Te-Marautanga-o-Aotearoa/Te-Anga/Nga-Wahanga-o-Te-Marautanga-o-Aotearoa/Diagram,NZ,Y
+https://ttw1.cwp.govt.nz/assets/Corporate-publications/He-Muka/2010/Putanga-23-3-Koanga-2010.pdf,NZ,Y
+http://animations.tewhanake.maori.nz/te-mahuri/te-whanga-tuatoru/418,NZ,?
+https://mi.m.wikipedia.org/wiki/1796,US,Y
+http://www.tmoa.tki.org.nz/content/download/2241/17084/file/91659-sam-2014.doc,NZ,Y
+http://tmoa.tki.org.nz/Puna-Mahara/Nga-Whanaketanga-Rumaki-Maori/Te-Hotaka,NZ,Y
+https://tetaurawhiri.govt.nz/rauemi-a-ipurangi/rauemi/hangarau/,NZ,?
+https://www.tetaurawhiri.govt.nz/rauemi-a-ipurangi/rauemi/aotearoa/,NZ,Y
+http://tmoa.tki.org.nz/Pakiwaitara-Marau/Te-Kura-Kaupapa-Maori-o-Kaikohe-Pouherenga-Tai,NZ,Y
+https://paekupu.co.nz/word/ahunga-koaro,NZ,?
+http://www.waiata.maori.nz/mri/song/whakarongo,NZ,Y
+http://www.wcl.govt.nz/mawhaituhi/,NZ,Y
+http://tmoa.tki.org.nz/Te-Marautanga-o-Aotearoa/Nga-Wahanga-Ako/Te-Reo-Maori/Te-Reo-Maori-Nga-Whakamarama,NZ,Y
+https://www.tetaurawhiri.govt.nz/kaupapa/tanga-rangatopu/he-kupu-whakamarama-ki-te-minita-hou/,NZ,Y
+http://tmoa.tki.org.nz/Kura/He-Reo-Moteatea-Tirohanga-whanui/Ruaumoko-Maori/Ruaumoko-Taumata-1-2,NZ,Y
+http://www.tmoa.tki.org.nz/Mataiako/Wahanga-Aromatawai/Te-Reo-Maori/Panui/He-Matai-Matatupu-2-Te-Tautu-Reta,NZ,Y
+http://maori.livingheritage.org.nz/Pae-mahere/Te-Whai-wahitanga,NZ,Y
+https://tetaurawhiri.govt.nz/rauemi-a-ipurangi/rauemi/akina-te-reo-maramataka/,NZ,Y
+http://tmoa.tki.org.nz/Te-Marautanga-o-Aotearoa/Te-Anga/Te-Putake-o-Te-Marautanga-o-Aotearoa,NZ,Y
+http://ngatipahauwera.co.nz/nga-konae/,NZ,Y
+https://mi.m.wikipedia.org/wiki/1748,US,Y
+http://tmoa.tki.org.nz/Mataiako/Ako/Ka-arotahi-te-aromatawai-ki-te-akonga,NZ,
+http://www.waiata.maori.nz/mri/song/aku-kanohi-kau,NZ,
+https://sexualviolence.victimsinfo.govt.nz/mi/glossary/showterm/kaitohutohu+p%c4%81rurenga+koeretanga/,NZ,
+http://tmoa.tki.org.nz/Kura/He-Reo-Moteatea-Tirohanga-whanui/Ka-Eke-ki-Wairaka-Maori/Ka-Eke-ki-Wairaka,NZ,
+http://www.waiata.maori.nz/en/song/mahara,NZ,
+https://mi.m.wikipedia.org/wiki/1886,US,
+http://m.biblepub.com/bibles/mb/11/16,US,
+https://mi.wikipedia.org/wiki/1779,US,
+https://www.tetaurawhiri.govt.nz/rauemi-a-ipurangi/rauemi/te-reo-i-te-kainga/,NZ,
+http://pukoro.co.nz/mi/crafts/making-chocolate/,NZ,
+http://www.kurakokiri.maori.nz/about.html,NZ,
+https://www.tetaurawhiri.govt.nz/rauemi-a-ipurangi/rauemi/kia-ora-hakinakina-booklet/,NZ,
+https://www.tetaurawhiri.govt.nz/rauemi-a-ipurangi/rauemi/everyday-labels/,NZ,
+https://tiritiowaitangi.govt.nz/maps/maoriland1910.php,NZ,
+https://tetaurawhiri.govt.nz/kaupapa/panui-papaho/ka-tuwhera-te-tono-putea-ma-te-reo-mo-nga-tau-2016/,NZ,
+https://mi.m.wikipedia.org/wiki/1855,US,
+https://tiritiowaitangi.govt.nz/story/growinginterest.php,NZ,
+http://www.tmoa.tki.org.nz/Pakiwaitara-Marau/Te-Waharoa-Ararau,NZ,
+http://piripi.blogspot.com/,US,
+http://www.tmoa.tki.org.nz/Rangahau/He-Uiui-Kaiako-mo-NWRM2,NZ,
+http://www.tmoa.tki.org.nz/Mataiako/Wahanga-Aromatawai/Pangarau/Te-Poutama-Tau-Uiui-Aromatawai,NZ,
+https://www.tetaurawhiri.govt.nz/rauemi-a-ipurangi/rauemi/te-tini-a-tane/,NZ,
+http://www.tmoa.tki.org.nz/Rauemi-Whanui/Te-Arotake-i-te-Marau-a-Kura,NZ,
+http://www.livingheritage.org.nz/layout/set/print/Schools-Stories/Ko-Hongoeka-te-Marae/Ko-to-Matou-Ropu-Rangahau,NZ,
+http://www.tmoa.tki.org.nz/Kura/Te-Reo-a-Waha/Te-whakaako-reo-a-waha/Nga-rautaki-whakaako-reo-tuarua,NZ,
+http://www.tmoa.tki.org.nz/Karere-Hou/He-Rau-Taki-Korero,NZ,
+http://www.tmoa.tki.org.nz/Karere-Hou,NZ,
+https://mi.m.wikipedia.org/wiki/1867,US,
+https://mi.m.wikipedia.org/wiki/1813,US,
+http://tmoa.tki.org.nz/Te-Marautanga-o-Aotearoa/Te-Anga/Nga-Wahanga-o-Te-Marautanga-o-Aotearoa,NZ,
+http://www.tmoa.tki.org.nz/Pakiwaitara-Marau/Tutarawananga-Nga-uara-Maori,NZ,
+http://www.tmoa.tki.org.nz/Karere-Hou/Nga-Tauaromahi,NZ,
+https://csunplugged.org/mi/computational-thinking/,US,
+http://tmoa.tki.org.nz/Mataiako/Ako/He-tino-auaha-te-mahi-ako,NZ,
+http://m.biblepub.com/bibles/mb/1/47,US,
+http://tmoa.tki.org.nz/Karere-Hou/Ka-Hikitia,NZ,
+https://tetaurawhiri.govt.nz/rauemi-a-ipurangi/rauemi/kiakaha/,NZ,
+https://ttw1.cwp.govt.nz/he-muka/he-muka-archive/2015-2019/,NZ,
+https://ttw1.cwp.govt.nz/assets/Corporate-publications/He-Muka/2014/Putanga-27-2-Ngahuru-2014.pdf,NZ,
+http://tiritiowaitangi.govt.nz/casestudies/ngaitahu.php,NZ,
+http://m.biblepub.com/bibles/mb/16/6,US,
+http://www.twtop.school.nz/774/pages/57-nga-tikanga-whakanui-o-aotearoa,NZ,
+http://tmoa.tki.org.nz/Taumata-Matauranga-a-Motu-Ka-Taea/Pangarau/1.9-Te-whakamahi-ahuahanga-panoni-hei-whakaoti-rapanga,NZ,
+http://www.tkkmmokopuna.school.nz/1/profile_areas/1-nga-kaimahi-o-nga-mokopuna/categories/3-wharekura/profiles/9-barbara-zerzouri,NZ,
+https://tetaurawhiri.govt.nz/kaupapa/panui-papaho/katahi-te-pai-o-te-whakaako-reo-maori-e-haere-nei-kia-kaha-ake-ra/,NZ,
+http://www.tkkmmokopuna.school.nz/1/image_galleries/3-2018-whakaahua/categories/12-2018-puna-kaukau,NZ,
+https://www.tetaurawhiri.govt.nz/kaupapa/panui-papaho/te-reo-maori-revitalisation-celebrated/,NZ,
+http://tmoa.tki.org.nz/Pakiwaitara-Marau/Te-Kura-o-Titahi-ki-te-Raki,NZ,
+http://kuraproductions.co.nz/mi/shows/only-in-aotearoa,NZ,
+http://www.tmoa.tki.org.nz/Akonga,NZ,
+http://www.tmoa.tki.org.nz/Pakiwaitara-Marau/Tatari-Tautoko-Tauawhi-Nawton-School,NZ,
+http://tmoa.tki.org.nz/Karere-Hou/He-rauemi-arataki-i-te-pouako,NZ,
+http://www.tmoa.tki.org.nz/Karere-Hou/Mataiako,NZ,
+http://www.tmoa.tki.org.nz/Pakiwaitara-Marau/Wai-Study-Help,NZ,
+http://tmoa.tki.org.nz/Kura/He-Reo-Moteatea-Overview/Ruaumoko-English,NZ,
+https://maorinews.com/writings/papers/newsltrs/hokjan63.html,US,
+http://tmoa.tki.org.nz/Taumata-Matauranga-a-Motu-Ka-Taea/Te-Reo-Rangatira/TRR-1.11-Te-whakaatu-i-nga-putanga-rangahau,NZ,
+https://tetaurawhiri.govt.nz/kaupapa/panui-papaho/nga-tohu-reo-maori/,NZ,
+http://pukoro.co.nz/mi/songs-and-lyrics/at-school/,NZ,
+http://pukoro.co.nz/mi/learning-points/test-learning-points/,NZ,
+http://www.kura-porirua.school.nz/194/profile_areas/5-te-rarangi-kaimahi-staff-directory,NZ,
+http://www.tmoa.tki.org.nz/Pakiwaitara-Marau,NZ,
+http://www.tmoa.tki.org.nz/Taumata-Matauranga-a-Motu-Ka-Taea/He-Maherehere-Paerewa-Paetae2,NZ,
+http://tmoa.tki.org.nz/Kura/He-Reo-Moteatea-Overview/Tirotiro-Kau-Au-English,NZ,
+https://paekupu.co.nz/word/arahau,NZ,
+http://www.twtop.school.nz/869/pages/84-tangaroa,NZ,
+http://www.tmoa.tki.org.nz/Karere-Hou/Toi-Te-Kupu-102-Te-Putanga-2-2016,NZ,
+https://www.sporty.co.nz/kuratakitimu/Akomanga/Akomanga-tuarua,NZ,
+https://www.sporty.co.nz/kuratakitimu/Mahi/Kapa-Haka,NZ,
+https://www.tetaurawhiri.govt.nz/events/maramataka/mobilising-te-reo-dunedin/,NZ,

other-projects/maori-lang-detection/src/org/greenstone/atea/MongoDBQueryer.java

@@ -113 +113 @@
     
     /** 
-     * Java mongodb find: https://mongodb.github.io/mongo-java-driver/3.4/driver/getting-started/quick-start/ 
+     * Java mongodb find: https://mongodb.github.io/mongo-java-driver/3.4/driver/getting-started/quick-start/ (but we're in version 3.9)
+     * https://mongodb.github.io/mongo-java-driver/3.9/javadoc/com/mongodb/client/MongoCollection.html
      * Java mongodb find filters: https://mongodb.github.io/mongo-java-driver/3.4/javadoc/?com/mongodb/client/model/Filters.html
      * Java mongodb projection: https://stackoverflow.com/questions/44894497/retrieving-data-with-mongodb-java-driver-3-4-using-find-method-with-projection
@@ -176 +177 @@
     
     return urlsList;
+    }
+    
+    /** 
+     * @param webPageURL the url of the web page stored in mongodb's Webpages
+     * collection for which the full text field is to be returned.
+     * @return full text string for web page URL.
+     * MongoDB query finds the MongoDB document in the Webpages collection
+     * with that exact URL and returns just the full text field value.
+     */
+    public String displayFullTextOfPage(String webPageURL) {
+    String fulltext = "";
+    
+    // load the "webpages" db table
+    // in mongodb, the equivalent of db tables are called 'collections' 
+    MongoCollection<Document> collection = getWebpagesCollection();
+
+    // code we'll execute in Iterable.forEach() below
+    // see also https://www.baeldung.com/foreach-java
+    Block<Document> printFullText = new Block<Document>() {
+        @Override
+        public void apply(final Document document) {            
+            String text = document.getString("text");           
+            System.out.println(text);
+            
+        }
+        };
+
+    
+    // Run the following mongodb query:
+    //    db.getCollection('Webpages').find({URL: "<webPageURL>"}, {text: 1, _id: 0})
+    // e.g.
+    //db.getCollection('Webpages').find({URL: "https://ttw1.cwp.govt.nz/he-muka/kainga/he-oranga-reo-he-oranga-tangata/"}, {text: 1, _id: 0})
+    
+    String query = "{URL: \""+webPageURL+"\"}";
+    
+    //System.err.println("Executing find query: " + query);
+    
+    BasicDBObject findObj = BasicDBObject.parse(query);
+    BasicDBObject projectionObj = BasicDBObject.parse("{text: 1, _id: 0}");
+    
+
+    //collection.find(findObj).projection(projectionObj).forEach(printFullText);
+    //fulltext = collection.find(findObj).projection(projectionObj).first().getString("text");
+    Document mongodbDoc = collection.find(findObj).projection(projectionObj).first();
+    fulltext = mongodbDoc.getString("text");
+
+    
+    return fulltext;
     }
     

other-projects/maori-lang-detection/src/org/greenstone/atea/SummaryTool.java

@@ -10 +10 @@
 /**
  * Runs some of the important mongoDB queries I ran.
+ * Produces json results of the queries, tables of results,
+ * geojson files for counts-by-country results and attempts to
+ * save screenshots of the maps generated from the geojson files.
  *
- * This program expects a folder ../mongo-data-auto to exist.
+ * PREREQUISITES: This program expects a folder ../mongo-data-auto to exist.
  *
  * TO COMPILE OR RUN, FIRST DO:
@@ -26 +29 @@
  *       java -cp ".:../conf:../lib/*" org/greenstone/atea/SummaryTool
  * OR:
- *       java -cp ".:../conf:../lib/*" org/greenstone/atea/SummaryTool ../mongodb-data/domainsNZ_IsMRI.txt
+ *       java -cp ".:../conf:../lib/*" org/greenstone/atea/SummaryTool ../mongodb-data/manualList_globalDomains_whereAPageContainsMRI.txt
  *
 */
@@ -480 +483 @@
         }
 
-        System.out.println("*************************************");
+        logger.info("*************************************");
     } catch(Exception e) {
         logger.error(e.getMessage(), e);