Changeset 33800

Timestamp:

2019-12-12T18:04:10+13:00 (4 years ago)

Author:

ak19

Message:

Removed an adult site from crawled contents and added its url to blacklist conf file (for if ever anyone crawls our MRI set of common crawl sites again)

Location:

other-projects/maori-lang-detection

Files:

• MoreReading/mongodb.txt (modified) (view diffs)
• conf/url-blacklist-filter.txt (modified) (view diffs)
• crawledNode2.tar (modified) (view diffs)
• src/org/greenstone/atea/CountryCodeCountsMapData.java (modified) (view diffs)
• src/org/greenstone/atea/NutchTextDumpToMongoDB.java (modified) (view diffs)